Leaderboard Neuron Segmentation
Results for the neuron segmentation category, averaged over all samples.
Group | Submission | CREMI score | VOI split | VOI merge | ARAND |
---|---|---|---|---|---|
DIVE | seg018 | 0.787 | 1.567 | 0.325 | 0.336 |
DIVE | seg030 | 0.793 | 1.584 | 0.328 | 0.337 |
DIVE | seg0316 | 0.775 | 1.536 | 0.327 | 0.331 |
DIVE | seg1 | 0.745 | 1.461 | 0.242 | 0.333 |
DIVE | seg2 | 0.735 | 1.438 | 0.239 | 0.330 |
DIVE | seg3 | 0.798 | 1.587 | 0.351 | 0.341 |
DIVE | seg4 | 0.791 | 1.565 | 0.347 | 0.340 |
DIVE | seg5 | 0.730 | 1.423 | 0.243 | 0.328 |
DIVE | seg7 | 0.717 | 1.398 | 0.232 | 0.324 |
DIVE | seg8 | 0.717 | 1.388 | 0.239 | 0.325 |
DIVE | seg9 | 0.711 | 1.381 | 0.234 | 0.322 |
DIVE | segBC018 | 0.717 | 1.347 | 0.422 | 0.296 |
DIVE | segBW1 | 0.693 | 1.296 | 0.314 | 0.304 |
DIVE | segBW2 | 0.776 | 1.111 | 0.651 | 0.346 |
DIVE | segBW3 | 0.776 | 1.110 | 0.653 | 0.346 |
DIVE | segBW4 | 0.772 | 1.113 | 0.645 | 0.344 |
DIVE | segBW5 | 0.775 | 1.112 | 0.651 | 0.345 |
PCH | sff_a | 0.277 | 0.473 | 0.119 | 0.131 |
PCH | sff_aug | 0.277 | 0.471 | 0.118 | 0.130 |
IAL | spUNet1 | 0.504 | 0.873 | 0.091 | 0.266 |
IAL | spUNetHC | 0.540 | 0.755 | 0.325 | 0.271 |
IAL | spUNetMC | 0.317 | 0.519 | 0.125 | 0.156 |
VCG | testmala | 2.412 | 3.297 | 3.283 | 0.888 |
- | testsubm | 2.683 | 3.083 | 4.768 | 0.918 |
DIVE | unet-1 | 1.001 | 1.436 | 0.861 | 0.443 |
Legend
- CREMI score
- The geometric mean of (VOI split + VOI merge) and ARAND.
- VOI split and merge
- The Variation of Information between a segmentation X and ground truth Y. The split and merge parts correspond to the conditional entropies H(X|Y) and H(Y|X), respectively.
- ARAND
- The Adapted Rand Error, i.e., 1.0 - Rand F-Score.
For each value, lower is better.
Leaderboard Synaptic Cleft Detection
Results for the synaptic cleft detection category, averaged over all samples.
Group | Submission | CREMI score | FP | FN | 1 - F-score | ADGT | ADF |
---|---|---|---|---|---|---|---|
VCG | FgUPlus | 57.90 | 137412.7 | 4763.3 | 0.160 | 90.99 | 24.81 |
VCG | FgSm0808 | 57.34 | 75120.7 | 9109.7 | 0.107 | 72.74 | 41.94 |
VCG | FgSm0805 | 54.23 | 111486.0 | 4917.0 | 0.142 | 84.04 | 24.43 |
VCG | FgSemi08 | 55.41 | 160792.7 | 3178.3 | 0.181 | 96.54 | 14.28 |
VCG | FgSemi05 | 57.63 | 221731.7 | 975.7 | 0.232 | 107.73 | 7.52 |
VCG | FgRj0808 | 117.25 | 1329995.3 | 327.7 | 0.610 | 232.66 | 1.84 |
VCG | FgRj0805 | 117.25 | 1329995.3 | 327.7 | 0.610 | 232.66 | 1.84 |
VCG | FgDTSm08 | 434.91 | 4747.0 | 355265.0 | 0.619 | 42.86 | 826.96 |
VCG | FgDTSm05 | 232.99 | 15377.7 | 173608.0 | 0.349 | 56.70 | 409.27 |
VCG | FgDT08 | 795.59 | 727.0 | 616222.3 | 0.834 | 60.07 | 1531.10 |
VCG | FgDT05 | 124.93 | 15650.7 | 88933.3 | 0.165 | 41.04 | 208.83 |
I2I | FCEval | 66.45 | 107963.7 | 21352.3 | 0.179 | 82.28 | 50.62 |
DIVE | Exp12_64 | 202.46 | 335698.7 | 0.0 | 0.374 | 402.99 | 1.93 |
JRC | DTU-2 | 67.56 | 70761.3 | 10069.3 | 0.123 | 109.67 | 25.46 |
JRC | DTU-1 | 72.21 | 85169.0 | 13607.3 | 0.131 | 106.31 | 38.11 |
DLST | DLST003 | 91.71 | 33118.7 | 35934.7 | 0.125 | 58.14 | 125.27 |
DLST | DLST002 | 75.46 | 56645.7 | 17498.3 | 0.119 | 65.93 | 85.00 |
DLST | DLST001 | 71.19 | 53908.0 | 14839.0 | 0.106 | 69.02 | 73.36 |
lbdl | Cleft_lb | 97.85 | 227868.0 | 0.0 | 0.262 | 181.08 | 14.61 |
DIVE | CleftNet | 57.73 | 116095.3 | 8004.3 | 0.169 | 85.60 | 29.87 |
DIVE | CleftC5 | 65.75 | 125395.7 | 11906.7 | 0.181 | 84.10 | 47.41 |
DIVE | CleftC4 | 65.38 | 112813.3 | 14762.3 | 0.179 | 82.62 | 48.15 |
DIVE | CleftC3 | 66.19 | 112868.0 | 18785.0 | 0.180 | 82.73 | 49.65 |
DIVE | CleftC2 | 66.19 | 117135.0 | 19904.7 | 0.181 | 83.30 | 49.08 |
DIVE | CleftC1 | 66.50 | 149148.3 | 12971.0 | 0.187 | 86.56 | 46.43 |
Legend
- CREMI score
- The mean of ADGT and ADF. We are not including the F-Score for now, as our current way of computing it can lead to unfair comparison. We are working on a more robust measure and will update the results accordingly.
- FP, FN, and F-Score
- The False Positives, False Negatives, and the resulting F-Score in the clefts detection volume. See metrics for details.
- ADGT
- The average distance of any found cleft voxel to the closest ground truth cleft voxel.
- ADF
- The average distance of any ground truth cleft voxel to the closest found cleft voxel.
For each value, lower is better (F-Score shown as 1 - F-Score).
Leaderboard Synaptic Partner Identification
Results for the synaptic partner identification category, averaged over all samples.
Group | Submission | CREMI score | FP | FN |
---|---|---|---|---|
AnonumoysGroup | PrTrn66 | 0.620 | 238.000 | 451.667 |
NO2 | lr_affin | 0.567 | 118.333 | 450.000 |
PNI | asyn_ori | 0.493 | 310.000 | 302.333 |
PNI | asyn_at1 | 0.490 | 274.333 | 314.667 |
HCBS | Tr66t-01 | 0.469 | 182.667 | 318.667 |
PNI | asyn_at0 | 0.468 | 293.333 | 297.000 |
HCBS | PrnTrn66 | 0.465 | 178.667 | 322.333 |
IAL | PSP_full | 0.464 | 187.333 | 310.000 |
IAL | PSP_unar | 0.461 | 266.667 | 281.000 |
DIVE | PTR_V2 | 0.453 | 162.667 | 333.667 |
HCBS | Tr66comb | 0.451 | 219.000 | 292.333 |
HCBS | Tr66_80K | 0.449 | 223.000 | 286.667 |
NO2 | lr_balan | 0.447 | 175.333 | 314.000 |
PNI | asyn_mod | 0.423 | 367.667 | 262.333 |
- 14 items
Legend
- CREMI score
- 1 - F-Score of the FP and FN.
- FP, FN
- The False Positives and False Negatives synaptic partner pairs. See metrics for details.
For each value, lower is better.