Leaderboard Neuron Segmentation
Results for the neuron segmentation category, averaged over all samples.
Group | Submission | CREMI score | VOI split | VOI merge | ARAND |
---|---|---|---|---|---|
DIVE | CRNNGate | 0.514 | 1.191 | 0.196 | 0.194 |
DIVE | MSTW | 0.537 | 0.915 | 0.168 | 0.268 |
DIVE | ag35-42 | 0.553 | 0.999 | 0.150 | 0.267 |
DIVE | DISW | 0.557 | 1.035 | 0.149 | 0.265 |
DIVE | CRunet2 | 0.566 | 1.081 | 0.389 | 0.229 |
DIVE | focalMST | 0.603 | 1.027 | 0.244 | 0.289 |
DIVE | CRunet1 | 0.619 | 1.141 | 0.381 | 0.275 |
DIVE | MPfcn | 0.625 | 1.063 | 0.486 | 0.260 |
DIVE | Segment | 0.670 | 1.275 | 0.315 | 0.287 |
DIVE | seg&BW | 0.679 | 1.287 | 0.318 | 0.292 |
DIVE | SegCleft | 0.679 | 1.286 | 0.319 | 0.292 |
DIVE | segBW1 | 0.693 | 1.296 | 0.314 | 0.304 |
DIVE | ftSeg1 | 0.695 | 1.224 | 0.355 | 0.311 |
DIVE | ftSeg2 | 0.698 | 1.218 | 0.436 | 0.299 |
DIVE | seg&BW1 | 0.699 | 1.320 | 0.319 | 0.303 |
DIVE | seg&BW4 | 0.700 | 1.322 | 0.321 | 0.303 |
DIVE | seg&BW2 | 0.701 | 1.307 | 0.327 | 0.306 |
DIVE | seg&BW5 | 0.702 | 1.308 | 0.328 | 0.307 |
DIVE | ag35-2 | 0.702 | 0.917 | 0.402 | 0.384 |
DIVE | seg9 | 0.711 | 1.381 | 0.234 | 0.322 |
DIVE | seg&BW3 | 0.714 | 1.343 | 0.322 | 0.312 |
DIVE | segBC018 | 0.717 | 1.347 | 0.422 | 0.296 |
DIVE | seg8 | 0.717 | 1.388 | 0.239 | 0.325 |
DIVE | seg7 | 0.717 | 1.398 | 0.232 | 0.324 |
DIVE | SegClef1 | 0.723 | 1.365 | 0.425 | 0.298 |
Legend
- CREMI score
- The geometric mean of (VOI split + VOI merge) and ARAND.
- VOI split and merge
- The Variation of Information between a segmentation X and ground truth Y. The split and merge parts correspond to the conditional entropies H(X|Y) and H(Y|X), respectively.
- ARAND
- The Adapted Rand Error, i.e., 1.0 - Rand F-Score.
For each value, lower is better.
Leaderboard Synaptic Cleft Detection
Results for the synaptic cleft detection category, averaged over all samples.
Group | Submission | CREMI score | FP | FN | 1 - F-score | ADGT | ADF |
---|---|---|---|---|---|---|---|
DIVE | CleftC2 | 66.19 | 117135.0 | 19904.7 | 0.181 | 83.30 | 49.08 |
DIVE | CleftC3 | 66.19 | 112868.0 | 18785.0 | 0.180 | 82.73 | 49.65 |
DIVE | CleftC4 | 65.38 | 112813.3 | 14762.3 | 0.179 | 82.62 | 48.15 |
I2I | FCEval | 66.45 | 107963.7 | 21352.3 | 0.179 | 82.28 | 50.62 |
3DEM | BC_BC | 66.71 | 82113.3 | 13347.3 | 0.126 | 79.96 | 53.46 |
DIVE | Mix_ABC1 | 74.39 | 101269.0 | 16022.0 | 0.174 | 79.04 | 69.73 |
DIVE | Mix_ABC2 | 75.02 | 131499.0 | 13795.7 | 0.200 | 78.36 | 71.67 |
3DEM | ABC_BC1 | 61.72 | 114005.0 | 10670.3 | 0.170 | 76.99 | 46.46 |
3DEM | ABC_BC2 | 61.70 | 110946.0 | 10787.3 | 0.168 | 76.67 | 46.73 |
DIVE | BouUNet | 81.45 | 75985.0 | 21974.0 | 0.160 | 76.66 | 86.24 |
3DEM | ABC_BC | 62.21 | 99221.7 | 10981.0 | 0.151 | 75.79 | 48.63 |
VCG | FgSm0808 | 57.34 | 75120.7 | 9109.7 | 0.107 | 72.74 | 41.94 |
I2I | CSparSep | 75.79 | 71650.0 | 18918.3 | 0.140 | 72.06 | 79.52 |
DIVE | WeitUNet | 78.12 | 54372.7 | 24480.3 | 0.128 | 71.51 | 84.73 |
VCG | FgUPlus8 | 58.66 | 65345.7 | 11887.0 | 0.101 | 70.36 | 46.96 |
DLST | DLST001 | 71.19 | 53908.0 | 14839.0 | 0.106 | 69.02 | 73.36 |
DLST | DLST002 | 75.46 | 56645.7 | 17498.3 | 0.119 | 65.93 | 85.00 |
CMM | Max Test | 74.10 | 24019.3 | 44179.7 | 0.101 | 64.63 | 83.56 |
DKFZ-MIC | nnUNet | 74.96 | 49914.0 | 18981.3 | 0.117 | 64.46 | 85.46 |
HSS | 3DUNet | 65.34 | 43440.3 | 22443.3 | 0.106 | 63.26 | 67.43 |
VCG | FgDT08 | 795.59 | 727.0 | 616222.3 | 0.834 | 60.07 | 1531.10 |
DLST | DLST003 | 91.71 | 33118.7 | 35934.7 | 0.125 | 58.14 | 125.27 |
VCG | FgDTSm05 | 232.99 | 15377.7 | 173608.0 | 0.349 | 56.70 | 409.27 |
HSS | 3DUNet04 | 79.33 | 29732.0 | 27514.3 | 0.113 | 53.22 | 105.44 |
VCG | FgDTSm08 | 434.91 | 4747.0 | 355265.0 | 0.619 | 42.86 | 826.96 |
Legend
- CREMI score
- The mean of ADGT and ADF. We are not including the F-Score for now, as our current way of computing it can lead to unfair comparison. We are working on a more robust measure and will update the results accordingly.
- FP, FN, and F-Score
- The False Positives, False Negatives, and the resulting F-Score in the clefts detection volume. See metrics for details.
- ADGT
- The average distance of any found cleft voxel to the closest ground truth cleft voxel.
- ADF
- The average distance of any ground truth cleft voxel to the closest found cleft voxel.
For each value, lower is better (F-Score shown as 1 - F-Score).
Leaderboard Synaptic Partner Identification
Results for the synaptic partner identification category, averaged over all samples.
Group | Submission | CREMI score | FP | FN |
---|---|---|---|---|
PNI | asyn_mod | 0.423 | 367.667 | 262.333 |
PNI | asyn_ori | 0.493 | 310.000 | 302.333 |
PNI | asyn_at0 | 0.468 | 293.333 | 297.000 |
PNI | asyn_at1 | 0.490 | 274.333 | 314.667 |
IAL | PSP_unar | 0.461 | 266.667 | 281.000 |
AnonumoysGroup | PrTrn66 | 0.620 | 238.000 | 451.667 |
HCBS | Tr66_80K | 0.449 | 223.000 | 286.667 |
HCBS | Tr66comb | 0.451 | 219.000 | 292.333 |
IAL | PSP_full | 0.464 | 187.333 | 310.000 |
HCBS | Tr66t-01 | 0.469 | 182.667 | 318.667 |
HCBS | PrnTrn66 | 0.465 | 178.667 | 322.333 |
NO2 | lr_balan | 0.447 | 175.333 | 314.000 |
DIVE | PTR_V2 | 0.453 | 162.667 | 333.667 |
NO2 | lr_affin | 0.567 | 118.333 | 450.000 |
- 14 items
Legend
- CREMI score
- 1 - F-Score of the FP and FN.
- FP, FN
- The False Positives and False Negatives synaptic partner pairs. See metrics for details.
For each value, lower is better.