Leaderboard Neuron Segmentation
Results for the neuron segmentation category, averaged over all samples.
Group | Submission | CREMI score | VOI split | VOI merge | ARAND |
---|---|---|---|---|---|
DIVE | pi-net | 0.728 | 1.480 | 0.270 | 0.305 |
DIVE | seg5 | 0.730 | 1.423 | 0.243 | 0.328 |
DIVE | seg2 | 0.735 | 1.438 | 0.239 | 0.330 |
DIVE | seg1 | 0.745 | 1.461 | 0.242 | 0.333 |
DIVE | CRunet22 | 0.746 | 1.522 | 0.438 | 0.298 |
DIVE | newSeg | 0.752 | 1.471 | 0.252 | 0.335 |
DIVE | ag35-4 | 0.759 | 0.899 | 0.510 | 0.416 |
DIVE | M2uD_CSR | 0.766 | 1.030 | 0.770 | 0.329 |
DIVE | segBW4 | 0.772 | 1.113 | 0.645 | 0.344 |
DIVE | seg0316 | 0.775 | 1.536 | 0.327 | 0.331 |
DIVE | segBW5 | 0.775 | 1.112 | 0.651 | 0.345 |
DIVE | segBW2 | 0.776 | 1.111 | 0.651 | 0.346 |
DIVE | segBW3 | 0.776 | 1.110 | 0.653 | 0.346 |
DIVE | ag35-3 | 0.784 | 0.829 | 0.612 | 0.433 |
DIVE | seg018 | 0.787 | 1.567 | 0.325 | 0.336 |
DIVE | seg4 | 0.791 | 1.565 | 0.347 | 0.340 |
DIVE | ag35-5 | 0.793 | 1.491 | 0.296 | 0.358 |
DIVE | seg030 | 0.793 | 1.584 | 0.328 | 0.337 |
DIVE | seg3 | 0.798 | 1.587 | 0.351 | 0.341 |
DIVE | ag35 | 0.804 | 0.853 | 0.647 | 0.438 |
DIVE | unet2 | 0.972 | 1.481 | 0.803 | 0.419 |
DIVE | unet-2 | 0.972 | 1.481 | 0.803 | 0.419 |
DIVE | unet4 | 0.987 | 1.523 | 0.775 | 0.429 |
DIVE | unet-4 | 0.987 | 1.523 | 0.775 | 0.429 |
DIVE | unet3 | 0.994 | 1.451 | 0.831 | 0.441 |
Legend
- CREMI score
- The geometric mean of (VOI split + VOI merge) and ARAND.
- VOI split and merge
- The Variation of Information between a segmentation X and ground truth Y. The split and merge parts correspond to the conditional entropies H(X|Y) and H(Y|X), respectively.
- ARAND
- The Adapted Rand Error, i.e., 1.0 - Rand F-Score.
For each value, lower is better.
Leaderboard Synaptic Cleft Detection
Results for the synaptic cleft detection category, averaged over all samples.
Group | Submission | CREMI score | FP | FN | 1 - F-score | ADGT | ADF |
---|---|---|---|---|---|---|---|
I2I | CleftB | 74.31 | 65334.0 | 21669.0 | 0.142 | 92.36 | 56.26 |
DIVE | BouUNet | 81.45 | 75985.0 | 21974.0 | 0.160 | 76.66 | 86.24 |
HSS | 3DUNet | 65.34 | 43440.3 | 22443.3 | 0.106 | 63.26 | 67.43 |
DIVE | CRunet22 | 180.77 | 162763.0 | 23055.7 | 0.312 | 305.59 | 55.95 |
DIVE | WeitUNet | 78.12 | 54372.7 | 24480.3 | 0.128 | 71.51 | 84.73 |
HSS | HSZ | 90.11 | 65092.3 | 25807.3 | 0.154 | 99.61 | 80.61 |
HSS | 3DUNet04 | 79.33 | 29732.0 | 27514.3 | 0.113 | 53.22 | 105.44 |
DIVE | clefitlo | 151.12 | 105664.7 | 32928.0 | 0.220 | 190.20 | 112.05 |
DLST | DLST003 | 91.71 | 33118.7 | 35934.7 | 0.125 | 58.14 | 125.27 |
CMM | Max Test | 74.10 | 24019.3 | 44179.7 | 0.101 | 64.63 | 83.56 |
DIVE | CRNNGate | 120.36 | 62609.0 | 47395.7 | 0.175 | 110.06 | 130.66 |
DIVE | cleft_hi | 107.24 | 44844.3 | 52063.7 | 0.158 | 94.14 | 120.33 |
IAL | A+test | 153.91 | 196558.0 | 55962.3 | 0.339 | 232.28 | 75.53 |
IAL | unaries | 150.64 | 175624.3 | 60151.3 | 0.327 | 213.52 | 87.77 |
IAL | full_mod | 137.73 | 153335.3 | 61967.7 | 0.310 | 176.37 | 99.09 |
Kreshuk | MG | 152.52 | 129494.3 | 63958.0 | 0.278 | 157.83 | 147.21 |
DIVE | cleftloh | 194.25 | 22502.0 | 67513.7 | 0.236 | 102.22 | 286.27 |
IAL | 3d_model | 229.78 | 86415.3 | 84295.0 | 0.317 | 255.27 | 204.29 |
VCG | FgDT05 | 124.93 | 15650.7 | 88933.3 | 0.165 | 41.04 | 208.83 |
3DEM | ABC_C | 375.91 | 289364.7 | 89797.7 | 0.619 | 385.49 | 366.34 |
SDG | Unet0 | 171.88 | 33308.3 | 108288.7 | 0.262 | 91.45 | 252.31 |
cxj | USTC | 284.98 | 1015564.7 | 108523.3 | 0.600 | 516.31 | 53.65 |
VCG | FgDTSm05 | 232.99 | 15377.7 | 173608.0 | 0.349 | 56.70 | 409.27 |
VCG | FgDTSm08 | 434.91 | 4747.0 | 355265.0 | 0.619 | 42.86 | 826.96 |
3DEM | BesA275 | 252.56 | 254701.0 | 581781.3 | 0.456 | 199.02 | 306.10 |
Legend
- CREMI score
- The mean of ADGT and ADF. We are not including the F-Score for now, as our current way of computing it can lead to unfair comparison. We are working on a more robust measure and will update the results accordingly.
- FP, FN, and F-Score
- The False Positives, False Negatives, and the resulting F-Score in the clefts detection volume. See metrics for details.
- ADGT
- The average distance of any found cleft voxel to the closest ground truth cleft voxel.
- ADF
- The average distance of any ground truth cleft voxel to the closest found cleft voxel.
For each value, lower is better (F-Score shown as 1 - F-Score).
Leaderboard Synaptic Partner Identification
Results for the synaptic partner identification category, averaged over all samples.
Group | Submission | CREMI score | FP | FN |
---|---|---|---|---|
PNI | asyn_mod | 0.423 | 367.667 | 262.333 |
PNI | asyn_ori | 0.493 | 310.000 | 302.333 |
PNI | asyn_at0 | 0.468 | 293.333 | 297.000 |
PNI | asyn_at1 | 0.490 | 274.333 | 314.667 |
IAL | PSP_unar | 0.461 | 266.667 | 281.000 |
AnonumoysGroup | PrTrn66 | 0.620 | 238.000 | 451.667 |
HCBS | Tr66_80K | 0.449 | 223.000 | 286.667 |
HCBS | Tr66comb | 0.451 | 219.000 | 292.333 |
IAL | PSP_full | 0.464 | 187.333 | 310.000 |
HCBS | Tr66t-01 | 0.469 | 182.667 | 318.667 |
HCBS | PrnTrn66 | 0.465 | 178.667 | 322.333 |
NO2 | lr_balan | 0.447 | 175.333 | 314.000 |
DIVE | PTR_V2 | 0.453 | 162.667 | 333.667 |
NO2 | lr_affin | 0.567 | 118.333 | 450.000 |
- 14 items
Legend
- CREMI score
- 1 - F-Score of the FP and FN.
- FP, FN
- The False Positives and False Negatives synaptic partner pairs. See metrics for details.
For each value, lower is better.