Leaderboard Neuron Segmentation
Results for the neuron segmentation category, averaged over all samples.
Group | Submission | CREMI score | VOI split | VOI merge | ARAND |
---|---|---|---|---|---|
IAL | CMaskSP2 | 0.327 | 0.339 | 0.205 | 0.201 |
JRC | MALA v1 | 0.327 | 0.524 | 0.165 | 0.156 |
IAL | MutexWS4 | 0.342 | 0.364 | 0.288 | 0.182 |
JRC | LSDLR | 0.344 | 0.336 | 0.256 | 0.203 |
VCG | mala-seg | 0.349 | 0.452 | 0.245 | 0.179 |
JRC | MALALMC | 0.352 | 0.640 | 0.116 | 0.165 |
IAL | MutexWS3 | 0.362 | 0.362 | 0.312 | 0.199 |
IAL | CMaskSP3 | 0.378 | 0.349 | 0.323 | 0.220 |
IAL | MWS | 0.392 | 0.718 | 0.100 | 0.187 |
IAL | LMC V5 | 0.398 | 0.597 | 0.272 | 0.184 |
IAL | LMC V1 | 0.399 | 0.646 | 0.211 | 0.187 |
IAL | UnetLRMC | 0.410 | 0.442 | 0.374 | 0.208 |
IAL | LMC V3 | 0.445 | 0.655 | 0.308 | 0.208 |
IAL | LMC V2 | 0.446 | 0.629 | 0.285 | 0.219 |
IAL | LMC V4 | 0.447 | 0.622 | 0.295 | 0.219 |
IAL | MutexWS2 | 0.469 | 0.427 | 0.551 | 0.228 |
IAL | spUNet1 | 0.504 | 0.873 | 0.091 | 0.266 |
DIVE | CRNNGate | 0.514 | 1.191 | 0.196 | 0.194 |
IAL | MutexWS1 | 0.514 | 0.423 | 0.626 | 0.255 |
IAL | LMC V6 | 0.516 | 0.672 | 0.415 | 0.245 |
VIDAR | unet3d | 0.534 | 0.833 | 0.282 | 0.256 |
DIVE | MSTW | 0.537 | 0.915 | 0.168 | 0.268 |
IAL | spUNetHC | 0.540 | 0.755 | 0.325 | 0.271 |
VIDAR | mala_py3 | 0.543 | 0.724 | 0.374 | 0.270 |
DIVE | ag35-42 | 0.553 | 0.999 | 0.150 | 0.267 |
Legend
- CREMI score
- The geometric mean of (VOI split + VOI merge) and ARAND.
- VOI split and merge
- The Variation of Information between a segmentation X and ground truth Y. The split and merge parts correspond to the conditional entropies H(X|Y) and H(Y|X), respectively.
- ARAND
- The Adapted Rand Error, i.e., 1.0 - Rand F-Score.
For each value, lower is better.
Leaderboard Synaptic Cleft Detection
Results for the synaptic cleft detection category, averaged over all samples.
Group | Submission | CREMI score | FP | FN | 1 - F-score | ADGT | ADF |
---|---|---|---|---|---|---|---|
VCG | FgDT08 | 795.59 | 727.0 | 616222.3 | 0.834 | 60.07 | 1531.10 |
VCG | FgDTSm08 | 434.91 | 4747.0 | 355265.0 | 0.619 | 42.86 | 826.96 |
DIVE | exp18_be | 136.63 | 8797.3 | 0.0 | 0.014 | 247.19 | 26.08 |
VCG | FgDTSm05 | 232.99 | 15377.7 | 173608.0 | 0.349 | 56.70 | 409.27 |
VCG | FgDT05 | 124.93 | 15650.7 | 88933.3 | 0.165 | 41.04 | 208.83 |
DIVE | cleftloh | 194.25 | 22502.0 | 67513.7 | 0.236 | 102.22 | 286.27 |
CMM | Max Test | 74.10 | 24019.3 | 44179.7 | 0.101 | 64.63 | 83.56 |
DIVE | exp19lst | 90.80 | 25114.7 | 21554.0 | 0.107 | 117.39 | 64.21 |
HSS | 3DUNet04 | 79.33 | 29732.0 | 27514.3 | 0.113 | 53.22 | 105.44 |
DLST | DLST003 | 91.71 | 33118.7 | 35934.7 | 0.125 | 58.14 | 125.27 |
SDG | Unet0 | 171.88 | 33308.3 | 108288.7 | 0.262 | 91.45 | 252.31 |
HSS | 3DUNet | 65.34 | 43440.3 | 22443.3 | 0.106 | 63.26 | 67.43 |
DIVE | cleft_hi | 107.24 | 44844.3 | 52063.7 | 0.158 | 94.14 | 120.33 |
DKFZ-MIC | nnUNet | 74.96 | 49914.0 | 18981.3 | 0.117 | 64.46 | 85.46 |
DLST | DLST001 | 71.19 | 53908.0 | 14839.0 | 0.106 | 69.02 | 73.36 |
DIVE | WeitUNet | 78.12 | 54372.7 | 24480.3 | 0.128 | 71.51 | 84.73 |
DLST | DLST002 | 75.46 | 56645.7 | 17498.3 | 0.119 | 65.93 | 85.00 |
DIVE | CRNNGate | 120.36 | 62609.0 | 47395.7 | 0.175 | 110.06 | 130.66 |
DIVE | ex19t5 | 315.97 | 64192.0 | 1757.3 | 0.112 | 600.79 | 31.15 |
HSS | HSZ | 90.11 | 65092.3 | 25807.3 | 0.154 | 99.61 | 80.61 |
I2I | CleftB | 74.31 | 65334.0 | 21669.0 | 0.142 | 92.36 | 56.26 |
VCG | FgUPlus8 | 58.66 | 65345.7 | 11887.0 | 0.101 | 70.36 | 46.96 |
CMM | UNet50 | 69.31 | 65762.0 | 12634.7 | 0.139 | 97.45 | 41.17 |
JRC | DTU-2 | 67.56 | 70761.3 | 10069.3 | 0.123 | 109.67 | 25.46 |
I2I | CSparSep | 75.79 | 71650.0 | 18918.3 | 0.140 | 72.06 | 79.52 |
- Page 1 of 5
- Next
- 25 of 101 items
Legend
- CREMI score
- The mean of ADGT and ADF. We are not including the F-Score for now, as our current way of computing it can lead to unfair comparison. We are working on a more robust measure and will update the results accordingly.
- FP, FN, and F-Score
- The False Positives, False Negatives, and the resulting F-Score in the clefts detection volume. See metrics for details.
- ADGT
- The average distance of any found cleft voxel to the closest ground truth cleft voxel.
- ADF
- The average distance of any ground truth cleft voxel to the closest found cleft voxel.
For each value, lower is better (F-Score shown as 1 - F-Score).
Leaderboard Synaptic Partner Identification
Results for the synaptic partner identification category, averaged over all samples.
Group | Submission | CREMI score | FP | FN |
---|---|---|---|---|
AnonumoysGroup | PrTrn66 | 0.620 | 238.000 | 451.667 |
DIVE | PTR_V2 | 0.453 | 162.667 | 333.667 |
HCBS | Tr66_80K | 0.449 | 223.000 | 286.667 |
HCBS | Tr66comb | 0.451 | 219.000 | 292.333 |
HCBS | PrnTrn66 | 0.465 | 178.667 | 322.333 |
HCBS | Tr66t-01 | 0.469 | 182.667 | 318.667 |
IAL | PSP_unar | 0.461 | 266.667 | 281.000 |
IAL | PSP_full | 0.464 | 187.333 | 310.000 |
NO2 | lr_balan | 0.447 | 175.333 | 314.000 |
NO2 | lr_affin | 0.567 | 118.333 | 450.000 |
PNI | asyn_mod | 0.423 | 367.667 | 262.333 |
PNI | asyn_at0 | 0.468 | 293.333 | 297.000 |
PNI | asyn_at1 | 0.490 | 274.333 | 314.667 |
PNI | asyn_ori | 0.493 | 310.000 | 302.333 |
- 14 items
Legend
- CREMI score
- 1 - F-Score of the FP and FN.
- FP, FN
- The False Positives and False Negatives synaptic partner pairs. See metrics for details.
For each value, lower is better.