Leaderboard Neuron Segmentation
Results for the neuron segmentation category, averaged over all samples.
Group | Submission | CREMI score | VOI split | VOI merge | ARAND |
---|---|---|---|---|---|
IAL | LMC V3 | 0.445 | 0.655 | 0.308 | 0.208 |
JRC | LSDLR | 0.344 | 0.336 | 0.256 | 0.203 |
IAL | CMaskSP2 | 0.327 | 0.339 | 0.205 | 0.201 |
IAL | MutexWS3 | 0.362 | 0.362 | 0.312 | 0.199 |
IAL | CMaskMWS | 0.314 | 0.361 | 0.162 | 0.196 |
DIVE | CRNNGate | 0.514 | 1.191 | 0.196 | 0.194 |
JRC | MTLSD_L | 0.318 | 0.386 | 0.153 | 0.190 |
IAL | MWS | 0.392 | 0.718 | 0.100 | 0.187 |
IAL | LMC V1 | 0.399 | 0.646 | 0.211 | 0.187 |
IAL | CMaskSP1 | 0.317 | 0.360 | 0.186 | 0.187 |
IAL | LMC V5 | 0.398 | 0.597 | 0.272 | 0.184 |
IAL | CMaskMC | 0.305 | 0.341 | 0.175 | 0.184 |
IAL | MutexWS4 | 0.342 | 0.364 | 0.288 | 0.182 |
VCG | mala-seg | 0.349 | 0.452 | 0.245 | 0.179 |
JRC | MALALMC | 0.352 | 0.640 | 0.116 | 0.165 |
IAL | UnetLRLC | 0.325 | 0.463 | 0.188 | 0.164 |
IAL | CMaskMC2 | 0.276 | 0.348 | 0.152 | 0.157 |
IAL | spUNetMC | 0.317 | 0.519 | 0.125 | 0.156 |
JRC | MALA v1 | 0.327 | 0.524 | 0.165 | 0.156 |
JRC | MALALMC2 | 0.294 | 0.400 | 0.168 | 0.154 |
JRC | MALAMC | 0.317 | 0.497 | 0.170 | 0.152 |
IAL | CMaskSP4 | 0.280 | 0.371 | 0.159 | 0.149 |
PCH | UNet_dip | 0.310 | 0.501 | 0.158 | 0.146 |
JRC | MTLSD | 0.266 | 0.380 | 0.116 | 0.144 |
PCH | UNet_dim | 0.312 | 0.513 | 0.180 | 0.141 |
Legend
- CREMI score
- The geometric mean of (VOI split + VOI merge) and ARAND.
- VOI split and merge
- The Variation of Information between a segmentation X and ground truth Y. The split and merge parts correspond to the conditional entropies H(X|Y) and H(Y|X), respectively.
- ARAND
- The Adapted Rand Error, i.e., 1.0 - Rand F-Score.
For each value, lower is better.
Leaderboard Synaptic Cleft Detection
Results for the synaptic cleft detection category, averaged over all samples.
Group | Submission | CREMI score | FP | FN | 1 - F-score | ADGT | ADF |
---|---|---|---|---|---|---|---|
DIVE | 3class8t | 198.78 | 262876.7 | 0.0 | 0.282 | 393.81 | 3.76 |
DIVE | cleft_A+ | 199.35 | 378215.7 | 0.0 | 0.386 | 395.99 | 2.72 |
DIVE | Exp12_64 | 202.46 | 335698.7 | 0.0 | 0.374 | 402.99 | 1.93 |
DIVE | ex19t2 | 283.68 | 173078.7 | 0.0 | 0.201 | 551.77 | 15.60 |
DIVE | exp18_la | 284.83 | 684532.0 | 0.0 | 0.493 | 564.72 | 4.94 |
DIVE | ex19t5 | 315.97 | 64192.0 | 1757.3 | 0.112 | 600.79 | 31.15 |
DIVE | CRunet2 | 318.85 | 107459361.0 | 4195.7 | 0.824 | 611.30 | 26.40 |
DIVE | Rclefts | 380.86 | 167900713.3 | 0.0 | 0.990 | 761.72 | 0.00 |
DIVE | OrClefts | 380.86 | 167900713.3 | 0.0 | 0.990 | 761.72 | 0.00 |
DIVE | ResUnet | 380.86 | 167900713.3 | 0.0 | 0.990 | 761.72 | 0.00 |
CleftKing | CleABC1 | 58.02 | 130521.0 | 7637.3 | 0.179 | 87.11 | 28.94 |
CleftKing | CleABC3 | 59.10 | 106917.7 | 10746.3 | 0.165 | 87.22 | 30.99 |
CleftKing | CleABC2 | 59.47 | 110518.3 | 10494.7 | 0.170 | 88.88 | 30.05 |
CMM | UNet50 | 69.31 | 65762.0 | 12634.7 | 0.139 | 97.45 | 41.17 |
CMM | Max Test | 74.10 | 24019.3 | 44179.7 | 0.101 | 64.63 | 83.56 |
CMM | GenT | 380.86 | 167900713.3 | 0.0 | 0.990 | 761.72 | 0.00 |
3DEM | BesA225 | 59.34 | 120053.7 | 7534.0 | 0.177 | 90.88 | 27.80 |
3DEM | BesA0.20 | 60.04 | 121311.3 | 7529.0 | 0.182 | 92.91 | 27.17 |
3DEM | ABC_BC2 | 61.70 | 110946.0 | 10787.3 | 0.168 | 76.67 | 46.73 |
3DEM | ABC_BC1 | 61.72 | 114005.0 | 10670.3 | 0.170 | 76.99 | 46.46 |
3DEM | ABC_BC | 62.21 | 99221.7 | 10981.0 | 0.151 | 75.79 | 48.63 |
3DEM | Part_A | 65.43 | 112964.7 | 10645.0 | 0.174 | 96.87 | 34.00 |
3DEM | BC_BC | 66.71 | 82113.3 | 13347.3 | 0.126 | 79.96 | 53.46 |
3DEM | All_A | 76.12 | 157692.7 | 6808.7 | 0.256 | 130.59 | 21.66 |
3DEM | BesA275 | 252.56 | 254701.0 | 581781.3 | 0.456 | 199.02 | 306.10 |
Legend
- CREMI score
- The mean of ADGT and ADF. We are not including the F-Score for now, as our current way of computing it can lead to unfair comparison. We are working on a more robust measure and will update the results accordingly.
- FP, FN, and F-Score
- The False Positives, False Negatives, and the resulting F-Score in the clefts detection volume. See metrics for details.
- ADGT
- The average distance of any found cleft voxel to the closest ground truth cleft voxel.
- ADF
- The average distance of any ground truth cleft voxel to the closest found cleft voxel.
For each value, lower is better (F-Score shown as 1 - F-Score).
Leaderboard Synaptic Partner Identification
Results for the synaptic partner identification category, averaged over all samples.
Group | Submission | CREMI score | FP | FN |
---|---|---|---|---|
NO2 | lr_balan | 0.447 | 175.333 | 314.000 |
NO2 | lr_affin | 0.567 | 118.333 | 450.000 |
PNI | asyn_ori | 0.493 | 310.000 | 302.333 |
PNI | asyn_mod | 0.423 | 367.667 | 262.333 |
PNI | asyn_at1 | 0.490 | 274.333 | 314.667 |
PNI | asyn_at0 | 0.468 | 293.333 | 297.000 |
HCBS | Tr66t-01 | 0.469 | 182.667 | 318.667 |
HCBS | Tr66comb | 0.451 | 219.000 | 292.333 |
HCBS | Tr66_80K | 0.449 | 223.000 | 286.667 |
HCBS | PrnTrn66 | 0.465 | 178.667 | 322.333 |
AnonumoysGroup | PrTrn66 | 0.620 | 238.000 | 451.667 |
DIVE | PTR_V2 | 0.453 | 162.667 | 333.667 |
IAL | PSP_unar | 0.461 | 266.667 | 281.000 |
IAL | PSP_full | 0.464 | 187.333 | 310.000 |
- 14 items
Legend
- CREMI score
- 1 - F-Score of the FP and FN.
- FP, FN
- The False Positives and False Negatives synaptic partner pairs. See metrics for details.
For each value, lower is better.