Leaderboard Neuron Segmentation
Results for the neuron segmentation category, averaged over all samples.
Group | Submission | CREMI score | VOI split | VOI merge | ARAND |
---|---|---|---|---|---|
JRC | MALA v1 | 0.327 | 0.524 | 0.165 | 0.156 |
DIVE | M2uD_CSR | 0.766 | 1.030 | 0.770 | 0.329 |
VCG | LearnCt2 | 0.623 | 1.091 | 0.148 | 0.316 |
VCG | LearnC | 0.618 | 1.093 | 0.139 | 0.313 |
JRC | LSDLR | 0.344 | 0.336 | 0.256 | 0.203 |
IAL | LMC V6 | 0.516 | 0.672 | 0.415 | 0.245 |
IAL | LMC V5 | 0.398 | 0.597 | 0.272 | 0.184 |
IAL | LMC V4 | 0.447 | 0.622 | 0.295 | 0.219 |
IAL | LMC V3 | 0.445 | 0.655 | 0.308 | 0.208 |
IAL | LMC V2 | 0.446 | 0.629 | 0.285 | 0.219 |
IAL | LMC V1 | 0.399 | 0.646 | 0.211 | 0.187 |
VCG | LFC | 0.616 | 1.085 | 0.140 | 0.313 |
PNI | JRC-UNet | 0.239 | 0.386 | 0.081 | 0.123 |
IAL | HCCAvgSP | 0.257 | 0.438 | 0.063 | 0.132 |
IAL | HCCAvgPx | 0.224 | 0.361 | 0.085 | 0.113 |
IAL | HCAvgSP | 0.262 | 0.448 | 0.063 | 0.135 |
IAL | HCAvgPx | 0.224 | 0.364 | 0.083 | 0.114 |
IAL | GASP_avg | 0.241 | 0.365 | 0.096 | 0.129 |
- | Final | 2.896 | 3.805 | 5.599 | 0.895 |
IAL | DunetLR | 0.249 | 0.372 | 0.142 | 0.121 |
HVCL | Deep Res | 2.212 | 1.672 | 4.182 | 0.837 |
DIVE | DISW | 0.557 | 1.035 | 0.149 | 0.265 |
DIVE | CRunet22 | 0.746 | 1.522 | 0.438 | 0.298 |
DIVE | CRunet2 | 0.566 | 1.081 | 0.389 | 0.229 |
DIVE | CRunet1 | 0.619 | 1.141 | 0.381 | 0.275 |
Legend
- CREMI score
- The geometric mean of (VOI split + VOI merge) and ARAND.
- VOI split and merge
- The Variation of Information between a segmentation X and ground truth Y. The split and merge parts correspond to the conditional entropies H(X|Y) and H(Y|X), respectively.
- ARAND
- The Adapted Rand Error, i.e., 1.0 - Rand F-Score.
For each value, lower is better.
Leaderboard Synaptic Cleft Detection
Results for the synaptic cleft detection category, averaged over all samples.
Group | Submission | CREMI score | FP | FN | 1 - F-score | ADGT | ADF |
---|---|---|---|---|---|---|---|
VCG | FgSemi08 | 55.41 | 160792.7 | 3178.3 | 0.181 | 96.54 | 14.28 |
3DEM | Part_A | 65.43 | 112964.7 | 10645.0 | 0.174 | 96.87 | 34.00 |
CMM | UNet50 | 69.31 | 65762.0 | 12634.7 | 0.139 | 97.45 | 41.17 |
SDG | Unet2 | 63.92 | 202177.7 | 13156.0 | 0.256 | 97.64 | 30.19 |
HSS | HSZ | 90.11 | 65092.3 | 25807.3 | 0.154 | 99.61 | 80.61 |
DIVE | cleftloh | 194.25 | 22502.0 | 67513.7 | 0.236 | 102.22 | 286.27 |
JRC | DTU-1 | 72.21 | 85169.0 | 13607.3 | 0.131 | 106.31 | 38.11 |
VCG | FgSemi05 | 57.63 | 221731.7 | 975.7 | 0.232 | 107.73 | 7.52 |
lbdl | lb_thicc | 59.04 | 107211.3 | 234.0 | 0.190 | 109.17 | 8.91 |
DIVE | BesUNet | 82.46 | 131090.7 | 15589.0 | 0.206 | 109.52 | 55.40 |
JRC | DTU-2 | 67.56 | 70761.3 | 10069.3 | 0.123 | 109.67 | 25.46 |
DIVE | CRNNGate | 120.36 | 62609.0 | 47395.7 | 0.175 | 110.06 | 130.66 |
DIVE | exp19lst | 90.80 | 25114.7 | 21554.0 | 0.107 | 117.39 | 64.21 |
DIVE | SegCleft | 77.03 | 80978.3 | 20639.3 | 0.162 | 121.03 | 33.03 |
DIVE | celft_1 | 77.03 | 80978.3 | 20639.3 | 0.162 | 121.03 | 33.03 |
lbdl | lb_lst | 64.22 | 118160.0 | 0.0 | 0.209 | 121.50 | 6.93 |
3DEM | All_A | 76.12 | 157692.7 | 6808.7 | 0.256 | 130.59 | 21.66 |
DIVE | cleft | 88.46 | 97220.7 | 21239.3 | 0.172 | 139.74 | 37.18 |
Kreshuk | MG | 152.52 | 129494.3 | 63958.0 | 0.278 | 157.83 | 147.21 |
IAL | full_mod | 137.73 | 153335.3 | 61967.7 | 0.310 | 176.37 | 99.09 |
lbdl | Cleft_lb | 97.85 | 227868.0 | 0.0 | 0.262 | 181.08 | 14.61 |
SDG | Synap0.0 | 118.10 | 193580.0 | 12504.0 | 0.270 | 185.62 | 50.58 |
SDG | SynapX.0 | 118.10 | 193580.0 | 12504.0 | 0.270 | 185.62 | 50.58 |
DIVE | clefitlo | 151.12 | 105664.7 | 32928.0 | 0.220 | 190.20 | 112.05 |
SDG | SynapX.X | 121.40 | 204301.0 | 16302.7 | 0.286 | 194.74 | 48.06 |
Legend
- CREMI score
- The mean of ADGT and ADF. We are not including the F-Score for now, as our current way of computing it can lead to unfair comparison. We are working on a more robust measure and will update the results accordingly.
- FP, FN, and F-Score
- The False Positives, False Negatives, and the resulting F-Score in the clefts detection volume. See metrics for details.
- ADGT
- The average distance of any found cleft voxel to the closest ground truth cleft voxel.
- ADF
- The average distance of any ground truth cleft voxel to the closest found cleft voxel.
For each value, lower is better (F-Score shown as 1 - F-Score).
Leaderboard Synaptic Partner Identification
Results for the synaptic partner identification category, averaged over all samples.
Group | Submission | CREMI score | FP | FN |
---|---|---|---|---|
AnonumoysGroup | PrTrn66 | 0.620 | 238.000 | 451.667 |
NO2 | lr_affin | 0.567 | 118.333 | 450.000 |
PNI | asyn_ori | 0.493 | 310.000 | 302.333 |
PNI | asyn_at1 | 0.490 | 274.333 | 314.667 |
HCBS | Tr66t-01 | 0.469 | 182.667 | 318.667 |
PNI | asyn_at0 | 0.468 | 293.333 | 297.000 |
HCBS | PrnTrn66 | 0.465 | 178.667 | 322.333 |
IAL | PSP_full | 0.464 | 187.333 | 310.000 |
IAL | PSP_unar | 0.461 | 266.667 | 281.000 |
DIVE | PTR_V2 | 0.453 | 162.667 | 333.667 |
HCBS | Tr66comb | 0.451 | 219.000 | 292.333 |
HCBS | Tr66_80K | 0.449 | 223.000 | 286.667 |
NO2 | lr_balan | 0.447 | 175.333 | 314.000 |
PNI | asyn_mod | 0.423 | 367.667 | 262.333 |
- 14 items
Legend
- CREMI score
- 1 - F-Score of the FP and FN.
- FP, FN
- The False Positives and False Negatives synaptic partner pairs. See metrics for details.
For each value, lower is better.