Leaderboard Neuron Segmentation
Results for the neuron segmentation category, averaged over all samples.
Group | Submission | CREMI score | VOI split | VOI merge | ARAND |
---|---|---|---|---|---|
JRC | MALALMC | 0.352 | 0.640 | 0.116 | 0.165 |
JRC | MTLSD | 0.266 | 0.380 | 0.116 | 0.144 |
PCH | sff_aug | 0.277 | 0.471 | 0.118 | 0.130 |
PCH | sff_a | 0.277 | 0.473 | 0.119 | 0.131 |
PNI | PNIUNet3 | 0.240 | 0.327 | 0.124 | 0.128 |
IAL | spUNetMC | 0.317 | 0.519 | 0.125 | 0.156 |
IAL | pEmbUNet | 0.268 | 0.397 | 0.127 | 0.139 |
JRC | MALA v2 | 0.286 | 0.479 | 0.127 | 0.135 |
VIDAR | MALAv2 | 0.286 | 0.479 | 0.127 | 0.135 |
PCH | UNet_aut | 0.286 | 0.479 | 0.127 | 0.135 |
PNI | PNIUNet2 | 0.242 | 0.326 | 0.127 | 0.130 |
PNI | PNIUNet1 | 0.251 | 0.344 | 0.129 | 0.134 |
PCH | UNet_no | 0.285 | 0.475 | 0.129 | 0.135 |
JRC | MTLR | 0.269 | 0.395 | 0.130 | 0.138 |
PCH | UNet_inp | 0.277 | 0.438 | 0.131 | 0.137 |
IAL | UnetLRIF | 0.242 | 0.350 | 0.135 | 0.121 |
VCG | LearnC | 0.618 | 1.093 | 0.139 | 0.313 |
VCG | LFC | 0.616 | 1.085 | 0.140 | 0.313 |
IAL | DunetLR | 0.249 | 0.372 | 0.142 | 0.121 |
VCG | LearnCt2 | 0.623 | 1.091 | 0.148 | 0.316 |
DIVE | DISW | 0.557 | 1.035 | 0.149 | 0.265 |
PCH | inp_x4 | 0.597 | 1.158 | 0.149 | 0.281 |
DIVE | ag35-42 | 0.553 | 0.999 | 0.150 | 0.267 |
PCH | ifn_x4 | 0.572 | 1.176 | 0.151 | 0.249 |
IAL | CMaskMC2 | 0.276 | 0.348 | 0.152 | 0.157 |
Legend
- CREMI score
- The geometric mean of (VOI split + VOI merge) and ARAND.
- VOI split and merge
- The Variation of Information between a segmentation X and ground truth Y. The split and merge parts correspond to the conditional entropies H(X|Y) and H(Y|X), respectively.
- ARAND
- The Adapted Rand Error, i.e., 1.0 - Rand F-Score.
For each value, lower is better.
Leaderboard Synaptic Cleft Detection
Results for the synaptic cleft detection category, averaged over all samples.
Group | Submission | CREMI score | FP | FN | 1 - F-score | ADGT | ADF |
---|---|---|---|---|---|---|---|
I2I | SparSep | 66.76 | 151781.7 | 11350.3 | 0.188 | 87.35 | 46.17 |
DIVE | CleftC1 | 66.50 | 149148.3 | 12971.0 | 0.187 | 86.56 | 46.43 |
3DEM | ABC_BC1 | 61.72 | 114005.0 | 10670.3 | 0.170 | 76.99 | 46.46 |
3DEM | ABC_BC2 | 61.70 | 110946.0 | 10787.3 | 0.168 | 76.67 | 46.73 |
VCG | FgUPlus8 | 58.66 | 65345.7 | 11887.0 | 0.101 | 70.36 | 46.96 |
DIVE | CleftC5 | 65.75 | 125395.7 | 11906.7 | 0.181 | 84.10 | 47.41 |
SDG | SynapX.X | 121.40 | 204301.0 | 16302.7 | 0.286 | 194.74 | 48.06 |
DIVE | CleftC4 | 65.38 | 112813.3 | 14762.3 | 0.179 | 82.62 | 48.15 |
3DEM | ABC_BC | 62.21 | 99221.7 | 10981.0 | 0.151 | 75.79 | 48.63 |
DIVE | CleftC2 | 66.19 | 117135.0 | 19904.7 | 0.181 | 83.30 | 49.08 |
DIVE | CleftC3 | 66.19 | 112868.0 | 18785.0 | 0.180 | 82.73 | 49.65 |
SDG | Synap0.0 | 118.10 | 193580.0 | 12504.0 | 0.270 | 185.62 | 50.58 |
SDG | SynapX.0 | 118.10 | 193580.0 | 12504.0 | 0.270 | 185.62 | 50.58 |
I2I | FCEval | 66.45 | 107963.7 | 21352.3 | 0.179 | 82.28 | 50.62 |
SDG | PyTC20-1 | 67.97 | 131489.3 | 8699.0 | 0.167 | 84.22 | 51.73 |
3DEM | BC_BC | 66.71 | 82113.3 | 13347.3 | 0.126 | 79.96 | 53.46 |
cxj | USTC | 284.98 | 1015564.7 | 108523.3 | 0.600 | 516.31 | 53.65 |
DIVE | BesUNet | 82.46 | 131090.7 | 15589.0 | 0.206 | 109.52 | 55.40 |
DIVE | CRunet22 | 180.77 | 162763.0 | 23055.7 | 0.312 | 305.59 | 55.95 |
I2I | CleftB | 74.31 | 65334.0 | 21669.0 | 0.142 | 92.36 | 56.26 |
DIVE | exp19lst | 90.80 | 25114.7 | 21554.0 | 0.107 | 117.39 | 64.21 |
SDG | Unet1 | 75.28 | 185988.3 | 16897.3 | 0.230 | 84.34 | 66.22 |
HSS | 3DUNet | 65.34 | 43440.3 | 22443.3 | 0.106 | 63.26 | 67.43 |
DIVE | Mix_ABC1 | 74.39 | 101269.0 | 16022.0 | 0.174 | 79.04 | 69.73 |
DIVE | Mix_ABC2 | 75.02 | 131499.0 | 13795.7 | 0.200 | 78.36 | 71.67 |
Legend
- CREMI score
- The mean of ADGT and ADF. We are not including the F-Score for now, as our current way of computing it can lead to unfair comparison. We are working on a more robust measure and will update the results accordingly.
- FP, FN, and F-Score
- The False Positives, False Negatives, and the resulting F-Score in the clefts detection volume. See metrics for details.
- ADGT
- The average distance of any found cleft voxel to the closest ground truth cleft voxel.
- ADF
- The average distance of any ground truth cleft voxel to the closest found cleft voxel.
For each value, lower is better (F-Score shown as 1 - F-Score).
Leaderboard Synaptic Partner Identification
Results for the synaptic partner identification category, averaged over all samples.
Group | Submission | CREMI score | FP | FN |
---|---|---|---|---|
NO2 | lr_affin | 0.567 | 118.333 | 450.000 |
DIVE | PTR_V2 | 0.453 | 162.667 | 333.667 |
NO2 | lr_balan | 0.447 | 175.333 | 314.000 |
HCBS | PrnTrn66 | 0.465 | 178.667 | 322.333 |
HCBS | Tr66t-01 | 0.469 | 182.667 | 318.667 |
IAL | PSP_full | 0.464 | 187.333 | 310.000 |
HCBS | Tr66comb | 0.451 | 219.000 | 292.333 |
HCBS | Tr66_80K | 0.449 | 223.000 | 286.667 |
AnonumoysGroup | PrTrn66 | 0.620 | 238.000 | 451.667 |
IAL | PSP_unar | 0.461 | 266.667 | 281.000 |
PNI | asyn_at1 | 0.490 | 274.333 | 314.667 |
PNI | asyn_at0 | 0.468 | 293.333 | 297.000 |
PNI | asyn_ori | 0.493 | 310.000 | 302.333 |
PNI | asyn_mod | 0.423 | 367.667 | 262.333 |
- 14 items
Legend
- CREMI score
- 1 - F-Score of the FP and FN.
- FP, FN
- The False Positives and False Negatives synaptic partner pairs. See metrics for details.
For each value, lower is better.