Leaderboard Neuron Segmentation
Results for the neuron segmentation category, averaged over all samples.
Group | Submission | CREMI score | VOI split | VOI merge | ARAND |
---|---|---|---|---|---|
PNI | PNIUNet1 | 0.251 | 0.344 | 0.129 | 0.134 |
PNI | PNIUNet2 | 0.242 | 0.326 | 0.127 | 0.130 |
JRC | MALA v2 | 0.286 | 0.479 | 0.127 | 0.135 |
VIDAR | MALAv2 | 0.286 | 0.479 | 0.127 | 0.135 |
PCH | UNet_aut | 0.286 | 0.479 | 0.127 | 0.135 |
IAL | pEmbUNet | 0.268 | 0.397 | 0.127 | 0.139 |
IAL | spUNetMC | 0.317 | 0.519 | 0.125 | 0.156 |
PNI | PNIUNet3 | 0.240 | 0.327 | 0.124 | 0.128 |
PCH | sff_a | 0.277 | 0.473 | 0.119 | 0.131 |
PCH | sff_aug | 0.277 | 0.471 | 0.118 | 0.130 |
JRC | MTLSD | 0.266 | 0.380 | 0.116 | 0.144 |
JRC | MALALMC | 0.352 | 0.640 | 0.116 | 0.165 |
IAL | UnetLMC2 | 0.221 | 0.339 | 0.115 | 0.108 |
PNI | PNIUNet6 | 0.237 | 0.349 | 0.114 | 0.122 |
PNI | PNIUNet8 | 0.237 | 0.349 | 0.114 | 0.122 |
PCH | interp | 0.275 | 0.473 | 0.114 | 0.129 |
PCH | interp_a | 0.274 | 0.472 | 0.113 | 0.129 |
PCH | UNet_mis | 0.272 | 0.453 | 0.113 | 0.131 |
PNI | PNIUNet4 | 0.237 | 0.350 | 0.110 | 0.122 |
IAL | CMskMWS2 | 0.246 | 0.383 | 0.107 | 0.125 |
PNI | PNIUNet5 | 0.228 | 0.345 | 0.106 | 0.116 |
PNI | PNIUNet7 | 0.228 | 0.345 | 0.106 | 0.116 |
PNI | PNIUNet0 | 0.229 | 0.350 | 0.101 | 0.117 |
IAL | MWS | 0.392 | 0.718 | 0.100 | 0.187 |
IAL | GASP_avg | 0.241 | 0.365 | 0.096 | 0.129 |
Legend
- CREMI score
- The geometric mean of (VOI split + VOI merge) and ARAND.
- VOI split and merge
- The Variation of Information between a segmentation X and ground truth Y. The split and merge parts correspond to the conditional entropies H(X|Y) and H(Y|X), respectively.
- ARAND
- The Adapted Rand Error, i.e., 1.0 - Rand F-Score.
For each value, lower is better.
Leaderboard Synaptic Cleft Detection
Results for the synaptic cleft detection category, averaged over all samples.
Group | Submission | CREMI score | FP | FN | 1 - F-score | ADGT | ADF |
---|---|---|---|---|---|---|---|
3DEM | BesA0.20 | 60.04 | 121311.3 | 7529.0 | 0.182 | 92.91 | 27.17 |
DIVE | CRunet2 | 318.85 | 107459361.0 | 4195.7 | 0.824 | 611.30 | 26.40 |
DIVE | exp18_be | 136.63 | 8797.3 | 0.0 | 0.014 | 247.19 | 26.08 |
JRC | DTU-2 | 67.56 | 70761.3 | 10069.3 | 0.123 | 109.67 | 25.46 |
VCG | FgUPlus | 57.90 | 137412.7 | 4763.3 | 0.160 | 90.99 | 24.81 |
DIVE | cleftlol | 179.28 | 723352.7 | 2716.7 | 0.375 | 334.05 | 24.51 |
VCG | FgSm0805 | 54.23 | 111486.0 | 4917.0 | 0.142 | 84.04 | 24.43 |
3DEM | All_A | 76.12 | 157692.7 | 6808.7 | 0.256 | 130.59 | 21.66 |
DIVE | SegClef1 | 156.70 | 617804.0 | 3339.3 | 0.373 | 296.85 | 16.56 |
DIVE | ex19t2 | 283.68 | 173078.7 | 0.0 | 0.201 | 551.77 | 15.60 |
lbdl | Cleft_lb | 97.85 | 227868.0 | 0.0 | 0.262 | 181.08 | 14.61 |
VCG | FgSemi08 | 55.41 | 160792.7 | 3178.3 | 0.181 | 96.54 | 14.28 |
DIVE | cleft_lb | 139.19 | 284326.0 | 0.0 | 0.349 | 265.87 | 12.52 |
lbdl | lb_thicc | 59.04 | 107211.3 | 234.0 | 0.190 | 109.17 | 8.91 |
VCG | FgSemi05 | 57.63 | 221731.7 | 975.7 | 0.232 | 107.73 | 7.52 |
lbdl | lb_lst | 64.22 | 118160.0 | 0.0 | 0.209 | 121.50 | 6.93 |
DIVE | exp18_la | 284.83 | 684532.0 | 0.0 | 0.493 | 564.72 | 4.94 |
DIVE | 3class8t | 198.78 | 262876.7 | 0.0 | 0.282 | 393.81 | 3.76 |
DIVE | cleft_A+ | 199.35 | 378215.7 | 0.0 | 0.386 | 395.99 | 2.72 |
DIVE | Exp12_64 | 202.46 | 335698.7 | 0.0 | 0.374 | 402.99 | 1.93 |
VCG | FgRj0805 | 117.25 | 1329995.3 | 327.7 | 0.610 | 232.66 | 1.84 |
VCG | FgRj0808 | 117.25 | 1329995.3 | 327.7 | 0.610 | 232.66 | 1.84 |
DIVE | Rclefts | 380.86 | 167900713.3 | 0.0 | 0.990 | 761.72 | 0.00 |
DIVE | OrClefts | 380.86 | 167900713.3 | 0.0 | 0.990 | 761.72 | 0.00 |
DIVE | ResUnet | 380.86 | 167900713.3 | 0.0 | 0.990 | 761.72 | 0.00 |
Legend
- CREMI score
- The mean of ADGT and ADF. We are not including the F-Score for now, as our current way of computing it can lead to unfair comparison. We are working on a more robust measure and will update the results accordingly.
- FP, FN, and F-Score
- The False Positives, False Negatives, and the resulting F-Score in the clefts detection volume. See metrics for details.
- ADGT
- The average distance of any found cleft voxel to the closest ground truth cleft voxel.
- ADF
- The average distance of any ground truth cleft voxel to the closest found cleft voxel.
For each value, lower is better (F-Score shown as 1 - F-Score).
Leaderboard Synaptic Partner Identification
Results for the synaptic partner identification category, averaged over all samples.
Group | Submission | CREMI score | FP | FN |
---|---|---|---|---|
PNI | asyn_mod | 0.423 | 367.667 | 262.333 |
NO2 | lr_balan | 0.447 | 175.333 | 314.000 |
HCBS | Tr66_80K | 0.449 | 223.000 | 286.667 |
HCBS | Tr66comb | 0.451 | 219.000 | 292.333 |
DIVE | PTR_V2 | 0.453 | 162.667 | 333.667 |
IAL | PSP_unar | 0.461 | 266.667 | 281.000 |
IAL | PSP_full | 0.464 | 187.333 | 310.000 |
HCBS | PrnTrn66 | 0.465 | 178.667 | 322.333 |
PNI | asyn_at0 | 0.468 | 293.333 | 297.000 |
HCBS | Tr66t-01 | 0.469 | 182.667 | 318.667 |
PNI | asyn_at1 | 0.490 | 274.333 | 314.667 |
PNI | asyn_ori | 0.493 | 310.000 | 302.333 |
NO2 | lr_affin | 0.567 | 118.333 | 450.000 |
AnonumoysGroup | PrTrn66 | 0.620 | 238.000 | 451.667 |
- 14 items
Legend
- CREMI score
- 1 - F-Score of the FP and FN.
- FP, FN
- The False Positives and False Negatives synaptic partner pairs. See metrics for details.
For each value, lower is better.