Leaderboard Neuron Segmentation
Results for the neuron segmentation category, averaged over all samples.
Group | Submission | CREMI score | VOI split | VOI merge | ARAND |
---|---|---|---|---|---|
DIVE | seg&BW2 | 0.701 | 1.307 | 0.327 | 0.306 |
DIVE | seg0316 | 0.775 | 1.536 | 0.327 | 0.331 |
DIVE | seg&BW5 | 0.702 | 1.308 | 0.328 | 0.307 |
DIVE | seg030 | 0.793 | 1.584 | 0.328 | 0.337 |
PCH | inp_x0 | 0.696 | 1.226 | 0.338 | 0.315 |
DIVE | seg4 | 0.791 | 1.565 | 0.347 | 0.340 |
DIVE | seg3 | 0.798 | 1.587 | 0.351 | 0.341 |
DIVE | ftSeg1 | 0.695 | 1.224 | 0.355 | 0.311 |
VIDAR | mala_py3 | 0.543 | 0.724 | 0.374 | 0.270 |
IAL | UnetLRMC | 0.410 | 0.442 | 0.374 | 0.208 |
DIVE | CRunet1 | 0.619 | 1.141 | 0.381 | 0.275 |
DIVE | CRunet2 | 0.566 | 1.081 | 0.389 | 0.229 |
DIVE | ag35-2 | 0.702 | 0.917 | 0.402 | 0.384 |
IAL | LMC V6 | 0.516 | 0.672 | 0.415 | 0.245 |
DIVE | segBC018 | 0.717 | 1.347 | 0.422 | 0.296 |
DIVE | SegClef1 | 0.723 | 1.365 | 0.425 | 0.298 |
DIVE | ftSeg2 | 0.698 | 1.218 | 0.436 | 0.299 |
DIVE | CRunet22 | 0.746 | 1.522 | 0.438 | 0.298 |
DIVE | MPfcn | 0.625 | 1.063 | 0.486 | 0.260 |
DIVE | ag35-4 | 0.759 | 0.899 | 0.510 | 0.416 |
PCH | UNet_hw | 0.990 | 1.828 | 0.529 | 0.419 |
FI-NCA | UnetMF | 0.608 | 0.772 | 0.534 | 0.283 |
IAL | MutexWS2 | 0.469 | 0.427 | 0.551 | 0.228 |
SCI | Submission_1 | 1.088 | 1.782 | 0.556 | 0.518 |
DIVE | ag35-3 | 0.784 | 0.829 | 0.612 | 0.433 |
Legend
- CREMI score
- The geometric mean of (VOI split + VOI merge) and ARAND.
- VOI split and merge
- The Variation of Information between a segmentation X and ground truth Y. The split and merge parts correspond to the conditional entropies H(X|Y) and H(Y|X), respectively.
- ARAND
- The Adapted Rand Error, i.e., 1.0 - Rand F-Score.
For each value, lower is better.
Leaderboard Synaptic Cleft Detection
Results for the synaptic cleft detection category, averaged over all samples.
Group | Submission | CREMI score | FP | FN | 1 - F-score | ADGT | ADF |
---|---|---|---|---|---|---|---|
VCG | FgUPlus | 57.90 | 137412.7 | 4763.3 | 0.160 | 90.99 | 24.81 |
VCG | FgUPlus8 | 58.66 | 65345.7 | 11887.0 | 0.101 | 70.36 | 46.96 |
CMM | GenT | 380.86 | 167900713.3 | 0.0 | 0.990 | 761.72 | 0.00 |
HSS | HSZ | 90.11 | 65092.3 | 25807.3 | 0.154 | 99.61 | 80.61 |
Kreshuk | MG | 152.52 | 129494.3 | 63958.0 | 0.278 | 157.83 | 147.21 |
CMM | Max Test | 74.10 | 24019.3 | 44179.7 | 0.101 | 64.63 | 83.56 |
DIVE | MixUNet | 57.91 | 125220.0 | 7920.0 | 0.178 | 86.57 | 29.25 |
DIVE | MixUNet2 | 65.19 | 106260.3 | 13962.0 | 0.188 | 95.28 | 35.09 |
DIVE | MixUNet3 | 59.11 | 125333.0 | 7696.0 | 0.180 | 89.68 | 28.54 |
DIVE | MixUNet4 | 59.03 | 122122.0 | 7761.3 | 0.177 | 89.35 | 28.71 |
DIVE | Mix_ABC1 | 74.39 | 101269.0 | 16022.0 | 0.174 | 79.04 | 69.73 |
DIVE | Mix_ABC2 | 75.02 | 131499.0 | 13795.7 | 0.200 | 78.36 | 71.67 |
DIVE | OrClefts | 380.86 | 167900713.3 | 0.0 | 0.990 | 761.72 | 0.00 |
3DEM | Part_A | 65.43 | 112964.7 | 10645.0 | 0.174 | 96.87 | 34.00 |
SDG | PyTC20 | 65.68 | 167107.0 | 6190.0 | 0.196 | 90.36 | 41.00 |
SDG | PyTC20-1 | 67.97 | 131489.3 | 8699.0 | 0.167 | 84.22 | 51.73 |
SDG | PyTC20-P | 64.59 | 215905.3 | 4962.0 | 0.227 | 96.14 | 33.05 |
DIVE | Rclefts | 380.86 | 167900713.3 | 0.0 | 0.990 | 761.72 | 0.00 |
DIVE | ResUnet | 380.86 | 167900713.3 | 0.0 | 0.990 | 761.72 | 0.00 |
DIVE | SegClef1 | 156.70 | 617804.0 | 3339.3 | 0.373 | 296.85 | 16.56 |
DIVE | SegCleft | 77.03 | 80978.3 | 20639.3 | 0.162 | 121.03 | 33.03 |
SDG | SnapF.V | 124.59 | 182577.0 | 17000.7 | 0.306 | 205.18 | 44.01 |
SDG | SnapX.O | 124.59 | 182577.0 | 17000.7 | 0.306 | 205.18 | 44.01 |
I2I | SparSep | 66.76 | 151781.7 | 11350.3 | 0.188 | 87.35 | 46.17 |
SDG | Synap0.0 | 118.10 | 193580.0 | 12504.0 | 0.270 | 185.62 | 50.58 |
Legend
- CREMI score
- The mean of ADGT and ADF. We are not including the F-Score for now, as our current way of computing it can lead to unfair comparison. We are working on a more robust measure and will update the results accordingly.
- FP, FN, and F-Score
- The False Positives, False Negatives, and the resulting F-Score in the clefts detection volume. See metrics for details.
- ADGT
- The average distance of any found cleft voxel to the closest ground truth cleft voxel.
- ADF
- The average distance of any ground truth cleft voxel to the closest found cleft voxel.
For each value, lower is better (F-Score shown as 1 - F-Score).
Leaderboard Synaptic Partner Identification
Results for the synaptic partner identification category, averaged over all samples.
Group | Submission | CREMI score | FP | FN |
---|---|---|---|---|
PNI | asyn_mod | 0.423 | 367.667 | 262.333 |
PNI | asyn_at0 | 0.468 | 293.333 | 297.000 |
PNI | asyn_at1 | 0.490 | 274.333 | 314.667 |
PNI | asyn_ori | 0.493 | 310.000 | 302.333 |
NO2 | lr_balan | 0.447 | 175.333 | 314.000 |
NO2 | lr_affin | 0.567 | 118.333 | 450.000 |
IAL | PSP_unar | 0.461 | 266.667 | 281.000 |
IAL | PSP_full | 0.464 | 187.333 | 310.000 |
HCBS | Tr66_80K | 0.449 | 223.000 | 286.667 |
HCBS | Tr66comb | 0.451 | 219.000 | 292.333 |
HCBS | PrnTrn66 | 0.465 | 178.667 | 322.333 |
HCBS | Tr66t-01 | 0.469 | 182.667 | 318.667 |
DIVE | PTR_V2 | 0.453 | 162.667 | 333.667 |
AnonumoysGroup | PrTrn66 | 0.620 | 238.000 | 451.667 |
- 14 items
Legend
- CREMI score
- 1 - F-Score of the FP and FN.
- FP, FN
- The False Positives and False Negatives synaptic partner pairs. See metrics for details.
For each value, lower is better.