Leaderboard Neuron Segmentation
Results for the neuron segmentation category, averaged over all samples.
Group | Submission | CREMI score | VOI split | VOI merge | ARAND |
---|---|---|---|---|---|
DIVE | ag35-2 | 0.702 | 0.917 | 0.402 | 0.384 |
PCH | ori_x4 | 0.839 | 1.700 | 0.078 | 0.398 |
DIVE | ag35-4 | 0.759 | 0.899 | 0.510 | 0.416 |
DIVE | unet2 | 0.972 | 1.481 | 0.803 | 0.419 |
DIVE | unet-2 | 0.972 | 1.481 | 0.803 | 0.419 |
PCH | UNet_hw | 0.990 | 1.828 | 0.529 | 0.419 |
DIVE | unet4 | 0.987 | 1.523 | 0.775 | 0.429 |
DIVE | unet-4 | 0.987 | 1.523 | 0.775 | 0.429 |
DIVE | ag35-3 | 0.784 | 0.829 | 0.612 | 0.433 |
DIVE | ag35 | 0.804 | 0.853 | 0.647 | 0.438 |
DIVE | unet3 | 0.994 | 1.451 | 0.831 | 0.441 |
DIVE | unet-3 | 0.994 | 1.451 | 0.831 | 0.441 |
DIVE | unet1 | 1.001 | 1.436 | 0.861 | 0.443 |
DIVE | unet-1 | 1.001 | 1.436 | 0.861 | 0.443 |
FI-NCA | UnetTest | 0.950 | 1.120 | 0.737 | 0.486 |
Rhoana | Test1 | 1.162 | 1.646 | 1.179 | 0.486 |
SCI | Submission_1 | 1.088 | 1.782 | 0.556 | 0.518 |
DIVE | ag23 | 1.221 | 0.755 | 1.557 | 0.647 |
DIVE | focalZ | 1.424 | 0.793 | 1.925 | 0.748 |
SeungLab-eding | Seung-ed | 1.525 | 0.895 | 2.160 | 0.764 |
Cvlab | cvlab_1 | 2.891 | 4.686 | 5.421 | 0.828 |
HVCL | Deep Res | 2.212 | 1.672 | 4.182 | 0.837 |
afish1001 | wunet_wj | 2.212 | 0.641 | 5.157 | 0.854 |
afish1001 | OurUnet | 2.197 | 0.698 | 5.034 | 0.855 |
afish1001 | ABWUnet | 2.199 | 0.696 | 5.042 | 0.856 |
Legend
- CREMI score
- The geometric mean of (VOI split + VOI merge) and ARAND.
- VOI split and merge
- The Variation of Information between a segmentation X and ground truth Y. The split and merge parts correspond to the conditional entropies H(X|Y) and H(Y|X), respectively.
- ARAND
- The Adapted Rand Error, i.e., 1.0 - Rand F-Score.
For each value, lower is better.
Leaderboard Synaptic Cleft Detection
Results for the synaptic cleft detection category, averaged over all samples.
Group | Submission | CREMI score | FP | FN | 1 - F-score | ADGT | ADF |
---|---|---|---|---|---|---|---|
SDG | SynapX.0 | 118.10 | 193580.0 | 12504.0 | 0.270 | 185.62 | 50.58 |
SDG | SynapX.X | 121.40 | 204301.0 | 16302.7 | 0.286 | 194.74 | 48.06 |
CMM | UNet50 | 69.31 | 65762.0 | 12634.7 | 0.139 | 97.45 | 41.17 |
cxj | USTC | 284.98 | 1015564.7 | 108523.3 | 0.600 | 516.31 | 53.65 |
SDG | Unet0 | 171.88 | 33308.3 | 108288.7 | 0.262 | 91.45 | 252.31 |
SDG | Unet1 | 75.28 | 185988.3 | 16897.3 | 0.230 | 84.34 | 66.22 |
SDG | Unet2 | 63.92 | 202177.7 | 13156.0 | 0.256 | 97.64 | 30.19 |
DIVE | WeitUNet | 78.12 | 54372.7 | 24480.3 | 0.128 | 71.51 | 84.73 |
DIVE | celft_1 | 77.03 | 80978.3 | 20639.3 | 0.162 | 121.03 | 33.03 |
DIVE | clefitlo | 151.12 | 105664.7 | 32928.0 | 0.220 | 190.20 | 112.05 |
DIVE | cleft | 88.46 | 97220.7 | 21239.3 | 0.172 | 139.74 | 37.18 |
DIVE | cleft_A+ | 199.35 | 378215.7 | 0.0 | 0.386 | 395.99 | 2.72 |
DIVE | cleft_hi | 107.24 | 44844.3 | 52063.7 | 0.158 | 94.14 | 120.33 |
DIVE | cleft_lb | 139.19 | 284326.0 | 0.0 | 0.349 | 265.87 | 12.52 |
DIVE | cleftloh | 194.25 | 22502.0 | 67513.7 | 0.236 | 102.22 | 286.27 |
DIVE | cleftlol | 179.28 | 723352.7 | 2716.7 | 0.375 | 334.05 | 24.51 |
DIVE | ex19t2 | 283.68 | 173078.7 | 0.0 | 0.201 | 551.77 | 15.60 |
DIVE | ex19t5 | 315.97 | 64192.0 | 1757.3 | 0.112 | 600.79 | 31.15 |
DIVE | exp18_be | 136.63 | 8797.3 | 0.0 | 0.014 | 247.19 | 26.08 |
DIVE | exp18_la | 284.83 | 684532.0 | 0.0 | 0.493 | 564.72 | 4.94 |
DIVE | exp19lst | 90.80 | 25114.7 | 21554.0 | 0.107 | 117.39 | 64.21 |
IAL | full_mod | 137.73 | 153335.3 | 61967.7 | 0.310 | 176.37 | 99.09 |
lbdl | lb_lst | 64.22 | 118160.0 | 0.0 | 0.209 | 121.50 | 6.93 |
lbdl | lb_thicc | 59.04 | 107211.3 | 234.0 | 0.190 | 109.17 | 8.91 |
DKFZ-MIC | nnUNet | 74.96 | 49914.0 | 18981.3 | 0.117 | 64.46 | 85.46 |
Legend
- CREMI score
- The mean of ADGT and ADF. We are not including the F-Score for now, as our current way of computing it can lead to unfair comparison. We are working on a more robust measure and will update the results accordingly.
- FP, FN, and F-Score
- The False Positives, False Negatives, and the resulting F-Score in the clefts detection volume. See metrics for details.
- ADGT
- The average distance of any found cleft voxel to the closest ground truth cleft voxel.
- ADF
- The average distance of any ground truth cleft voxel to the closest found cleft voxel.
For each value, lower is better (F-Score shown as 1 - F-Score).
Leaderboard Synaptic Partner Identification
Results for the synaptic partner identification category, averaged over all samples.
Group | Submission | CREMI score | FP | FN |
---|---|---|---|---|
AnonumoysGroup | PrTrn66 | 0.620 | 238.000 | 451.667 |
NO2 | lr_affin | 0.567 | 118.333 | 450.000 |
DIVE | PTR_V2 | 0.453 | 162.667 | 333.667 |
HCBS | PrnTrn66 | 0.465 | 178.667 | 322.333 |
HCBS | Tr66t-01 | 0.469 | 182.667 | 318.667 |
PNI | asyn_at1 | 0.490 | 274.333 | 314.667 |
NO2 | lr_balan | 0.447 | 175.333 | 314.000 |
IAL | PSP_full | 0.464 | 187.333 | 310.000 |
PNI | asyn_ori | 0.493 | 310.000 | 302.333 |
PNI | asyn_at0 | 0.468 | 293.333 | 297.000 |
HCBS | Tr66comb | 0.451 | 219.000 | 292.333 |
HCBS | Tr66_80K | 0.449 | 223.000 | 286.667 |
IAL | PSP_unar | 0.461 | 266.667 | 281.000 |
PNI | asyn_mod | 0.423 | 367.667 | 262.333 |
- 14 items
Legend
- CREMI score
- 1 - F-Score of the FP and FN.
- FP, FN
- The False Positives and False Negatives synaptic partner pairs. See metrics for details.
For each value, lower is better.