CREMI

Results for the neuron segmentation category, averaged over all samples.

Group	Submission	CREMI score	VOI split	VOI merge	ARAND
DIVE	ag35-5	0.793	1.491	0.296	0.358
DIVE	seg030	0.793	1.584	0.328	0.337
DIVE	seg3	0.798	1.587	0.351	0.341
DIVE	ag35	0.804	0.853	0.647	0.438
PCH	ori_x4	0.839	1.700	0.078	0.398
FI-NCA	UnetTest	0.950	1.120	0.737	0.486
DIVE	unet2	0.972	1.481	0.803	0.419
DIVE	unet-2	0.972	1.481	0.803	0.419
DIVE	unet4	0.987	1.523	0.775	0.429
DIVE	unet-4	0.987	1.523	0.775	0.429
PCH	UNet_hw	0.990	1.828	0.529	0.419
DIVE	unet3	0.994	1.451	0.831	0.441
DIVE	unet-3	0.994	1.451	0.831	0.441
DIVE	unet1	1.001	1.436	0.861	0.443
DIVE	unet-1	1.001	1.436	0.861	0.443
SCI	Submission_1	1.088	1.782	0.556	0.518
Rhoana	Test1	1.162	1.646	1.179	0.486
DIVE	ag23	1.221	0.755	1.557	0.647
DIVE	focalZ	1.424	0.793	1.925	0.748
SeungLab-eding	Seung-ed	1.525	0.895	2.160	0.764
afish1001	OurUnet	2.197	0.698	5.034	0.855
afish1001	ABWUnet	2.199	0.696	5.042	0.856
HVCL	Deep Res	2.212	1.672	4.182	0.837
afish1001	wunet_wj	2.212	0.641	5.157	0.854
afish1001	unet_wj	2.223	0.648	5.178	0.858

CREMI score: The geometric mean of (VOI split + VOI merge) and ARAND.
VOI split and merge: The Variation of Information between a segmentation X and ground truth Y. The split and merge parts correspond to the conditional entropies H(X|Y) and H(Y|X), respectively.
ARAND: The Adapted Rand Error, i.e., 1.0 - Rand F-Score.

For each value, lower is better.

Results for the synaptic cleft detection category, averaged over all samples.

Group	Submission	CREMI score	FP	FN	1 - F-score	ADGT	ADF
VCG	FgDT08	795.59	727.0	616222.3	0.834	60.07	1531.10

CREMI score: The mean of ADGT and ADF. We are not including the F-Score for now, as our current way of computing it can lead to unfair comparison. We are working on a more robust measure and will update the results accordingly.
FP, FN, and F-Score: The False Positives, False Negatives, and the resulting F-Score in the clefts detection volume. See metrics for details.
ADGT: The average distance of any found cleft voxel to the closest ground truth cleft voxel.
ADF: The average distance of any ground truth cleft voxel to the closest found cleft voxel.

For each value, lower is better (F-Score shown as 1 - F-Score).

Results for the synaptic partner identification category, averaged over all samples.

Group	Submission	CREMI score	FP	FN
AnonumoysGroup	PrTrn66	0.620	238.000	451.667
DIVE	PTR_V2	0.453	162.667	333.667
HCBS	Tr66_80K	0.449	223.000	286.667
HCBS	Tr66comb	0.451	219.000	292.333
HCBS	PrnTrn66	0.465	178.667	322.333
HCBS	Tr66t-01	0.469	182.667	318.667
IAL	PSP_unar	0.461	266.667	281.000
IAL	PSP_full	0.464	187.333	310.000
NO2	lr_balan	0.447	175.333	314.000
NO2	lr_affin	0.567	118.333	450.000
PNI	asyn_mod	0.423	367.667	262.333
PNI	asyn_at0	0.468	293.333	297.000
PNI	asyn_at1	0.490	274.333	314.667
PNI	asyn_ori	0.493	310.000	302.333

CREMI score: 1 - F-Score of the FP and FN.
FP, FN: The False Positives and False Negatives synaptic partner pairs. See metrics for details.

For each value, lower is better.

MICCAI Challenge on Circuit Reconstruction from Electron Microscopy Images