CREMI

Results for the neuron segmentation category, averaged over all samples.

Group	Submission	CREMI score	VOI split	VOI merge	ARAND
DIVE	ag35-5	0.793	1.491	0.296	0.358
DIVE	unet2	0.972	1.481	0.803	0.419
DIVE	unet-2	0.972	1.481	0.803	0.419
DIVE	pi-net	0.728	1.480	0.270	0.305
DIVE	newSeg	0.752	1.471	0.252	0.335
DIVE	seg1	0.745	1.461	0.242	0.333
DIVE	unet3	0.994	1.451	0.831	0.441
DIVE	unet-3	0.994	1.451	0.831	0.441
VIDAR	mala_py	0.696	1.446	0.153	0.307
DIVE	seg2	0.735	1.438	0.239	0.330
DIVE	unet1	1.001	1.436	0.861	0.443
DIVE	unet-1	1.001	1.436	0.861	0.443
DIVE	seg5	0.730	1.423	0.243	0.328
PCH	ori_x0	0.661	1.409	0.204	0.272
DIVE	seg7	0.717	1.398	0.232	0.324
DIVE	seg8	0.717	1.388	0.239	0.325
DIVE	seg9	0.711	1.381	0.234	0.322
VIDAR	mala_py2	0.675	1.365	0.174	0.300
DIVE	SegClef1	0.723	1.365	0.425	0.298
harris-manor	DBS2D3D	0.870	1.350	0.250	0.473
harris-manor	DBS3DMT	0.834	1.348	0.226	0.445
DIVE	segBC018	0.717	1.347	0.422	0.296
DIVE	seg&BW3	0.714	1.343	0.322	0.312
harris-manor	DNBS2D3D	0.837	1.331	0.281	0.435
DIVE	seg&BW4	0.700	1.322	0.321	0.303

CREMI score: The geometric mean of (VOI split + VOI merge) and ARAND.
VOI split and merge: The Variation of Information between a segmentation X and ground truth Y. The split and merge parts correspond to the conditional entropies H(X|Y) and H(Y|X), respectively.
ARAND: The Adapted Rand Error, i.e., 1.0 - Rand F-Score.

For each value, lower is better.

Results for the synaptic cleft detection category, averaged over all samples.

Group	Submission	CREMI score	FP	FN	1 - F-score	ADGT	ADF
VCG	FgDTSm08	434.91	4747.0	355265.0	0.619	42.86	826.96
VCG	FgDT08	795.59	727.0	616222.3	0.834	60.07	1531.10

CREMI score: The mean of ADGT and ADF. We are not including the F-Score for now, as our current way of computing it can lead to unfair comparison. We are working on a more robust measure and will update the results accordingly.
FP, FN, and F-Score: The False Positives, False Negatives, and the resulting F-Score in the clefts detection volume. See metrics for details.
ADGT: The average distance of any found cleft voxel to the closest ground truth cleft voxel.
ADF: The average distance of any ground truth cleft voxel to the closest found cleft voxel.

For each value, lower is better (F-Score shown as 1 - F-Score).

Results for the synaptic partner identification category, averaged over all samples.

Group	Submission	CREMI score	FP	FN
PNI	asyn_mod	0.423	367.667	262.333
NO2	lr_balan	0.447	175.333	314.000
HCBS	Tr66_80K	0.449	223.000	286.667
HCBS	Tr66comb	0.451	219.000	292.333
DIVE	PTR_V2	0.453	162.667	333.667
IAL	PSP_unar	0.461	266.667	281.000
IAL	PSP_full	0.464	187.333	310.000
HCBS	PrnTrn66	0.465	178.667	322.333
PNI	asyn_at0	0.468	293.333	297.000
HCBS	Tr66t-01	0.469	182.667	318.667
PNI	asyn_at1	0.490	274.333	314.667
PNI	asyn_ori	0.493	310.000	302.333
NO2	lr_affin	0.567	118.333	450.000
AnonumoysGroup	PrTrn66	0.620	238.000	451.667

CREMI score: 1 - F-Score of the FP and FN.
FP, FN: The False Positives and False Negatives synaptic partner pairs. See metrics for details.

For each value, lower is better.

MICCAI Challenge on Circuit Reconstruction from Electron Microscopy Images