Classification EER analysis

Competition "comp1" (train on VOC data)

Class "bicycle"

Equal error rate (EER)

Submission	EER
QMUL_LSPCH	0.870
QMUL_HSLS	0.866
XRCE	0.855
INRIA_Marszalek	0.844
ROUND2_INRIA_Moosmann	0.836
INRIA_Nowak	0.832
INRIA_Larlus	0.817
INRIA_Moosmann	0.802
MUL_1v1	0.802
RWTH_GMM	0.802
UVA_big5	0.795
Cambridge	0.787
RWTH_DiscHist	0.784
MUL_1vALL	0.776
TKK	0.776
AP06_Lee	0.773
RWTH_SparseHists	0.772
ROUND2_TKK	0.757
UVA_weibull	0.754
AP06_Batra	0.720
Siena	0.638

Analysis

Table entry in row i, column j shows EER for method i minus EER for method j
Statistically significant differences (95% confidence) are shown in red (negative) or green (positive)
Test is chi-squared approximation of McNemar's test

Dietterich, T. G., (1998). Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms. Neural Computation, 10 (7) 1895-1924.

	QMUL LSPCH	QMUL HSLS	XRCE	INRIA Marszalek	ROUND2 INRIA_Moosmann	INRIA Nowak	INRIA Larlus	INRIA Moosmann	MUL 1v1	RWTH GMM	UVA big5	Cambridge	RWTH DiscHist	MUL 1vALL	TKK	AP06 Lee	RWTH SparseHists	ROUND2 TKK	UVA weibull	AP06 Batra	Siena
QMUL_LSPCH	-	0.004	0.015	0.025	0.033	0.037	0.052	0.067	0.067	0.067	0.074	0.082	0.086	0.093	0.093	0.096	0.097	0.112	0.116	0.150	0.232
QMUL_HSLS	-0.004	-	0.011	0.022	0.029	0.034	0.049	0.063	0.063	0.063	0.071	0.078	0.082	0.090	0.090	0.093	0.093	0.108	0.112	0.146	0.228
XRCE	-0.015	-0.011	-	0.010	0.018	0.022	0.037	0.052	0.052	0.052	0.059	0.067	0.071	0.078	0.078	0.081	0.082	0.097	0.101	0.135	0.217
INRIA_Marszalek	-0.025	-0.022	-0.010	-	0.008	0.012	0.027	0.042	0.042	0.042	0.049	0.057	0.061	0.068	0.068	0.071	0.072	0.087	0.090	0.124	0.206
ROUND2_INRIA_Moosmann	-0.033	-0.029	-0.018	-0.008	-	0.004	0.019	0.034	0.034	0.034	0.041	0.049	0.053	0.060	0.060	0.063	0.064	0.079	0.083	0.117	0.198
INRIA_Nowak	-0.037	-0.034	-0.022	-0.012	-0.004	-	0.015	0.030	0.030	0.030	0.037	0.045	0.049	0.056	0.056	0.059	0.060	0.075	0.078	0.112	0.194
INRIA_Larlus	-0.052	-0.049	-0.037	-0.027	-0.019	-0.015	-	0.015	0.015	0.015	0.022	0.030	0.034	0.041	0.041	0.044	0.045	0.060	0.063	0.098	0.179
INRIA_Moosmann	-0.067	-0.063	-0.052	-0.042	-0.034	-0.030	-0.015	-	0.000	0.000	0.007	0.015	0.019	0.026	0.026	0.029	0.030	0.045	0.049	0.083	0.164
MUL_1v1	-0.067	-0.063	-0.052	-0.042	-0.034	-0.030	-0.015	0.000	-	0.000	0.007	0.015	0.019	0.026	0.026	0.029	0.030	0.045	0.049	0.083	0.164
RWTH_GMM	-0.067	-0.063	-0.052	-0.042	-0.034	-0.030	-0.015	0.000	0.000	-	0.007	0.015	0.019	0.026	0.026	0.029	0.030	0.045	0.049	0.083	0.164
UVA_big5	-0.074	-0.071	-0.059	-0.049	-0.041	-0.037	-0.022	-0.007	-0.007	-0.007	-	0.008	0.012	0.019	0.019	0.022	0.023	0.038	0.041	0.076	0.157
Cambridge	-0.082	-0.078	-0.067	-0.057	-0.049	-0.045	-0.030	-0.015	-0.015	-0.015	-0.008	-	0.004	0.011	0.011	0.014	0.015	0.030	0.034	0.068	0.149
RWTH_DiscHist	-0.086	-0.082	-0.071	-0.061	-0.053	-0.049	-0.034	-0.019	-0.019	-0.019	-0.012	-0.004	-	0.007	0.007	0.010	0.011	0.026	0.030	0.064	0.146
MUL_1vALL	-0.093	-0.090	-0.078	-0.068	-0.060	-0.056	-0.041	-0.026	-0.026	-0.026	-0.019	-0.011	-0.007	-	0.000	0.003	0.004	0.019	0.022	0.056	0.138
TKK	-0.093	-0.090	-0.078	-0.068	-0.060	-0.056	-0.041	-0.026	-0.026	-0.026	-0.019	-0.011	-0.007	0.000	-	0.003	0.004	0.019	0.022	0.056	0.138
AP06_Lee	-0.096	-0.093	-0.081	-0.071	-0.063	-0.059	-0.044	-0.029	-0.029	-0.029	-0.022	-0.014	-0.010	-0.003	-0.003	-	0.001	0.016	0.020	0.054	0.135
RWTH_SparseHists	-0.097	-0.093	-0.082	-0.072	-0.064	-0.060	-0.045	-0.030	-0.030	-0.030	-0.023	-0.015	-0.011	-0.004	-0.004	-0.001	-	0.015	0.019	0.053	0.134
ROUND2_TKK	-0.112	-0.108	-0.097	-0.087	-0.079	-0.075	-0.060	-0.045	-0.045	-0.045	-0.038	-0.030	-0.026	-0.019	-0.019	-0.016	-0.015	-	0.004	0.038	0.120
UVA_weibull	-0.116	-0.112	-0.101	-0.090	-0.083	-0.078	-0.063	-0.049	-0.049	-0.049	-0.041	-0.034	-0.030	-0.022	-0.022	-0.020	-0.019	-0.004	-	0.034	0.116
AP06_Batra	-0.150	-0.146	-0.135	-0.124	-0.117	-0.112	-0.098	-0.083	-0.083	-0.083	-0.076	-0.068	-0.064	-0.056	-0.056	-0.054	-0.053	-0.038	-0.034	-	0.082
Siena	-0.232	-0.228	-0.217	-0.206	-0.198	-0.194	-0.179	-0.164	-0.164	-0.164	-0.157	-0.149	-0.146	-0.138	-0.138	-0.135	-0.134	-0.120	-0.116	-0.082	-