Classification EER analysis

Competition "comp1" (train on VOC data)

Class "sheep"

Equal error rate (EER)

Submission	EER
XRCE	0.882
INRIA_Marszalek	0.878
QMUL_LSPCH	0.874
QMUL_HSLS	0.866
INRIA_Nowak	0.865
ROUND2_INRIA_Moosmann	0.865
INRIA_Moosmann	0.857
RWTH_DiscHist	0.828
RWTH_SparseHists	0.828
TKK	0.828
ROUND2_TKK	0.824
INRIA_Larlus	0.815
UVA_big5	0.804
RWTH_GMM	0.803
AP06_Lee	0.798
INSARouen	0.790
MUL_1v1	0.790
Cambridge	0.777
UVA_weibull	0.732
AP06_Batra	0.710
Siena	0.706
MUL_1vALL	0.689

Analysis

Table entry in row i, column j shows EER for method i minus EER for method j
Statistically significant differences (95% confidence) are shown in red (negative) or green (positive)
Test is chi-squared approximation of McNemar's test

Dietterich, T. G., (1998). Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms. Neural Computation, 10 (7) 1895-1924.

	XRCE	INRIA Marszalek	QMUL LSPCH	QMUL HSLS	INRIA Nowak	ROUND2 INRIA_Moosmann	INRIA Moosmann	RWTH DiscHist	RWTH SparseHists	TKK	ROUND2 TKK	INRIA Larlus	UVA big5	RWTH GMM	AP06 Lee	INSARouen	MUL 1v1	Cambridge	UVA weibull	AP06 Batra	Siena	MUL 1vALL
XRCE	-	0.004	0.009	0.017	0.017	0.017	0.025	0.055	0.054	0.055	0.059	0.067	0.079	0.080	0.084	0.092	0.092	0.105	0.150	0.172	0.176	0.193
INRIA_Marszalek	-0.004	-	0.005	0.012	0.013	0.013	0.021	0.050	0.050	0.050	0.055	0.063	0.075	0.075	0.080	0.088	0.088	0.101	0.146	0.168	0.172	0.189
QMUL_LSPCH	-0.009	-0.005	-	0.008	0.008	0.008	0.016	0.046	0.046	0.046	0.050	0.059	0.070	0.071	0.075	0.084	0.083	0.096	0.142	0.163	0.168	0.184
QMUL_HSLS	-0.017	-0.012	-0.008	-	0.000	0.000	0.008	0.038	0.038	0.038	0.042	0.051	0.062	0.063	0.067	0.076	0.075	0.088	0.134	0.155	0.160	0.177
INRIA_Nowak	-0.017	-0.013	-0.008	-0.000	-	0.000	0.008	0.038	0.038	0.038	0.042	0.051	0.062	0.063	0.067	0.076	0.075	0.088	0.134	0.155	0.160	0.176
ROUND2_INRIA_Moosmann	-0.017	-0.013	-0.008	-0.000	0.000	-	0.008	0.038	0.038	0.038	0.042	0.051	0.062	0.063	0.067	0.076	0.075	0.088	0.134	0.155	0.160	0.176
INRIA_Moosmann	-0.025	-0.021	-0.016	-0.008	-0.008	-0.008	-	0.029	0.029	0.029	0.034	0.042	0.054	0.055	0.059	0.067	0.067	0.080	0.125	0.147	0.151	0.168
RWTH_DiscHist	-0.055	-0.050	-0.046	-0.038	-0.038	-0.038	-0.029	-	-0.000	0.000	0.004	0.013	0.024	0.025	0.029	0.038	0.037	0.050	0.096	0.118	0.122	0.139
RWTH_SparseHists	-0.054	-0.050	-0.046	-0.038	-0.038	-0.038	-0.029	0.000	-	0.000	0.004	0.013	0.024	0.025	0.030	0.038	0.038	0.051	0.096	0.118	0.122	0.139
TKK	-0.055	-0.050	-0.046	-0.038	-0.038	-0.038	-0.029	0.000	-0.000	-	0.004	0.013	0.024	0.025	0.029	0.038	0.037	0.050	0.096	0.118	0.122	0.139
ROUND2_TKK	-0.059	-0.055	-0.050	-0.042	-0.042	-0.042	-0.034	-0.004	-0.004	-0.004	-	0.009	0.020	0.021	0.025	0.034	0.033	0.046	0.092	0.113	0.118	0.135
INRIA_Larlus	-0.067	-0.063	-0.059	-0.051	-0.051	-0.051	-0.042	-0.013	-0.013	-0.013	-0.009	-	0.011	0.012	0.017	0.025	0.024	0.038	0.083	0.105	0.109	0.126
UVA_big5	-0.079	-0.075	-0.070	-0.062	-0.062	-0.062	-0.054	-0.024	-0.024	-0.024	-0.020	-0.011	-	0.001	0.005	0.014	0.013	0.026	0.072	0.093	0.098	0.114
RWTH_GMM	-0.080	-0.075	-0.071	-0.063	-0.063	-0.063	-0.055	-0.025	-0.025	-0.025	-0.021	-0.012	-0.001	-	0.004	0.013	0.012	0.025	0.071	0.092	0.097	0.114
AP06_Lee	-0.084	-0.080	-0.075	-0.067	-0.067	-0.067	-0.059	-0.029	-0.030	-0.029	-0.025	-0.017	-0.005	-0.004	-	0.008	0.008	0.021	0.067	0.088	0.092	0.109
INSARouen	-0.092	-0.088	-0.084	-0.076	-0.076	-0.076	-0.067	-0.038	-0.038	-0.038	-0.034	-0.025	-0.014	-0.013	-0.008	-	-0.001	0.012	0.058	0.080	0.084	0.101
MUL_1v1	-0.092	-0.088	-0.083	-0.075	-0.075	-0.075	-0.067	-0.037	-0.038	-0.037	-0.033	-0.024	-0.013	-0.012	-0.008	0.001	-	0.013	0.059	0.080	0.085	0.101
Cambridge	-0.105	-0.101	-0.096	-0.088	-0.088	-0.088	-0.080	-0.050	-0.051	-0.050	-0.046	-0.038	-0.026	-0.025	-0.021	-0.012	-0.013	-	0.046	0.067	0.072	0.088
UVA_weibull	-0.150	-0.146	-0.142	-0.134	-0.134	-0.134	-0.125	-0.096	-0.096	-0.096	-0.092	-0.083	-0.072	-0.071	-0.067	-0.058	-0.059	-0.046	-	0.022	0.026	0.043
AP06_Batra	-0.172	-0.168	-0.163	-0.155	-0.155	-0.155	-0.147	-0.118	-0.118	-0.118	-0.113	-0.105	-0.093	-0.092	-0.088	-0.080	-0.080	-0.067	-0.022	-	0.004	0.021
Siena	-0.176	-0.172	-0.168	-0.160	-0.160	-0.160	-0.151	-0.122	-0.122	-0.122	-0.118	-0.109	-0.098	-0.097	-0.092	-0.084	-0.085	-0.072	-0.026	-0.004	-	0.017
MUL_1vALL	-0.193	-0.189	-0.184	-0.177	-0.176	-0.176	-0.168	-0.139	-0.139	-0.139	-0.135	-0.126	-0.114	-0.114	-0.109	-0.101	-0.101	-0.088	-0.043	-0.021	-0.017	-