Classification EER analysis

Competition "comp1" (train on VOC data)

Class "car"

Equal error rate (EER)

Submission	EER
INRIA_Nowak	0.921
QMUL_HSLS	0.919
QMUL_LSPCH	0.917
INRIA_Marszalek	0.915
ROUND2_INRIA_Moosmann	0.910
XRCE	0.904
INRIA_Moosmann	0.895
ROUND2_TKK	0.883
INRIA_Larlus	0.875
UVA_big5	0.871
RWTH_GMM	0.868
TKK	0.866
RWTH_DiscHist	0.864
MUL_1v1	0.860
RWTH_SparseHists	0.859
MUL_1vALL	0.846
AP06_Lee	0.822
INSARouen	0.818
UVA_weibull	0.816
Cambridge	0.796
Siena	0.770
AP06_Batra	0.754

Analysis

Table entry in row i, column j shows EER for method i minus EER for method j
Statistically significant differences (95% confidence) are shown in red (negative) or green (positive)
Test is chi-squared approximation of McNemar's test

Dietterich, T. G., (1998). Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms. Neural Computation, 10 (7) 1895-1924.

	INRIA Nowak	QMUL HSLS	QMUL LSPCH	INRIA Marszalek	ROUND2 INRIA_Moosmann	XRCE	INRIA Moosmann	ROUND2 TKK	INRIA Larlus	UVA big5	RWTH GMM	TKK	RWTH DiscHist	MUL 1v1	RWTH SparseHists	MUL 1vALL	AP06 Lee	INSARouen	UVA weibull	Cambridge	Siena	AP06 Batra
INRIA_Nowak	-	0.002	0.004	0.006	0.011	0.017	0.026	0.038	0.046	0.050	0.053	0.055	0.057	0.061	0.062	0.075	0.099	0.103	0.105	0.125	0.151	0.167
QMUL_HSLS	-0.002	-	0.001	0.003	0.009	0.014	0.023	0.036	0.044	0.047	0.051	0.053	0.055	0.059	0.060	0.073	0.097	0.101	0.102	0.122	0.149	0.165
QMUL_LSPCH	-0.004	-0.001	-	0.002	0.007	0.013	0.022	0.035	0.042	0.046	0.050	0.052	0.054	0.057	0.059	0.071	0.096	0.099	0.101	0.121	0.147	0.164
INRIA_Marszalek	-0.006	-0.003	-0.002	-	0.005	0.011	0.020	0.033	0.040	0.044	0.048	0.049	0.052	0.055	0.056	0.069	0.094	0.097	0.099	0.119	0.145	0.161
ROUND2_INRIA_Moosmann	-0.011	-0.009	-0.007	-0.005	-	0.006	0.015	0.027	0.035	0.039	0.042	0.044	0.046	0.050	0.051	0.064	0.088	0.092	0.094	0.114	0.140	0.156
XRCE	-0.017	-0.014	-0.013	-0.011	-0.006	-	0.009	0.022	0.029	0.033	0.037	0.039	0.041	0.044	0.046	0.058	0.083	0.086	0.088	0.108	0.134	0.151
INRIA_Moosmann	-0.026	-0.023	-0.022	-0.020	-0.015	-0.009	-	0.013	0.020	0.024	0.028	0.030	0.032	0.035	0.036	0.049	0.074	0.077	0.079	0.099	0.125	0.141
ROUND2_TKK	-0.038	-0.036	-0.035	-0.033	-0.027	-0.022	-0.013	-	0.008	0.011	0.015	0.017	0.019	0.023	0.024	0.037	0.061	0.065	0.066	0.086	0.113	0.129
INRIA_Larlus	-0.046	-0.044	-0.042	-0.040	-0.035	-0.029	-0.020	-0.008	-	0.004	0.007	0.009	0.011	0.015	0.016	0.029	0.053	0.057	0.059	0.079	0.105	0.121
UVA_big5	-0.050	-0.047	-0.046	-0.044	-0.039	-0.033	-0.024	-0.011	-0.004	-	0.004	0.006	0.008	0.011	0.013	0.025	0.050	0.053	0.055	0.075	0.101	0.118
RWTH_GMM	-0.053	-0.051	-0.050	-0.048	-0.042	-0.037	-0.028	-0.015	-0.007	-0.004	-	0.002	0.004	0.007	0.009	0.022	0.046	0.049	0.051	0.071	0.098	0.114
TKK	-0.055	-0.053	-0.052	-0.049	-0.044	-0.039	-0.030	-0.017	-0.009	-0.006	-0.002	-	0.002	0.006	0.007	0.020	0.044	0.048	0.049	0.069	0.096	0.112
RWTH_DiscHist	-0.057	-0.055	-0.054	-0.052	-0.046	-0.041	-0.032	-0.019	-0.011	-0.008	-0.004	-0.002	-	0.003	0.005	0.018	0.042	0.046	0.047	0.067	0.094	0.110
MUL_1v1	-0.061	-0.059	-0.057	-0.055	-0.050	-0.044	-0.035	-0.023	-0.015	-0.011	-0.007	-0.006	-0.003	-	0.001	0.014	0.039	0.042	0.044	0.064	0.090	0.106
RWTH_SparseHists	-0.062	-0.060	-0.059	-0.056	-0.051	-0.046	-0.036	-0.024	-0.016	-0.013	-0.009	-0.007	-0.005	-0.001	-	0.013	0.037	0.041	0.043	0.062	0.089	0.105
MUL_1vALL	-0.075	-0.073	-0.071	-0.069	-0.064	-0.058	-0.049	-0.037	-0.029	-0.025	-0.022	-0.020	-0.018	-0.014	-0.013	-	0.024	0.028	0.030	0.050	0.076	0.092
AP06_Lee	-0.099	-0.097	-0.096	-0.094	-0.088	-0.083	-0.074	-0.061	-0.053	-0.050	-0.046	-0.044	-0.042	-0.039	-0.037	-0.024	-	0.003	0.005	0.025	0.052	0.068
INSARouen	-0.103	-0.101	-0.099	-0.097	-0.092	-0.086	-0.077	-0.065	-0.057	-0.053	-0.049	-0.048	-0.046	-0.042	-0.041	-0.028	-0.003	-	0.002	0.022	0.048	0.064
UVA_weibull	-0.105	-0.102	-0.101	-0.099	-0.094	-0.088	-0.079	-0.066	-0.059	-0.055	-0.051	-0.049	-0.047	-0.044	-0.043	-0.030	-0.005	-0.002	-	0.020	0.046	0.062
Cambridge	-0.125	-0.122	-0.121	-0.119	-0.114	-0.108	-0.099	-0.086	-0.079	-0.075	-0.071	-0.069	-0.067	-0.064	-0.062	-0.050	-0.025	-0.022	-0.020	-	0.026	0.043
Siena	-0.151	-0.149	-0.147	-0.145	-0.140	-0.134	-0.125	-0.113	-0.105	-0.101	-0.098	-0.096	-0.094	-0.090	-0.089	-0.076	-0.052	-0.048	-0.046	-0.026	-	0.016
AP06_Batra	-0.167	-0.165	-0.164	-0.161	-0.156	-0.151	-0.141	-0.129	-0.121	-0.118	-0.114	-0.112	-0.110	-0.106	-0.105	-0.092	-0.068	-0.064	-0.062	-0.043	-0.016	-