Classification EER analysis

Competition "comp1" (train on VOC data)

Class "cat"

Equal error rate (EER)

Submission	EER
QMUL_HSLS	0.866
QMUL_LSPCH	0.866
XRCE	0.861
INRIA_Marszalek	0.856
INRIA_Nowak	0.829
INRIA_Moosmann	0.814
ROUND2_INRIA_Moosmann	0.814
RWTH_SparseHists	0.809
RWTH_DiscHist	0.804
RWTH_GMM	0.796
INRIA_Larlus	0.794
TKK	0.794
ROUND2_TKK	0.789
AP06_Lee	0.781
UVA_big5	0.773
MUL_1v1	0.763
Cambridge	0.745
UVA_weibull	0.745
AP06_Batra	0.668
Siena	0.665
MUL_1vALL	0.538

Analysis

Table entry in row i, column j shows EER for method i minus EER for method j
Statistically significant differences (95% confidence) are shown in red (negative) or green (positive)
Test is chi-squared approximation of McNemar's test

Dietterich, T. G., (1998). Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms. Neural Computation, 10 (7) 1895-1924.

	QMUL HSLS	QMUL LSPCH	XRCE	INRIA Marszalek	INRIA Nowak	INRIA Moosmann	ROUND2 INRIA_Moosmann	RWTH SparseHists	RWTH DiscHist	RWTH GMM	INRIA Larlus	TKK	ROUND2 TKK	AP06 Lee	UVA big5	MUL 1v1	Cambridge	UVA weibull	AP06 Batra	Siena	MUL 1vALL
QMUL_HSLS	-	-0.000	0.005	0.010	0.037	0.052	0.051	0.057	0.062	0.070	0.072	0.072	0.077	0.085	0.093	0.103	0.121	0.121	0.198	0.201	0.328
QMUL_LSPCH	0.000	-	0.006	0.011	0.037	0.053	0.052	0.057	0.062	0.071	0.072	0.072	0.078	0.085	0.093	0.104	0.121	0.122	0.199	0.202	0.328
XRCE	-0.005	-0.006	-	0.005	0.031	0.047	0.046	0.051	0.056	0.065	0.067	0.067	0.072	0.080	0.088	0.098	0.115	0.116	0.193	0.196	0.323
INRIA_Marszalek	-0.010	-0.011	-0.005	-	0.026	0.042	0.041	0.046	0.051	0.060	0.062	0.062	0.067	0.075	0.083	0.093	0.111	0.111	0.188	0.191	0.318
INRIA_Nowak	-0.037	-0.037	-0.031	-0.026	-	0.016	0.015	0.020	0.025	0.034	0.035	0.035	0.041	0.048	0.056	0.067	0.084	0.085	0.162	0.165	0.291
INRIA_Moosmann	-0.052	-0.053	-0.047	-0.042	-0.016	-	-0.001	0.005	0.010	0.018	0.020	0.020	0.025	0.033	0.041	0.051	0.069	0.069	0.146	0.149	0.276
ROUND2_INRIA_Moosmann	-0.051	-0.052	-0.046	-0.041	-0.015	0.001	-	0.005	0.010	0.019	0.021	0.021	0.026	0.033	0.041	0.052	0.069	0.070	0.147	0.150	0.276
RWTH_SparseHists	-0.057	-0.057	-0.051	-0.046	-0.020	-0.005	-0.005	-	0.005	0.013	0.015	0.015	0.021	0.028	0.036	0.047	0.064	0.064	0.142	0.144	0.271
RWTH_DiscHist	-0.062	-0.062	-0.056	-0.051	-0.025	-0.010	-0.010	-0.005	-	0.008	0.010	0.010	0.016	0.023	0.031	0.042	0.059	0.059	0.137	0.139	0.266
RWTH_GMM	-0.070	-0.071	-0.065	-0.060	-0.034	-0.018	-0.019	-0.013	-0.008	-	0.002	0.002	0.007	0.015	0.023	0.033	0.051	0.051	0.128	0.131	0.258
INRIA_Larlus	-0.072	-0.072	-0.067	-0.062	-0.035	-0.020	-0.021	-0.015	-0.010	-0.002	-	0.000	0.005	0.013	0.021	0.031	0.049	0.049	0.126	0.129	0.256
TKK	-0.072	-0.072	-0.067	-0.062	-0.035	-0.020	-0.021	-0.015	-0.010	-0.002	0.000	-	0.005	0.013	0.021	0.031	0.049	0.049	0.126	0.129	0.256
ROUND2_TKK	-0.077	-0.078	-0.072	-0.067	-0.041	-0.025	-0.026	-0.021	-0.016	-0.007	-0.005	-0.005	-	0.008	0.016	0.026	0.043	0.044	0.121	0.124	0.251
AP06_Lee	-0.085	-0.085	-0.080	-0.075	-0.048	-0.033	-0.033	-0.028	-0.023	-0.015	-0.013	-0.013	-0.008	-	0.008	0.019	0.036	0.036	0.114	0.116	0.243
UVA_big5	-0.093	-0.093	-0.088	-0.083	-0.056	-0.041	-0.041	-0.036	-0.031	-0.023	-0.021	-0.021	-0.016	-0.008	-	0.011	0.028	0.028	0.106	0.108	0.235
MUL_1v1	-0.103	-0.104	-0.098	-0.093	-0.067	-0.051	-0.052	-0.047	-0.042	-0.033	-0.031	-0.031	-0.026	-0.019	-0.011	-	0.017	0.018	0.095	0.098	0.224
Cambridge	-0.121	-0.121	-0.115	-0.111	-0.084	-0.069	-0.069	-0.064	-0.059	-0.051	-0.049	-0.049	-0.043	-0.036	-0.028	-0.017	-	0.000	0.078	0.080	0.207
UVA_weibull	-0.121	-0.122	-0.116	-0.111	-0.085	-0.069	-0.070	-0.064	-0.059	-0.051	-0.049	-0.049	-0.044	-0.036	-0.028	-0.018	-0.000	-	0.077	0.080	0.207
AP06_Batra	-0.198	-0.199	-0.193	-0.188	-0.162	-0.146	-0.147	-0.142	-0.137	-0.128	-0.126	-0.126	-0.121	-0.114	-0.106	-0.095	-0.078	-0.077	-	0.003	0.130
Siena	-0.201	-0.202	-0.196	-0.191	-0.165	-0.149	-0.150	-0.144	-0.139	-0.131	-0.129	-0.129	-0.124	-0.116	-0.108	-0.098	-0.080	-0.080	-0.003	-	0.127
MUL_1vALL	-0.328	-0.328	-0.323	-0.318	-0.291	-0.276	-0.276	-0.271	-0.266	-0.258	-0.256	-0.256	-0.251	-0.243	-0.235	-0.224	-0.207	-0.207	-0.130	-0.127	-