Classification EER analysis

Competition "comp1" (train on VOC data)

Class "motorbike"

Equal error rate (EER)

Submission	EER
INRIA_Nowak	0.897
QMUL_HSLS	0.897
QMUL_LSPCH	0.897
INRIA_Marszalek	0.889
XRCE	0.885
ROUND2_INRIA_Moosmann	0.872
RWTH_DiscHist	0.867
UVA_big5	0.846
TKK	0.838
ROUND2_TKK	0.838
RWTH_GMM	0.829
UVA_weibull	0.826
MUL_1v1	0.812
INRIA_Larlus	0.803
RWTH_SparseHists	0.791
MUL_1vALL	0.765
Cambridge	0.761
AP06_Lee	0.748
Siena	0.645
AP06_Batra	0.623

Analysis

Table entry in row i, column j shows EER for method i minus EER for method j
Statistically significant differences (95% confidence) are shown in red (negative) or green (positive)
Test is chi-squared approximation of McNemar's test

Dietterich, T. G., (1998). Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms. Neural Computation, 10 (7) 1895-1924.

	INRIA Nowak	QMUL HSLS	QMUL LSPCH	INRIA Marszalek	XRCE	ROUND2 INRIA_Moosmann	RWTH DiscHist	UVA big5	TKK	ROUND2 TKK	RWTH GMM	UVA weibull	MUL 1v1	INRIA Larlus	RWTH SparseHists	MUL 1vALL	Cambridge	AP06 Lee	Siena	AP06 Batra
INRIA_Nowak	-	0.000	0.000	0.008	0.013	0.026	0.031	0.051	0.060	0.060	0.068	0.072	0.085	0.094	0.107	0.132	0.137	0.149	0.252	0.274
QMUL_HSLS	0.000	-	0.000	0.008	0.013	0.026	0.031	0.051	0.060	0.060	0.068	0.072	0.085	0.094	0.107	0.132	0.137	0.149	0.252	0.274
QMUL_LSPCH	0.000	0.000	-	0.008	0.013	0.026	0.031	0.051	0.060	0.060	0.068	0.072	0.085	0.094	0.107	0.132	0.137	0.149	0.252	0.274
INRIA_Marszalek	-0.008	-0.008	-0.008	-	0.004	0.017	0.022	0.043	0.051	0.051	0.060	0.063	0.077	0.086	0.098	0.124	0.128	0.141	0.244	0.266
XRCE	-0.013	-0.013	-0.013	-0.004	-	0.013	0.018	0.038	0.047	0.047	0.055	0.059	0.073	0.081	0.094	0.120	0.124	0.137	0.240	0.261
ROUND2_INRIA_Moosmann	-0.026	-0.026	-0.026	-0.017	-0.013	-	0.005	0.026	0.034	0.034	0.043	0.046	0.060	0.069	0.081	0.107	0.111	0.124	0.227	0.249
RWTH_DiscHist	-0.031	-0.031	-0.031	-0.022	-0.018	-0.005	-	0.020	0.029	0.029	0.037	0.041	0.055	0.063	0.076	0.102	0.106	0.119	0.222	0.243
UVA_big5	-0.051	-0.051	-0.051	-0.043	-0.038	-0.026	-0.020	-	0.009	0.009	0.017	0.021	0.034	0.043	0.056	0.081	0.086	0.098	0.201	0.223
TKK	-0.060	-0.060	-0.060	-0.051	-0.047	-0.034	-0.029	-0.009	-	0.000	0.008	0.012	0.026	0.034	0.047	0.073	0.077	0.090	0.193	0.214
ROUND2_TKK	-0.060	-0.060	-0.060	-0.051	-0.047	-0.034	-0.029	-0.009	0.000	-	0.008	0.012	0.026	0.034	0.047	0.073	0.077	0.090	0.193	0.214
RWTH_GMM	-0.068	-0.068	-0.068	-0.060	-0.055	-0.043	-0.037	-0.017	-0.008	-0.008	-	0.004	0.017	0.026	0.039	0.064	0.069	0.081	0.184	0.206
UVA_weibull	-0.072	-0.072	-0.072	-0.063	-0.059	-0.046	-0.041	-0.021	-0.012	-0.012	-0.004	-	0.014	0.022	0.035	0.061	0.065	0.078	0.181	0.202
MUL_1v1	-0.085	-0.085	-0.085	-0.077	-0.073	-0.060	-0.055	-0.034	-0.026	-0.026	-0.017	-0.014	-	0.009	0.022	0.047	0.051	0.064	0.167	0.189
INRIA_Larlus	-0.094	-0.094	-0.094	-0.086	-0.081	-0.069	-0.063	-0.043	-0.034	-0.034	-0.026	-0.022	-0.009	-	0.013	0.038	0.043	0.055	0.158	0.180
RWTH_SparseHists	-0.107	-0.107	-0.107	-0.098	-0.094	-0.081	-0.076	-0.056	-0.047	-0.047	-0.039	-0.035	-0.022	-0.013	-	0.026	0.030	0.043	0.146	0.167
MUL_1vALL	-0.132	-0.132	-0.132	-0.124	-0.120	-0.107	-0.102	-0.081	-0.073	-0.073	-0.064	-0.061	-0.047	-0.038	-0.026	-	0.004	0.017	0.120	0.142
Cambridge	-0.137	-0.137	-0.137	-0.128	-0.124	-0.111	-0.106	-0.086	-0.077	-0.077	-0.069	-0.065	-0.051	-0.043	-0.030	-0.004	-	0.013	0.116	0.137
AP06_Lee	-0.149	-0.149	-0.149	-0.141	-0.137	-0.124	-0.119	-0.098	-0.090	-0.090	-0.081	-0.078	-0.064	-0.055	-0.043	-0.017	-0.013	-	0.103	0.125
Siena	-0.252	-0.252	-0.252	-0.244	-0.240	-0.227	-0.222	-0.201	-0.193	-0.193	-0.184	-0.181	-0.167	-0.158	-0.146	-0.120	-0.116	-0.103	-	0.022
AP06_Batra	-0.274	-0.274	-0.274	-0.266	-0.261	-0.249	-0.243	-0.223	-0.214	-0.214	-0.206	-0.202	-0.189	-0.180	-0.167	-0.142	-0.137	-0.125	-0.022	-