Results of the wikipedia retrieval task at ImageCLEF 2010

Introduction

The results for the wikipedia retrieval task are computed with the trec_eval tool (version 9.0). Please use this tool in combination with the sources provided below.

The submitted runs have been corrected (where necessary) so as to correspond to valid runs in the correct TREC format. The following corrections have been made:

The ranks in the retrieval results have been appropriately fixed so that they correspond to consecutive numbers in ascending order starting from 0.
Each of the submitted runs has been assigned a unique name.

The relevance assessments (qrels) for the wikipedia retrieval 2010 topics can be found here.

Results

The evaluation results for all submitted runs in the wikipedia retrieval task are listed below ranked by MAP. The runs marked with a * are manual.

For the evaluation results for the runs submitted by each participant please select the appropriate group from the following list:
cheshire daedalus dcu duth i2rcviu nus rgu sztaki telecom uaic uned unt xrce

	Participant	Run	Modality	FB/QE	Annotation language	Topic language	Topic field(s)	MAP	P@10	P@20	R-prec.	Bpref	NDCG	retrieved images	relevant retrieved images
1	xrce	XRCE_AUTO_FUSION_SEQ_RERANKING-TEXTLGD_ALL_METANOPRF_PARAGPRF20	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2765	0.5814	0.5193	0.3465	0.3137	0.5537	70000	8802
2	xrce	XRCE_AUTO_CONFAGmin_FUSION_SEQ_RERANKING-TEXTLGD_ALL_METANOPRF_PARAGPRF20	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2681	0.5686	0.5257	0.3413	0.3059	0.5484	70000	8709
3	xrce	XRCE_AUTO_FUSION_SEQ_RERANKING-TEXTLGD_ALL_METANOPRF_PARAGPRF20-Rer7_Text3	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2627	0.6114	0.5407	0.3289	0.2967	0.5359	70000	8749
4	xrce	XRCE_AUTO_FUSION_SEQ_RERANKING_PW2-TEXT_PW2LGD_ALL_METANOPRF_PARAGPRF20	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2591	0.5829	0.5143	0.3316	0.2991	0.5376	70000	8717
5	xrce	XRCE_AUTO_CONFAGmin_FUSION_SEQ_RERANKING-TEXTLGD_ALL_META_PARAG	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2575	0.5957	0.5164	0.3257	0.2945	0.5326	70000	8340
6	xrce	XRCE_AUTO_CONF0.7_FUSION_SEQ_RERANKING-TEXTLGD_ALL_METANOPRF_PARAGPRF20	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2532	0.5429	0.4986	0.3300	0.2871	0.5359	70000	8829
7	xrce	XRCE_AUTO_FUSION_SEQ_RERANKING-TEXTLGD_ALL_META_PARAG-Rer7_Text3	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2527	0.5971	0.5336	0.3200	0.2873	0.5186	70000	8372
8	xrce	XRCE_AUTO_FUSION_SEQ_RERANKING_PW2-TEXT_PW2LGD_ALL_META_PARAG	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2495	0.5729	0.5157	0.3189	0.2905	0.5201	70000	8339
9	xrce	XRCE_AUTO_FUSION_SEQ_RERANKING-TEXTLGD_ALL_METANOPRF_PARAGPRF20-Rer3_Text7	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2493	0.5171	0.4743	0.3233	0.2874	0.5353	70000	8736
10	xrce	XRCE_AUTO_CONF0.7_FUSION_SEQ_RERANKING-TEXTLGD_ALL_META_PARAG	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2424	0.5543	0.4907	0.3183	0.2806	0.5210	70000	8462
11	xrce	XRCE_AUTO_FUSION_SEQ_RERANKING-TEXTLGD_ALL_META_PARAG-Rer3_Text7	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2415	0.5414	0.4664	0.3165	0.2800	0.5243	70000	8383
12	xrce	ALL_DFRPMETAPRF5_DFRPARAGPRF20	Textual	FB	EN+FR+DE	EN+FR+DE	TITLE	0.2361	0.4871	0.4393	0.3077	0.2694	0.5217	70000	8658
13	unt	untaTxEn	Textual	NOFB	EN	EN	TITLE	0.2251	0.4314	0.3871	0.3025	0.2617	0.4774	55647	7840
14	telecom	telecom_en_flickr_wiki_maj	Textual	QE	EN+FR+DE	EN	TITLE	0.2227	0.4829	0.4407	0.2953	0.2700	0.4809	70000	7854
15	unt	untaTxFr	Textual	NOFB	FR	FR	TITLE	0.2200	0.4229	0.3986	0.2855	0.2567	0.4634	58476	7641
16	i2rcviu	MONOLINGUAL	Textual	NOFB	EN	EN+FR+DE	TITLE	0.2126	0.4486	0.4143	0.2832	0.2585	0.4805	68739	6955
17	unt*	untMan1TxEn*	Textual	FB	EN	EN	TITLE	0.2064	0.5886	0.5021	0.2603	0.2411	0.3639	11779	4584
18	telecom	telecom_en_flickr_wiki	Textual	QE	EN+FR+DE	EN	TITLE	0.2052	0.4786	0.4236	0.2677	0.2422	0.4670	70000	7789
19	xrce	LGD_ALL_METANOPRF_PARAGPRF20	Textual	FB	EN+FR+DE	EN+FR+DE	TITLE	0.2045	0.4686	0.4200	0.2782	0.2413	0.4903	69848	7985
20	dcu	dcuRunOkapi	Textual	QE	EN	EN	TITLE	0.2039	0.4271	0.3907	0.2832	0.2491	0.4288	67706	6865
21	dcu	dcuRunOkapiAll	Textual	QE	EN+FR+DE	EN+FR+DE	TITLE	0.2039	0.4271	0.3907	0.2832	0.2491	0.4288	67706	6865
22	telecom	telecom_en_flickr_wiki_maj_visual_bag_reranked	Mixed	QE	EN+FR+DE	EN	TITLEIMG_Q	0.2026	0.4914	0.4336	0.2720	0.2504	0.4630	70000	7262
23	telecom	telecom_en_flickr_wiki_maj_visual_merged	Mixed	QE	EN+FR+DE	EN	TITLEIMG_Q	0.2023	0.4871	0.4293	0.2726	0.2487	0.4623	70000	7258
24	cheshire	BRK_T2BF_ENDEFR_ALL	Textual	FB	EN+FR+DE	EN+FR+DE	TITLE	0.2014	0.4600	0.4036	0.2739	0.2380	0.4372	70000	6986
25	telecom	telecom_en_flickr_wiki_maj_visual_tlep_reranked	Mixed	QE	EN+FR+DE	EN	TITLEIMG_Q	0.2000	0.4914	0.4286	0.2639	0.2440	0.4610	70000	7245
26	duth	DUTH_20_MinMaxSum	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1998	0.5200	0.4836	0.2820	0.2507	0.4355	70000	6888
27	telecom	telecom_mixed_flickr_wiki_maj	Textual	QE	EN+FR+DE	EN+FR+DE	TITLE	0.1994	0.4886	0.4250	0.2748	0.2442	0.4691	70000	8328
28	telecom	telecom_en_flickr_wiki_visual_merged	Mixed	QE	EN+FR+DE	EN	TITLEIMG_Q	0.1985	0.4586	0.4150	0.2626	0.2367	0.4592	70000	7440
29	i2rcviu	I2R.VISUAL.NDK	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1984	0.4971	0.4321	0.2761	0.2466	0.4546	64830	6084
30	telecom	telecom_en_flickr_wiki_visual_bag_reranked	Mixed	QE	EN+FR+DE	EN	TITLEIMG_Q	0.1974	0.4729	0.4179	0.2621	0.2382	0.4576	70000	7460
31	telecom	telecom_en_flickr_wiki_visual_tlep_reranked	Mixed	QE	EN+FR+DE	EN	TITLEIMG_Q	0.1960	0.4600	0.4164	0.2573	0.2354	0.4587	70000	7445
32	i2rcviu	I2R.Feat.selection	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1945	0.4600	0.4186	0.2684	0.2365	0.4561	68252	6216
33	cheshire	BRK_T2BF_EN_ALL	Textual	FB	EN	EN	TITLE	0.1941	0.4929	0.4364	0.2713	0.2397	0.4373	69369	6900
34	uned	UNED-UV1_EN+FR+DE_YES_EN+FR+DE_AUTO_NOFB_TXT_TITLE	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1927	0.3914	0.3564	0.2663	0.2282	0.4092	50180	6556
35	telecom	telecom_mixed_flickr_wiki_maj_visual_bag_reranked	Mixed	QE	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1917	0.4700	0.4186	0.2721	0.2369	0.4518	68464	7943
36	telecom	telecom_mixed_flickr_wiki_maj_visual_merged	Mixed	QE	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1906	0.4800	0.4229	0.2697	0.2352	0.4515	68464	7935
37	xrce	LGD_ALL_META_PARAG	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1903	0.4629	0.4000	0.2746	0.2368	0.4710	66862	7640
38	telecom	telecom_mixed_flickr_wiki	Textual	QE	EN+FR+DE	EN+FR+DE	TITLE	0.1895	0.4800	0.4214	0.2562	0.2320	0.4614	70000	8414
39	telecom	telecom_mixed_flickr_wiki_maj_visual_tlep_reranked	Mixed	QE	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1878	0.4686	0.4171	0.2672	0.2327	0.4483	68464	7901
40	uned	UNED-UV9_EN+FR+DE_YES_EN+FR+DE_AUTO_NOFB_TXT_TITLE	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1865	0.4200	0.3636	0.2638	0.2253	0.4012	48883	6634
41	duth	DUTH_ZscoreSum	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1863	0.3729	0.3521	0.2760	0.2302	0.4586	70000	7955
42	duth	DUTH_20_ZscoreSum	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1859	0.3643	0.3414	0.2700	0.2265	0.4771	70000	8615
43	i2rcviu	I2R.baseline	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1847	0.4214	0.3936	0.2642	0.2278	0.4471	68247	6036
44	i2rcviu	I2R.PRF	Textual	FB	EN+FR+DE	EN+FR+DE	TITLE	0.1840	0.4386	0.3993	0.2656	0.2299	0.4388	68920	5895
45	telecom	telecom_mixed_flickr_wiki_visual_merged	Mixed	QE	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1839	0.4757	0.4236	0.2565	0.2289	0.4499	68648	8181
46	telecom	telecom_mixed_flickr_wiki_visual_tlep_reranked	Mixed	QE	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1831	0.4786	0.4186	0.2566	0.2284	0.4489	68648	8156
47	telecom	telecom_mixed_flickr_wiki_visual_bag_reranked	Mixed	QE	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1821	0.4629	0.4171	0.2573	0.2280	0.4477	68648	8144
48	daedalus	DAEDALUS_W_CT	Textual	QE	EN+FR+DE	EN+FR+DE	TITLE	0.1820	0.4471	0.4029	0.2662	0.2314	0.4055	53859	6453
49	duth	DUTH_baseline	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1818	0.4243	0.4079	0.2545	0.2267	0.4554	70000	6595
50	sztaki	bp_acad_txtimg50_20_03	Mixed	QE	EN	EN	TITLEIMG_Q	0.1794	0.4857	0.4329	0.2685	0.2318	0.3865	57518	6412
51	uned	UNED-UV11_EN+FR+DE_YES_EN+FR+DE_AUTO_FB_TXTIMG_TITLE	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLE	0.1792	0.3914	0.3629	0.2514	0.2175	0.3887	49356	6296
52	uned	UNED-UV8_EN+FR+DE_YES_EN+FR+DE_AUTO_NOFB_TXT_TITLE	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1790	0.3914	0.3350	0.2533	0.2150	0.4006	50180	6537
53	sztaki	bp_acad_txtimg50_20_01	Mixed	QE	EN	EN	TITLEIMG_Q	0.1779	0.4729	0.4257	0.2687	0.2296	0.3857	57518	6412
54	sztaki	bp_acad_the_text	Textual	NOFB	EN	EN	TITLE	0.1768	0.4714	0.4229	0.2678	0.2287	0.3845	57518	6412
55	xrce	XRCE_AUTO_SEQ_RERANKING-LGD_ALL_META_PARAG	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1747	0.5029	0.4471	0.2389	0.2242	0.4321	70000	7916
56	i2rcviu	DUAL_LINGUAL	Textual	FB	EN+FR+DE	EN+FR+DE	TITLE	0.1742	0.4271	0.3964	0.2628	0.2263	0.4223	68072	5610
57	sztaki	bp_acad_text	Textual	NOFB	EN	EN	TITLE	0.1737	0.4671	0.4171	0.2652	0.2256	0.3740	46729	6317
58	daedalus	DAEDALUS_W_CTS	Textual	QE	EN+FR+DE	EN+FR+DE	TITLE	0.1737	0.3943	0.3521	0.2478	0.2225	0.4315	62230	6871
59	uned	UNED-UV20_EN+FR+DE_YES_EN+FR+DE_AUTO_FB_TXTIMG_TITLE	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLE	0.1717	0.4071	0.3571	0.2499	0.2133	0.3803	48005	6333
60	duth	DUTH_RFTwoStageZs	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1633	0.3786	0.3493	0.2188	0.2091	0.3963	70000	5569
61	uned	UNED-UV2_EN+FR+DE_YES_EN_AUTO_NOFB_TXT_TITLE	Textual	NOFB	EN+FR+DE	EN	TITLE	0.1627	0.3657	0.3293	0.2340	0.2002	0.3582	40351	5328
62	daedalus	DAEDALUS_NER_W_CT	Textual	QE	EN+FR+DE	EN+FR+DE	TITLE	0.1610	0.4043	0.3736	0.2514	0.2166	0.3801	55979	6038
63	duth	DUTH_TwoStageZsv2	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1595	0.3629	0.3400	0.2157	0.2054	0.3928	70000	5569
64	daedalus	DAEDALUS_NER_W_CTS	Textual	QE	EN+FR+DE	EN+FR+DE	TITLE	0.1593	0.4029	0.3593	0.2342	0.2079	0.4036	65779	6105
65	duth	DUTH_RFTwoStage	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1589	0.3700	0.3393	0.2185	0.2051	0.3925	70000	5573
66	nus	nustextonly	Textual	NOFB	EN	EN	TITLE	0.1581	0.3529	0.3264	0.2386	0.2043	0.3487	52068	5838
67	duth	DUTH_kiacdfMax	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1565	0.3300	0.3021	0.2282	0.1912	0.4115	70000	6612
68	uned	UNED-UV12_EN+FR+DE_YES_EN+FR+DE_AUTO_QE_TXTIMG_TITLE	Mixed	QE	EN+FR+DE	EN+FR+DE	TITLE	0.1525	0.3943	0.3621	0.2236	0.1939	0.3341	44091	4997
69	uned	UNED-UV10_EN+FR+DE_YES_EN+FR+DE_AUTO_NOFB_TXTIMG_TITLE	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1502	0.3971	0.3607	0.2204	0.1920	0.3318	44091	4981
70	uned	UNED-UV14_EN+FR+DE_YES_EN_AUTO_FB_TXTIMG_TITLE	Mixed	FB	EN+FR+DE	EN	TITLE	0.1498	0.3543	0.3250	0.2203	0.1902	0.3387	39402	5165
71	daedalus	DAEDALUS_Bas	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1492	0.3971	0.3529	0.2377	0.2030	0.3556	52204	6088
72	uned	UNED-UV19_EN+FR+DE_YES_EN+FR+DE_AUTO_NOFB_TXTIMG_TITLE	Mixed	FB	EN+FR+DE	EN	TITLE	0.1427	0.4171	0.3671	0.2166	0.1872	0.3219	42758	4918
73	duth	DUTH_TwoStage	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1406	0.3957	0.3436	0.2072	0.1903	0.4086	68846	6302
74	cheshire	BRK_T2BF_EN_EN	Textual	FB	EN	EN	TITLE	0.1386	0.4286	0.3736	0.2319	0.1941	0.3274	44839	5502
75	duth	DUTH_TwoStageZs	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1377	0.3971	0.3429	0.2043	0.1877	0.4067	68846	6261
76	uned	UNED-UV3_EN_YES_EN_AUTO_NOFB_TXT_TITLE	Textual	NOFB	EN	EN	TITLE	0.1370	0.3871	0.3336	0.2146	0.1787	0.3168	38555	4609
77	uned	UNED-UV15_EN+FR+DE_YES_EN_AUTO_QE_TXTIMG_TITLE	Mixed	QE	EN+FR+DE	EN	TITLE	0.1286	0.3829	0.3386	0.1947	0.1687	0.2935	33865	3905
78	uned	UNED-UV17_EN_YES_EN_AUTO_FB_TXTIMG_TITLE	Mixed	FB	EN	EN	TITLE	0.1285	0.3614	0.3379	0.2047	0.1723	0.3049	37717	4485
79	uned	UNED-UV13_EN+FR+DE_YES_EN_AUTO_NOFB_TXTIMG_TITLE	Mixed	NOFB	EN+FR+DE	EN	TITLE	0.1261	0.3857	0.3307	0.1879	0.1650	0.2909	33865	3915
80	daedalus	DAEDALUS_NER_Bas	Textual	QE	EN+FR+DE	EN+FR+DE	TITLE	0.1249	0.3643	0.3236	0.2115	0.1825	0.3255	53657	5628
81	duth	DUTH_baseline_metadata	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1230	0.3700	0.3171	0.1754	0.1573	0.3073	70000	5007
82	dcu	dcuRunOkapiFR	Textual	QE	FR	FR	TITLE	0.1192	0.3243	0.2707	0.1820	0.1600	0.2707	68459	4014
83	uned	UNED-UV16_EN_YES_EN_AUTO_NOFB_TXTIMG_TITLE	Mixed	NOFB	EN	EN	TITLE	0.1089	0.4043	0.3357	0.1728	0.1491	0.2588	32372	3361
84	uned	UNED-UV18_EN_YES_EN_AUTO_QE_TXTIMG_TITLE	Mixed	QE	EN	EN	TITLE	0.1077	0.3886	0.3307	0.1729	0.1492	0.2571	32372	3360
85	duth	DUTH_20_Borda_Normnonlinear	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1028	0.3314	0.2864	0.1692	0.1480	0.3068	70000	5564
86	duth	DUTH_20_Borda_nonlinear	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0978	0.3329	0.2821	0.1643	0.1445	0.3011	70000	5445
87	duth	DUTH_20_Borda_Norm	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0963	0.2886	0.2643	0.1589	0.1381	0.2906	70000	5219
88	uned	UNED-UV6_EN+FR+DE_YES_DE_AUTO_NOFB_TXT_TITLE	Textual	NOFB	DE	DE	TITLE	0.0936	0.2671	0.2314	0.1312	0.1151	0.1885	12453	2400
89	uned	UNED-UV4_EN+FR+DE_YES_FR_AUTO_NOFB_TXT_TITLE	Textual	NOFB	EN+FR+DE	FR	TITLE	0.0920	0.2829	0.2536	0.1492	0.1301	0.2128	27946	2792
90	duth	DUTH_20_Borda	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0917	0.2943	0.2564	0.1527	0.1344	0.2851	70000	5151
91	nus	nusconceptonly	Textual	NOFB	EN	EN	TITLE	0.0897	0.3329	0.2743	0.1533	0.1343	0.2346	64102	3111
92	cheshire	BRK_T2BF_FR_ALL	Textual	FB	FR	FR	TITLE	0.0853	0.2671	0.2250	0.1358	0.1235	0.2384	69790	4110
93	cheshire	BRK_T2BF_DE_ALL	Textual	FB	DE	DE	TITLE	0.0820	0.2357	0.2043	0.1142	0.1072	0.2038	60015	3262
94	nus	nusconceptrelated	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0758	0.2671	0.2321	0.1358	0.1234	0.2498	70000	4074
95	duth	DUTH_Borda	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0686	0.3086	0.2679	0.1247	0.1140	0.2249	70000	3977
96	duth	DUTH_Borda_Norm	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0674	0.3100	0.2607	0.1241	0.1102	0.2120	70000	3728
97	uned	UNED-UV5_FR_YES_FR_AUTO_NOFB_TXT_TITLE	Textual	NOFB	FR	FR	TITLE	0.0661	0.2943	0.2650	0.1156	0.1017	0.1703	24440	2095
98	duth	DUTH_Borda_nonlinear	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0648	0.3243	0.2779	0.1166	0.1086	0.2101	70000	3597
99	cheshire	BRK_T2BF_FR_FR	Textual	FB	FR	FR	TITLE	0.0623	0.3429	0.2707	0.1294	0.1088	0.1800	28456	2498
100	rgu	combine	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0617	0.2271	0.2129	0.1221	0.1029	0.2038	70000	4535
101	rgu	T+F_L	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0617	0.2257	0.2143	0.1228	0.1027	0.2051	43829	4520
102	uned	UNED-UV7_DE_YES_DE_AUTO_NOFB_TXT_TITLE	Textual	NOFB	DE	DE	TITLE	0.0603	0.2586	0.2221	0.0994	0.0851	0.1378	11233	2092
103	duth	DUTH_Borda_Normnonlinear	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0597	0.3229	0.2771	0.1078	0.0990	0.1935	70000	3313
104	nus	nusconceptrelated3	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0573	0.2186	0.2043	0.1116	0.1021	0.2125	70000	3520
105	xrce	XRCE_AUTO_IMG	Visual	NOFB	N/A		IMG_Q	0.0553	0.2957	0.2686	0.1020	0.1027	0.1915	70000	3705
106	duth	DUTH_MinMaxSum	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0516	0.3114	0.2600	0.0929	0.0876	0.1724	70000	2636
107	cheshire	BRK_T2BF_DE_DE	Textual	FB	DE	DE	TITLE	0.0505	0.2657	0.2114	0.1029	0.0851	0.1378	16217	2327
108	rgu	TXF_C	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0486	0.1443	0.1514	0.0992	0.0821	0.1738	42415	4292
109	rgu	TXF_L	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0484	0.1500	0.1486	0.0938	0.0791	0.1759	43829	4182
110	uaic	dfiush	Mixed	QE	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0423	0.1543	0.1529	0.0744	0.0582	0.1119	18678	1943
111	rgu	T+F_C	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0325	0.1143	0.1171	0.0680	0.0583	0.1353	43742	3506
112	uaic	bgtfv	Mixed	QE	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0248	0.1086	0.1121	0.0506	0.0451	0.0709	18314	1810
113	nus	nusconceptrelatedimage7	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0149	0.1900	0.1307	0.0205	0.0198	0.0432	1071	451
114	nus	nusimageconcept10	Mixed	NOFB	EN	EN	TITLE	0.0140	0.0757	0.0721	0.0204	0.0182	0.0301	7117	676
115	nus	nustexttagimage	Mixed	NOFB	EN	EN	IMG_Q	0.0130	0.2300	0.1607	0.0211	0.0194	0.0432	769	334
116	nus	nusconceptrelatedimage3	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0125	0.1657	0.1164	0.0171	0.0165	0.0368	949	368
117	nus	nusconceptrelatedimage	Visual	NOFB	EN	EN	TITLEIMG_Q	0.0120	0.1943	0.1257	0.0177	0.0161	0.0389	690	277
118	nus	nusimageconcept7	Mixed	NOFB	EN	EN	IMG_Q	0.0110	0.0671	0.0643	0.0176	0.0151	0.0253	7008	493
119	nus	nusimageonly	Visual	NOFB	N/A	EN	IMG_Q	0.0100	0.1000	0.0864	0.0299	0.0310	0.0542	70000	1419
120	nus	nusimageconcept	Textual	NOFB	EN	EN	TITLE	0.0081	0.0700	0.0614	0.0141	0.0126	0.0216	4417	408
121	rgu	c_leszek	Visual	NOFB	N/A		IMG_Q	0.0069	0.0614	0.0593	0.0245	0.0243	0.0491	70000	999
122	nus	nusimageconceptimage7	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0050	0.0757	0.0536	0.0057	0.0056	0.0119	588	183
123	nus	nusimageconceptimage3	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0034	0.0743	0.0579	0.0044	0.0043	0.0100	505	121
124	rgu	W+F_C	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0031	0.0086	0.0129	0.0128	0.0122	0.0318	61423	596
125	sztaki	bp_acad_img	Visual	NOFB	N/A		IMG_Q	0.0015	0.0071	0.0079	0.0104	0.0398	0.0361	69930	1142
126	rgu	c_add	Visual	NOFB	N/A		IMG_Q	0.0003	0.0100	0.0050	0.0029	0.0030	0.0050	70000	106
127	cheshire	BRK_FEAT_T3	Visual	NOFB	N/A		IMG_Q	0.0001	0.0071	0.0086	0.0025	0.0025	0.0041	70000	116

cheshire

The corrected runs submitted by cheshire for the wikipedia retrieval task are: submissions_cheshire.tar.gz.

These are the evaluation results for these runs as produced by trec_eval:

Summary statistics for the runs submitted by cheshire sorted by MAP

	Participant	Run	Modality	FB/QE	Annotation language	Topic language	Topic field(s)	MAP	P@10	P@20	R-prec.	Bpref	NDCG	retrieved images	relevant retrieved images
24	cheshire	BRK_T2BF_ENDEFR_ALL	Textual	FB	EN+FR+DE	EN+FR+DE	TITLE	0.2014	0.4600	0.4036	0.2739	0.2380	0.4372	70000	6986
33	cheshire	BRK_T2BF_EN_ALL	Textual	FB	EN	EN	TITLE	0.1941	0.4929	0.4364	0.2713	0.2397	0.4373	69369	6900
74	cheshire	BRK_T2BF_EN_EN	Textual	FB	EN	EN	TITLE	0.1386	0.4286	0.3736	0.2319	0.1941	0.3274	44839	5502
92	cheshire	BRK_T2BF_FR_ALL	Textual	FB	FR	FR	TITLE	0.0853	0.2671	0.2250	0.1358	0.1235	0.2384	69790	4110
93	cheshire	BRK_T2BF_DE_ALL	Textual	FB	DE	DE	TITLE	0.0820	0.2357	0.2043	0.1142	0.1072	0.2038	60015	3262
99	cheshire	BRK_T2BF_FR_FR	Textual	FB	FR	FR	TITLE	0.0623	0.3429	0.2707	0.1294	0.1088	0.1800	28456	2498
107	cheshire	BRK_T2BF_DE_DE	Textual	FB	DE	DE	TITLE	0.0505	0.2657	0.2114	0.1029	0.0851	0.1378	16217	2327
127	cheshire	BRK_FEAT_T3	Visual	NOFB	N/A		IMG_Q	0.0001	0.0071	0.0086	0.0025	0.0025	0.0041	70000	116

daedalus

The corrected runs submitted by daedalus for the wikipedia retrieval task are: submissions_daedalus.tar.gz.

These are the evaluation results for these runs as produced by trec_eval:

Summary statistics for the runs submitted by daedalus sorted by MAP

	Participant	Run	Modality	FB/QE	Annotation language	Topic language	Topic field(s)	MAP	P@10	P@20	R-prec.	Bpref	NDCG	retrieved images	relevant retrieved images
48	daedalus	DAEDALUS_W_CT	Textual	QE	EN+FR+DE	EN+FR+DE	TITLE	0.1820	0.4471	0.4029	0.2662	0.2314	0.4055	53859	6453
58	daedalus	DAEDALUS_W_CTS	Textual	QE	EN+FR+DE	EN+FR+DE	TITLE	0.1737	0.3943	0.3521	0.2478	0.2225	0.4315	62230	6871
62	daedalus	DAEDALUS_NER_W_CT	Textual	QE	EN+FR+DE	EN+FR+DE	TITLE	0.1610	0.4043	0.3736	0.2514	0.2166	0.3801	55979	6038
64	daedalus	DAEDALUS_NER_W_CTS	Textual	QE	EN+FR+DE	EN+FR+DE	TITLE	0.1593	0.4029	0.3593	0.2342	0.2079	0.4036	65779	6105
71	daedalus	DAEDALUS_Bas	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1492	0.3971	0.3529	0.2377	0.2030	0.3556	52204	6088
80	daedalus	DAEDALUS_NER_Bas	Textual	QE	EN+FR+DE	EN+FR+DE	TITLE	0.1249	0.3643	0.3236	0.2115	0.1825	0.3255	53657	5628

dcu

The corrected runs submitted by dcu for the wikipedia retrieval task are: submissions_dcu.tar.gz.

These are the evaluation results for these runs as produced by trec_eval:

Summary statistics for the runs submitted by dcu sorted by MAP

	Participant	Run	Modality	FB/QE	Annotation language	Topic language	Topic field(s)	MAP	P@10	P@20	R-prec.	Bpref	NDCG	retrieved images	relevant retrieved images
20	dcu	dcuRunOkapi	Textual	QE	EN	EN	TITLE	0.2039	0.4271	0.3907	0.2832	0.2491	0.4288	67706	6865
21	dcu	dcuRunOkapiAll	Textual	QE	EN+FR+DE	EN+FR+DE	TITLE	0.2039	0.4271	0.3907	0.2832	0.2491	0.4288	67706	6865
82	dcu	dcuRunOkapiFR	Textual	QE	FR	FR	TITLE	0.1192	0.3243	0.2707	0.1820	0.1600	0.2707	68459	4014

duth

The corrected runs submitted by duth for the wikipedia retrieval task are: submissions_duth.tar.gz.

These are the evaluation results for these runs as produced by trec_eval:

Summary statistics for the runs submitted by duth sorted by MAP

	Participant	Run	Modality	FB/QE	Annotation language	Topic language	Topic field(s)	MAP	P@10	P@20	R-prec.	Bpref	NDCG	retrieved images	relevant retrieved images
26	duth	DUTH_20_MinMaxSum	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1998	0.5200	0.4836	0.2820	0.2507	0.4355	70000	6888
41	duth	DUTH_ZscoreSum	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1863	0.3729	0.3521	0.2760	0.2302	0.4586	70000	7955
42	duth	DUTH_20_ZscoreSum	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1859	0.3643	0.3414	0.2700	0.2265	0.4771	70000	8615
49	duth	DUTH_baseline	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1818	0.4243	0.4079	0.2545	0.2267	0.4554	70000	6595
60	duth	DUTH_RFTwoStageZs	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1633	0.3786	0.3493	0.2188	0.2091	0.3963	70000	5569
63	duth	DUTH_TwoStageZsv2	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1595	0.3629	0.3400	0.2157	0.2054	0.3928	70000	5569
65	duth	DUTH_RFTwoStage	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1589	0.3700	0.3393	0.2185	0.2051	0.3925	70000	5573
67	duth	DUTH_kiacdfMax	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1565	0.3300	0.3021	0.2282	0.1912	0.4115	70000	6612
73	duth	DUTH_TwoStage	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1406	0.3957	0.3436	0.2072	0.1903	0.4086	68846	6302
75	duth	DUTH_TwoStageZs	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1377	0.3971	0.3429	0.2043	0.1877	0.4067	68846	6261
81	duth	DUTH_baseline_metadata	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1230	0.3700	0.3171	0.1754	0.1573	0.3073	70000	5007
85	duth	DUTH_20_Borda_Normnonlinear	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1028	0.3314	0.2864	0.1692	0.1480	0.3068	70000	5564
86	duth	DUTH_20_Borda_nonlinear	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0978	0.3329	0.2821	0.1643	0.1445	0.3011	70000	5445
87	duth	DUTH_20_Borda_Norm	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0963	0.2886	0.2643	0.1589	0.1381	0.2906	70000	5219
90	duth	DUTH_20_Borda	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0917	0.2943	0.2564	0.1527	0.1344	0.2851	70000	5151
95	duth	DUTH_Borda	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0686	0.3086	0.2679	0.1247	0.1140	0.2249	70000	3977
96	duth	DUTH_Borda_Norm	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0674	0.3100	0.2607	0.1241	0.1102	0.2120	70000	3728
98	duth	DUTH_Borda_nonlinear	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0648	0.3243	0.2779	0.1166	0.1086	0.2101	70000	3597
103	duth	DUTH_Borda_Normnonlinear	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0597	0.3229	0.2771	0.1078	0.0990	0.1935	70000	3313
106	duth	DUTH_MinMaxSum	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.0516	0.3114	0.2600	0.0929	0.0876	0.1724	70000	2636

i2rcviu

The corrected runs submitted by i2rcviu for the wikipedia retrieval task are: submissions_i2rcviu.tar.gz.

These are the evaluation results for these runs as produced by trec_eval:

Summary statistics for the runs submitted by i2rcviu sorted by MAP

	Participant	Run	Modality	FB/QE	Annotation language	Topic language	Topic field(s)	MAP	P@10	P@20	R-prec.	Bpref	NDCG	retrieved images	relevant retrieved images
16	i2rcviu	MONOLINGUAL	Textual	NOFB	EN	EN+FR+DE	TITLE	0.2126	0.4486	0.4143	0.2832	0.2585	0.4805	68739	6955
29	i2rcviu	I2R.VISUAL.NDK	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1984	0.4971	0.4321	0.2761	0.2466	0.4546	64830	6084
32	i2rcviu	I2R.Feat.selection	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1945	0.4600	0.4186	0.2684	0.2365	0.4561	68252	6216
43	i2rcviu	I2R.baseline	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1847	0.4214	0.3936	0.2642	0.2278	0.4471	68247	6036
44	i2rcviu	I2R.PRF	Textual	FB	EN+FR+DE	EN+FR+DE	TITLE	0.1840	0.4386	0.3993	0.2656	0.2299	0.4388	68920	5895
56	i2rcviu	DUAL_LINGUAL	Textual	FB	EN+FR+DE	EN+FR+DE	TITLE	0.1742	0.4271	0.3964	0.2628	0.2263	0.4223	68072	5610

nus

The corrected runs submitted by nus for the wikipedia retrieval task are: submissions_nus.tar.gz.

These are the evaluation results for these runs as produced by trec_eval:

Summary statistics for the runs submitted by nus sorted by MAP

	Participant	Run	Modality	FB/QE	Annotation language	Topic language	Topic field(s)	MAP	P@10	P@20	R-prec.	Bpref	NDCG	retrieved images	relevant retrieved images
66	nus	nustextonly	Textual	NOFB	EN	EN	TITLE	0.1581	0.3529	0.3264	0.2386	0.2043	0.3487	52068	5838
91	nus	nusconceptonly	Textual	NOFB	EN	EN	TITLE	0.0897	0.3329	0.2743	0.1533	0.1343	0.2346	64102	3111
94	nus	nusconceptrelated	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0758	0.2671	0.2321	0.1358	0.1234	0.2498	70000	4074
104	nus	nusconceptrelated3	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0573	0.2186	0.2043	0.1116	0.1021	0.2125	70000	3520
113	nus	nusconceptrelatedimage7	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0149	0.1900	0.1307	0.0205	0.0198	0.0432	1071	451
114	nus	nusimageconcept10	Mixed	NOFB	EN	EN	TITLE	0.0140	0.0757	0.0721	0.0204	0.0182	0.0301	7117	676
115	nus	nustexttagimage	Mixed	NOFB	EN	EN	IMG_Q	0.0130	0.2300	0.1607	0.0211	0.0194	0.0432	769	334
116	nus	nusconceptrelatedimage3	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0125	0.1657	0.1164	0.0171	0.0165	0.0368	949	368
117	nus	nusconceptrelatedimage	Visual	NOFB	EN	EN	TITLEIMG_Q	0.0120	0.1943	0.1257	0.0177	0.0161	0.0389	690	277
118	nus	nusimageconcept7	Mixed	NOFB	EN	EN	IMG_Q	0.0110	0.0671	0.0643	0.0176	0.0151	0.0253	7008	493
119	nus	nusimageonly	Visual	NOFB	N/A	EN	IMG_Q	0.0100	0.1000	0.0864	0.0299	0.0310	0.0542	70000	1419
120	nus	nusimageconcept	Textual	NOFB	EN	EN	TITLE	0.0081	0.0700	0.0614	0.0141	0.0126	0.0216	4417	408
122	nus	nusimageconceptimage7	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0050	0.0757	0.0536	0.0057	0.0056	0.0119	588	183
123	nus	nusimageconceptimage3	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0034	0.0743	0.0579	0.0044	0.0043	0.0100	505	121

rgu

The corrected runs submitted by rgu for the wikipedia retrieval task are: submissions_rgu.tar.gz.

These are the evaluation results for these runs as produced by trec_eval:

Summary statistics for the runs submitted by rgu sorted by MAP

	Participant	Run	Modality	FB/QE	Annotation language	Topic language	Topic field(s)	MAP	P@10	P@20	R-prec.	Bpref	NDCG	retrieved images	relevant retrieved images
100	rgu	combine	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0617	0.2271	0.2129	0.1221	0.1029	0.2038	70000	4535
101	rgu	T+F_L	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0617	0.2257	0.2143	0.1228	0.1027	0.2051	43829	4520
108	rgu	TXF_C	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0486	0.1443	0.1514	0.0992	0.0821	0.1738	42415	4292
109	rgu	TXF_L	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0484	0.1500	0.1486	0.0938	0.0791	0.1759	43829	4182
111	rgu	T+F_C	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0325	0.1143	0.1171	0.0680	0.0583	0.1353	43742	3506
121	rgu	c_leszek	Visual	NOFB	N/A		IMG_Q	0.0069	0.0614	0.0593	0.0245	0.0243	0.0491	70000	999
124	rgu	W+F_C	Mixed	NOFB	EN	EN	TITLEIMG_Q	0.0031	0.0086	0.0129	0.0128	0.0122	0.0318	61423	596
126	rgu	c_add	Visual	NOFB	N/A		IMG_Q	0.0003	0.0100	0.0050	0.0029	0.0030	0.0050	70000	106

sztaki

The corrected runs submitted by sztaki for the wikipedia retrieval task are: submissions_sztaki.tar.gz.

These are the evaluation results for these runs as produced by trec_eval:

Summary statistics for the runs submitted by sztaki sorted by MAP

	Participant	Run	Modality	FB/QE	Annotation language	Topic language	Topic field(s)	MAP	P@10	P@20	R-prec.	Bpref	NDCG	retrieved images	relevant retrieved images
50	sztaki	bp_acad_txtimg50_20_03	Mixed	QE	EN	EN	TITLEIMG_Q	0.1794	0.4857	0.4329	0.2685	0.2318	0.3865	57518	6412
53	sztaki	bp_acad_txtimg50_20_01	Mixed	QE	EN	EN	TITLEIMG_Q	0.1779	0.4729	0.4257	0.2687	0.2296	0.3857	57518	6412
54	sztaki	bp_acad_the_text	Textual	NOFB	EN	EN	TITLE	0.1768	0.4714	0.4229	0.2678	0.2287	0.3845	57518	6412
57	sztaki	bp_acad_text	Textual	NOFB	EN	EN	TITLE	0.1737	0.4671	0.4171	0.2652	0.2256	0.3740	46729	6317
125	sztaki	bp_acad_img	Visual	NOFB	N/A		IMG_Q	0.0015	0.0071	0.0079	0.0104	0.0398	0.0361	69930	1142

telecom

The corrected runs submitted by telecom for the wikipedia retrieval task are: submissions_telecom.tar.gz.

These are the evaluation results for these runs as produced by trec_eval:

Summary statistics for the runs submitted by telecom sorted by MAP

	Participant	Run	Modality	FB/QE	Annotation language	Topic language	Topic field(s)	MAP	P@10	P@20	R-prec.	Bpref	NDCG	retrieved images	relevant retrieved images
14	telecom	telecom_en_flickr_wiki_maj	Textual	QE	EN+FR+DE	EN	TITLE	0.2227	0.4829	0.4407	0.2953	0.2700	0.4809	70000	7854
18	telecom	telecom_en_flickr_wiki	Textual	QE	EN+FR+DE	EN	TITLE	0.2052	0.4786	0.4236	0.2677	0.2422	0.4670	70000	7789
22	telecom	telecom_en_flickr_wiki_maj_visual_bag_reranked	Mixed	QE	EN+FR+DE	EN	TITLEIMG_Q	0.2026	0.4914	0.4336	0.2720	0.2504	0.4630	70000	7262
23	telecom	telecom_en_flickr_wiki_maj_visual_merged	Mixed	QE	EN+FR+DE	EN	TITLEIMG_Q	0.2023	0.4871	0.4293	0.2726	0.2487	0.4623	70000	7258
25	telecom	telecom_en_flickr_wiki_maj_visual_tlep_reranked	Mixed	QE	EN+FR+DE	EN	TITLEIMG_Q	0.2000	0.4914	0.4286	0.2639	0.2440	0.4610	70000	7245
27	telecom	telecom_mixed_flickr_wiki_maj	Textual	QE	EN+FR+DE	EN+FR+DE	TITLE	0.1994	0.4886	0.4250	0.2748	0.2442	0.4691	70000	8328
28	telecom	telecom_en_flickr_wiki_visual_merged	Mixed	QE	EN+FR+DE	EN	TITLEIMG_Q	0.1985	0.4586	0.4150	0.2626	0.2367	0.4592	70000	7440
30	telecom	telecom_en_flickr_wiki_visual_bag_reranked	Mixed	QE	EN+FR+DE	EN	TITLEIMG_Q	0.1974	0.4729	0.4179	0.2621	0.2382	0.4576	70000	7460
31	telecom	telecom_en_flickr_wiki_visual_tlep_reranked	Mixed	QE	EN+FR+DE	EN	TITLEIMG_Q	0.1960	0.4600	0.4164	0.2573	0.2354	0.4587	70000	7445
35	telecom	telecom_mixed_flickr_wiki_maj_visual_bag_reranked	Mixed	QE	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1917	0.4700	0.4186	0.2721	0.2369	0.4518	68464	7943
36	telecom	telecom_mixed_flickr_wiki_maj_visual_merged	Mixed	QE	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1906	0.4800	0.4229	0.2697	0.2352	0.4515	68464	7935
38	telecom	telecom_mixed_flickr_wiki	Textual	QE	EN+FR+DE	EN+FR+DE	TITLE	0.1895	0.4800	0.4214	0.2562	0.2320	0.4614	70000	8414
39	telecom	telecom_mixed_flickr_wiki_maj_visual_tlep_reranked	Mixed	QE	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1878	0.4686	0.4171	0.2672	0.2327	0.4483	68464	7901
45	telecom	telecom_mixed_flickr_wiki_visual_merged	Mixed	QE	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1839	0.4757	0.4236	0.2565	0.2289	0.4499	68648	8181
46	telecom	telecom_mixed_flickr_wiki_visual_tlep_reranked	Mixed	QE	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1831	0.4786	0.4186	0.2566	0.2284	0.4489	68648	8156
47	telecom	telecom_mixed_flickr_wiki_visual_bag_reranked	Mixed	QE	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1821	0.4629	0.4171	0.2573	0.2280	0.4477	68648	8144

uaic

The corrected runs submitted by uaic for the wikipedia retrieval task are: submissions_uaic.tar.gz.

These are the evaluation results for these runs as produced by trec_eval:

Summary statistics for the runs submitted by uaic sorted by MAP

Participant

Run

Modality

FB/QE

Annotation language

Topic language

Topic field(s)

MAP

P@10

P@20

R-prec.

Bpref

NDCG

retrieved images

relevant retrieved images

110

uaic

dfiush

Mixed

EN+FR+DE

TITLEIMG_Q

0.0423

0.1543

0.1529

0.0744

0.0582

0.1119

18678

1943

112

uaic

bgtfv

Mixed

EN+FR+DE

TITLEIMG_Q

0.0248

0.1086

0.1121

0.0506

0.0451

0.0709

18314

1810

uned

The corrected runs submitted by uned for the wikipedia retrieval task are: submissions_uned.tar.gz.

These are the evaluation results for these runs as produced by trec_eval:

Summary statistics for the runs submitted by uned sorted by MAP

	Participant	Run	Modality	FB/QE	Annotation language	Topic language	Topic field(s)	MAP	P@10	P@20	R-prec.	Bpref	NDCG	retrieved images	relevant retrieved images
34	uned	UNED-UV1_EN+FR+DE_YES_EN+FR+DE_AUTO_NOFB_TXT_TITLE	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1927	0.3914	0.3564	0.2663	0.2282	0.4092	50180	6556
40	uned	UNED-UV9_EN+FR+DE_YES_EN+FR+DE_AUTO_NOFB_TXT_TITLE	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1865	0.4200	0.3636	0.2638	0.2253	0.4012	48883	6634
51	uned	UNED-UV11_EN+FR+DE_YES_EN+FR+DE_AUTO_FB_TXTIMG_TITLE	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLE	0.1792	0.3914	0.3629	0.2514	0.2175	0.3887	49356	6296
52	uned	UNED-UV8_EN+FR+DE_YES_EN+FR+DE_AUTO_NOFB_TXT_TITLE	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1790	0.3914	0.3350	0.2533	0.2150	0.4006	50180	6537
59	uned	UNED-UV20_EN+FR+DE_YES_EN+FR+DE_AUTO_FB_TXTIMG_TITLE	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLE	0.1717	0.4071	0.3571	0.2499	0.2133	0.3803	48005	6333
61	uned	UNED-UV2_EN+FR+DE_YES_EN_AUTO_NOFB_TXT_TITLE	Textual	NOFB	EN+FR+DE	EN	TITLE	0.1627	0.3657	0.3293	0.2340	0.2002	0.3582	40351	5328
68	uned	UNED-UV12_EN+FR+DE_YES_EN+FR+DE_AUTO_QE_TXTIMG_TITLE	Mixed	QE	EN+FR+DE	EN+FR+DE	TITLE	0.1525	0.3943	0.3621	0.2236	0.1939	0.3341	44091	4997
69	uned	UNED-UV10_EN+FR+DE_YES_EN+FR+DE_AUTO_NOFB_TXTIMG_TITLE	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1502	0.3971	0.3607	0.2204	0.1920	0.3318	44091	4981
70	uned	UNED-UV14_EN+FR+DE_YES_EN_AUTO_FB_TXTIMG_TITLE	Mixed	FB	EN+FR+DE	EN	TITLE	0.1498	0.3543	0.3250	0.2203	0.1902	0.3387	39402	5165
72	uned	UNED-UV19_EN+FR+DE_YES_EN+FR+DE_AUTO_NOFB_TXTIMG_TITLE	Mixed	FB	EN+FR+DE	EN	TITLE	0.1427	0.4171	0.3671	0.2166	0.1872	0.3219	42758	4918
76	uned	UNED-UV3_EN_YES_EN_AUTO_NOFB_TXT_TITLE	Textual	NOFB	EN	EN	TITLE	0.1370	0.3871	0.3336	0.2146	0.1787	0.3168	38555	4609
77	uned	UNED-UV15_EN+FR+DE_YES_EN_AUTO_QE_TXTIMG_TITLE	Mixed	QE	EN+FR+DE	EN	TITLE	0.1286	0.3829	0.3386	0.1947	0.1687	0.2935	33865	3905
78	uned	UNED-UV17_EN_YES_EN_AUTO_FB_TXTIMG_TITLE	Mixed	FB	EN	EN	TITLE	0.1285	0.3614	0.3379	0.2047	0.1723	0.3049	37717	4485
79	uned	UNED-UV13_EN+FR+DE_YES_EN_AUTO_NOFB_TXTIMG_TITLE	Mixed	NOFB	EN+FR+DE	EN	TITLE	0.1261	0.3857	0.3307	0.1879	0.1650	0.2909	33865	3915
83	uned	UNED-UV16_EN_YES_EN_AUTO_NOFB_TXTIMG_TITLE	Mixed	NOFB	EN	EN	TITLE	0.1089	0.4043	0.3357	0.1728	0.1491	0.2588	32372	3361
84	uned	UNED-UV18_EN_YES_EN_AUTO_QE_TXTIMG_TITLE	Mixed	QE	EN	EN	TITLE	0.1077	0.3886	0.3307	0.1729	0.1492	0.2571	32372	3360
88	uned	UNED-UV6_EN+FR+DE_YES_DE_AUTO_NOFB_TXT_TITLE	Textual	NOFB	DE	DE	TITLE	0.0936	0.2671	0.2314	0.1312	0.1151	0.1885	12453	2400
89	uned	UNED-UV4_EN+FR+DE_YES_FR_AUTO_NOFB_TXT_TITLE	Textual	NOFB	EN+FR+DE	FR	TITLE	0.0920	0.2829	0.2536	0.1492	0.1301	0.2128	27946	2792
97	uned	UNED-UV5_FR_YES_FR_AUTO_NOFB_TXT_TITLE	Textual	NOFB	FR	FR	TITLE	0.0661	0.2943	0.2650	0.1156	0.1017	0.1703	24440	2095
102	uned	UNED-UV7_DE_YES_DE_AUTO_NOFB_TXT_TITLE	Textual	NOFB	DE	DE	TITLE	0.0603	0.2586	0.2221	0.0994	0.0851	0.1378	11233	2092

unt

The corrected runs submitted by unt for the wikipedia retrieval task are: submissions_unt.tar.gz.

These are the evaluation results for these runs as produced by trec_eval:

Summary statistics for the runs submitted by unt sorted by MAP

	Participant	Run	Modality	FB/QE	Annotation language	Topic language	Topic field(s)	MAP	P@10	P@20	R-prec.	Bpref	NDCG	retrieved images	relevant retrieved images
13	unt	untaTxEn	Textual	NOFB	EN	EN	TITLE	0.2251	0.4314	0.3871	0.3025	0.2617	0.4774	55647	7840
15	unt	untaTxFr	Textual	NOFB	FR	FR	TITLE	0.2200	0.4229	0.3986	0.2855	0.2567	0.4634	58476	7641
17	unt*	untMan1TxEn*	Textual	FB	EN	EN	TITLE	0.2064	0.5886	0.5021	0.2603	0.2411	0.3639	11779	4584

xrce

The corrected runs submitted by xrce for the wikipedia retrieval task are: submissions_xrce.tar.gz.

These are the evaluation results for these runs as produced by trec_eval:

Summary statistics for the runs submitted by xrce sorted by MAP

	Participant	Run	Modality	FB/QE	Annotation language	Topic language	Topic field(s)	MAP	P@10	P@20	R-prec.	Bpref	NDCG	retrieved images	relevant retrieved images
1	xrce	XRCE_AUTO_FUSION_SEQ_RERANKING-TEXTLGD_ALL_METANOPRF_PARAGPRF20	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2765	0.5814	0.5193	0.3465	0.3137	0.5537	70000	8802
2	xrce	XRCE_AUTO_CONFAGmin_FUSION_SEQ_RERANKING-TEXTLGD_ALL_METANOPRF_PARAGPRF20	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2681	0.5686	0.5257	0.3413	0.3059	0.5484	70000	8709
3	xrce	XRCE_AUTO_FUSION_SEQ_RERANKING-TEXTLGD_ALL_METANOPRF_PARAGPRF20-Rer7_Text3	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2627	0.6114	0.5407	0.3289	0.2967	0.5359	70000	8749
4	xrce	XRCE_AUTO_FUSION_SEQ_RERANKING_PW2-TEXT_PW2LGD_ALL_METANOPRF_PARAGPRF20	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2591	0.5829	0.5143	0.3316	0.2991	0.5376	70000	8717
5	xrce	XRCE_AUTO_CONFAGmin_FUSION_SEQ_RERANKING-TEXTLGD_ALL_META_PARAG	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2575	0.5957	0.5164	0.3257	0.2945	0.5326	70000	8340
6	xrce	XRCE_AUTO_CONF0.7_FUSION_SEQ_RERANKING-TEXTLGD_ALL_METANOPRF_PARAGPRF20	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2532	0.5429	0.4986	0.3300	0.2871	0.5359	70000	8829
7	xrce	XRCE_AUTO_FUSION_SEQ_RERANKING-TEXTLGD_ALL_META_PARAG-Rer7_Text3	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2527	0.5971	0.5336	0.3200	0.2873	0.5186	70000	8372
8	xrce	XRCE_AUTO_FUSION_SEQ_RERANKING_PW2-TEXT_PW2LGD_ALL_META_PARAG	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2495	0.5729	0.5157	0.3189	0.2905	0.5201	70000	8339
9	xrce	XRCE_AUTO_FUSION_SEQ_RERANKING-TEXTLGD_ALL_METANOPRF_PARAGPRF20-Rer3_Text7	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2493	0.5171	0.4743	0.3233	0.2874	0.5353	70000	8736
10	xrce	XRCE_AUTO_CONF0.7_FUSION_SEQ_RERANKING-TEXTLGD_ALL_META_PARAG	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2424	0.5543	0.4907	0.3183	0.2806	0.5210	70000	8462
11	xrce	XRCE_AUTO_FUSION_SEQ_RERANKING-TEXTLGD_ALL_META_PARAG-Rer3_Text7	Mixed	FB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.2415	0.5414	0.4664	0.3165	0.2800	0.5243	70000	8383
12	xrce	ALL_DFRPMETAPRF5_DFRPARAGPRF20	Textual	FB	EN+FR+DE	EN+FR+DE	TITLE	0.2361	0.4871	0.4393	0.3077	0.2694	0.5217	70000	8658
19	xrce	LGD_ALL_METANOPRF_PARAGPRF20	Textual	FB	EN+FR+DE	EN+FR+DE	TITLE	0.2045	0.4686	0.4200	0.2782	0.2413	0.4903	69848	7985
37	xrce	LGD_ALL_META_PARAG	Textual	NOFB	EN+FR+DE	EN+FR+DE	TITLE	0.1903	0.4629	0.4000	0.2746	0.2368	0.4710	66862	7640
55	xrce	XRCE_AUTO_SEQ_RERANKING-LGD_ALL_META_PARAG	Mixed	NOFB	EN+FR+DE	EN+FR+DE	TITLEIMG_Q	0.1747	0.5029	0.4471	0.2389	0.2242	0.4321	70000	7916
105	xrce	XRCE_AUTO_IMG	Visual	NOFB	N/A		IMG_Q	0.0553	0.2957	0.2686	0.1020	0.1027	0.1915	70000	3705

Navigation

You are here

Results of the wikipedia retrieval task at ImageCLEF 2010

Primary tabs

Summary statistics for the runs submitted by cheshire sorted by MAP

Summary statistics for the runs submitted by daedalus sorted by MAP

Summary statistics for the runs submitted by dcu sorted by MAP

Summary statistics for the runs submitted by duth sorted by MAP

Summary statistics for the runs submitted by i2rcviu sorted by MAP

Summary statistics for the runs submitted by nus sorted by MAP

Summary statistics for the runs submitted by rgu sorted by MAP

Summary statistics for the runs submitted by sztaki sorted by MAP

Summary statistics for the runs submitted by telecom sorted by MAP

Summary statistics for the runs submitted by uaic sorted by MAP

Summary statistics for the runs submitted by uned sorted by MAP

Summary statistics for the runs submitted by unt sorted by MAP

Summary statistics for the runs submitted by xrce sorted by MAP