Revision of Fusion Task from Fri, 10/16/2009 - 11:20

Short description

Goal of the fusion task is to explore strategies for fusing data of visual and textual retrieval systems for an optimal multi-modal retrieval performance. Training data is currently not foreseen.

Contact person

• Jayashre Kaplathy-Cramer, OHSU, Portland, OR, USA, kalpathy@ohsu.edu
• Henning Müller, University of Applied Sciences Western Switzerland, Sierre, henning.mueller@sim.hcuge.ch

Important dates

30.11.2009 Release of data
15.1.2010 Paper submission of main conference
15.1.2009 Submission of results without training data
31.1.2009 Release of ground truth data
(31.3.2009 Submission of results with ground truth data)
30.04.2009 Deadline for overview papers for contests
23.8.-26.8.2010 ICPR Conference

Data sets

Interested participants will received the best purely visual and the best purely textual runs of the 2009 ImageCLEF medical retrieval task and then need to combine the runs in a way to optimize the performance.

Format of the supplied runs and of the results to submit is the trec_eval format.

Performance measures

All performance measures of trec_eva will be made available.

Lead measure will be mean average precision (MAP) but early precision (P@10, P@30) will also be used for rankings.

How to register for the task

We plan to set up a registration interface by the end of October so interested participants can register automatically for this task.