You are here

ImageCLEF 2014

Primary tabs


ImageCLEF 2014 is part of the CLEF 2014 to be held in the city of Sheffield in the United Kingdom. It will organize the four main tasks to benchmark the challenging task of image annotation for a wide range of source images and annotation objective, such as general multi-domain images for object or concept detection, as well as domain-specific tasks such as visual-depth images for robot vision and volumetric medical images for automated structured reporting. The tasks address different aspects of the annotation problem and are aimed at supporting and promoting the cutting-edge research addressing the key challenges in the field, such as multi-modal image annotation, domain adaptation and ontology driven image annotation. The lab is envisioned to serve as a benchmark for the aforementioned research fields.


Each of the tasks sets its own schedule, so please check the corresponding task webpage for specific dates. A (tentative) global schedule can be found below:
  • 01.11.2013: registration opens for all ImageCLEF tasks
  • 15.11.2013: development data release starts (depends on the task)
  • 15.03.2013: test data release starts (depends on the task)
  • 01.05.2014: deadline for submission of runs by the participants (depends on the task)
  • 01.06.2014: release of processed results by the task organizers (depends on the task)
  • 07.06.2014: deadline for submission of working notes papers by the participants
  • 15.-18.09.2014: CLEF 2014, Sheffield, UK


Registration for ImageCLEF 2014 is open. To do so please register by completing the end user agreement. Then scan and send the completed form by email to the following two addresses: Barbara Caputo <>, Alba Garcia Seco de Herrera <>. You also need to register in the following system in order to access the evaluation data and collect the runs
  • For people already registered in the past, you can transfer your registration details to CLEF 2014 here.
  • If you have not registered in the past or you do not want to transfer your details, you can register for 2014 here.

Keeping in touch

The best way to keep in touch with ImageCLEF this year, is through following ImageCLEF on twitter and facebook. Through Twitter and Facebook we will provide updates and reminders throughout the year, the twitter name is @imageclef and the facebook page

The CLEF Conference

CLEF 2014 CLEF Initiative
ImageCLEF lab and all its tasks are part of the Cross Language Evaluation Forum: CLEF 2014. CLEF 2014 consists of an independent peer-reviewed conference on a broad range of issues in the fields of multilingual and multimodal information access evaluation, and a set of benchmarking activities carried in various Tracks designed to test different aspects of mono and cross-language Information retrieval systems. More details about the conference can be found here. Also there is more information about the Clef Initiative.

The Tasks

There are 4 main tasks
  • Robot Vision Addressing the problem of semantic place classification using visual and depth information including object recognition.
  • Scalable Concept Image Annotation Uses only automatically obtained data for multi-concept image annotation.
  • Liver CT Annotation A pilot study towards automated structured reporting, the task is computer aided automatic annotation of liver CT volumes by filling in a pre-prepared form
  • Domain Adaptation The aim is to build recognition systems for the target classes by exploiting existing available resources like the ImageNet, Caltetch256, AwA databases and so on,

The Organising Committee

Overall coordination

  • Henning Müller, University of Applied Sciences Western Switzerland in Sierre, Switzerland, henning.mueller(replace-by-an-arrobe)

Robot Vision

  • Jesus Martinez Gomez, University of Castilla-La Mancha, Albacete, Spain, jesus.martinez(replace-by-an-at)
  • Ismael Garcia Varea, University of Castilla-La Mancha, Albacete, Spain, Ismael.Garcia(replace-by-an-at)
  • Miguel Cazorla, University of Alicante, Alicante, Spain, miguel(replace-by-an-at)
  • Vicente Morell, Research Institute, University of Alicante, Alicante, Spain, vmorell(replace-by-an-at)

Scalable Concept Image Annotation

  • Mauricio Villegas, Universidad Politécnica de Valencia, Spain, mauvilsa(replace-by-an-at)
  • Roberto Paredes, Universidad Politécnica de Valencia, Spain, rparedes(replace-by-an-at)

Liver CT Annotation

  • Burak Acar, PhD, Bogazici University, EE Dept., Istanbul, Turkey, acarbu(replace-by-an-at)
  • Suzan Uskudarli, PhD, Bogazici University, CmpE Dept., Istanbul, Turkey, suzan.uskudarli(replace-by-an-at)
  • Neda Marvasty,Bogazici University, EE Dept., Istanbul, Turkey, neda.barzegarmarvasti(replace-by-an-at) (Contact Person)

Domain Adaptation

  • Barbara Caputo, University of Rome La Sapienza, caputo(replace-by-an-at)
  • Novi Patricia, Idiap Research Institute, novi.patricia(replace-by-an-at)

Contact and Queries

For any queries or comments about the overall ImageClef track please contact Barbara Caputo