You are here

ImageCLEF 2021


ImageCLEF 2021 is an evaluation campaign that is being organized as part of the CLEF initiative labs. The campaign offers several research tasks that welcome participation from teams around the world. The results of the campaign appear in the working notes proceedings, published by CEUR Workshop Proceedings ( Selected contributions among the participants, will be invited for publication in the following year in the Springer Lecture Notes in Computer Science (LNCS) together with the annual lab overviews.

For the 2021 edition, ImageCLEF organizes 4 main tasks with a global objective of promoting the evaluation of technologies for annotation, indexing and retrieval of visual data with the aim of providing information access to large collections of images in various usage scenarios and application domains: medical, nature, Internet and social media.

Target communities involve (but are not limited to): information retrieval (e.g., text, vision, audio, multimedia, social media, sensor data), machine learning, deep learning, data mining, natural language processing, image and video processing; with special emphasis on the challenges of multi-modality, multi-linguality, and interactive search.

#imageclef, and Facebook @ImageClef.

ImageCLEF schedule

Each of the tasks sets its own schedule, so please check the corresponding task webpage for specific dates. A (tentative) global schedule can be found below:

  • 16.11.2020: registration opens for all ImageCLEF tasks
  • 18.01.2021: development data release starts (depends on the task)
  • 15.03.2021: test data release starts (depends on the task)
  • 07.05.2021: deadline for submitting the participants runs (depends on the task)
  • 14.05.2021: release of the processed results by the task organizers (depends on the task)
  • 28.05.2021: deadline for submission of working notes papers by the participants
  • 11.06.2021: notification of acceptance of the working notes papers
  • 02.07.2021: camera ready working notes papers
  • 21-24.09.2021: CLEF 2021, Bucharest, Romania

The CLEF Conference

CLEF 2021 CLEF Initiative

ImageCLEF lab and all its tasks are part of the Conference and Labs of the Evaluation Forum: CLEF 2021. CLEF 2021 consists of an independent peer-reviewed workshops on a broad range of challenges in the fields of multilingual and multimodal information access evaluation, and a set of benchmarking activities carried in various labs designed to test different aspects of mono and cross-language information retrieval systems. More details about the conference can be found here. Also there is more information about the Clef Initiative.

Programme of ImageCLEF at the CLEF 2021 Conference

(coming closer to the conference)

Participant registration

  1. Each participant has to register on ( with username, email and password. A representative team name should be used
    as username.
  2. In order to be compliant with the CLEF requirements, participants also have to fill in the following additional fields on their profile:
    • First name
    • Last name
    • Affiliation
    • Address
    • City
    • Country
  3. Participants now have to access the 'Resources tab' on the challenge page, where they find a download link to the task's End User Agreement (EUA). At the same place they will also be able to upload a filled in and signed EUA.

    Participants have to fill in and submit one EUA for each ImageCLEF task they want to participate in. An ImageCLEF participant is considered as registered for a task as soon as he/she has uploaded a valid EUA that was approved by an ImageCLEF organizer (examples of how the EUAs for the medical task should be filled in can be found here: Caption 2019 EUA example, Tuberculosis 2019 EUA example and VQA 2019 EUA example).

    Registrations are handled on a per-task basis. This means if a task has multiple challenges (subtasks), a participant can automatically access the data of all challenges in that task because there is one common dataset per task. We do not separate datasets on a per-challenge basis.

PS: You do not have to remember all of the steps mentioned above as you will be given instructions on what to do as soon as you try to access a challenge's 'Resouces' tab.

The Tasks

ImageCLEF 2021 proposes 4 main tasks:

  • ImageCLEFcoral: The increasing use of structure-from-motion photogrammetry for modelling large-scale environments from action cameras has driven the next generation of visualization techniques. The task addresses the problem of automatically segmenting and labeling a collection of images that can be used in combination to create 3D models for the monitoring of coral reefs.
  • ImageCLEFmedical: Medical images can be used in a variety of scenarios and this task will combine the most popular medical tasks of ImageCLEF and continue the last year idea of combining various applications, namely: automatic image captioning and scene understanding, medical visual question answering and decision support on tuberculosis. This allows to explore synergies between the tasks.
  • ImageCLEFdrawnUI: Enabling people to create websites by drawing them on a piece of paper can make the webpage building process more accessible. The task addresses the problem of automatically recognizing hand drawn objects representing website UIs, that will be further translated into automatic website code.
  • ImageCLEFaware: The images available on social networks can be exploited in ways users are unaware of when initially shared, including situations that have serious consequences for the users’ real lives. The task addresses the development of algorithms which raise the users’ awareness about real-life impact of online image sharing.

Overview Paper

[] Bogdan Ionescu, Henning Müller, Renaud Péteri, Asma Ben Abacha, Mourad Sarrouti, Dina Demner-Fushman, Sadid A. Hasan, Serge Kozlovski, Vitali Liauchuk, Yashin Dicente, Vassili Kovalev, Obioma Pelka, Alba García Seco de Herrera, Janadhip Jacutprakart, Christoph M. Friedrich, Raul Berari, Andrei Tauteanu, Dimitri Fichou, Paul Brie, Mihai Dogariu, Liviu Daniel Ştefan, Mihai Gabriel Constantin, Jon Chamberlain, Antonio Campello, Adrian Clark, Thomas A. Oliver, Hassan Moustahfid, Adrian Popescu, Jérôme Deshayes-Chossart, Overview of the ImageCLEF 2021: Multimedia Retrieval in Medical, Nature, Internet and Social Media Applications, in Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the 12th International Conference of the CLEF Association (CLEF 2021), Bucharest, Romania, Springer Lecture Notes in Computer Science LNCS, September 21-24, 2021.

author = {Bogdan Ionescu and Henning M\"uller and Renaud P\’{e}teri and Asma {Ben Abacha} and Mourad Sarrouti and Dina Demner-Fushman and Sadid A. Hasan and Serge Kozlovski and Vitali Liauchuk and Yashin Dicente and Vassili Kovalev and Obioma Pelka and Alba Garc\’{\i}a Seco de Herrera and Janadhip Jacutprakart and Christoph M. Friedrich and Raul Berari and Andrei Tauteanu and Dimitri Fichou and Paul Brie and Mihai Dogariu and Liviu Daniel \c{S}tefan and Mihai Gabriel Constantin and Jon Chamberlain and Antonio Campello and Adrian Clark and Thomas A. Oliver and Hassan Moustahfid and Adrian Popescu and J\’{e}r\^{o}me Deshayes-Chossart},
title = {{Overview of the ImageCLEF 2021}: Multimedia Retrieval in Medical, Nature, Internet and Social Media Applications},
booktitle = {Experimental IR Meets Multilinguality, Multimodality, and Interaction},
series = {Proceedings of the 12th International Conference of the CLEF Association (CLEF 2021)},
year = 2021,
volume = {},
publisher = {{LNCS} Lecture Notes in Computer Science, Springer},
pages = {},
month = {September 21-24},
address = {Bucharest, Romania}

The Organising Committee

Overall coordination

  • Bogdan Ionescu <bogdan.ionescu(at)>, University Politehnica of Bucharest, Romania
  • Henning Müller <henning.mueller(at)>, University of Applied Sciences Western Switzerland, Sierre, Switzerland
  • Renaud Péteri <renaud.peteri(at)>, University of La Rochelle, France

Technical support

  • Ivan Eggel <ivan.eggel(at)>, University of Applied Sciences Western Switzerland, Sierre, Switzerland
  • Mihai Dogariu <dogariu_mihai8(at)>, University Politehnica of Bucharest, Romania