You are here

ImageCLEF 2020

#Page under construction#

Motivation

ImageCLEF 2020 is an evaluation campaign that is being organized as part of the CLEF initiative labs. The campaign offers several research tasks that welcome participation from teams around the world. The results of the campaign appear in the working notes proceedings, published by CEUR Workshop Proceedings (CEUR-WS.org). Selected contributions among the participants, will be invited for publication in the following year in the Springer Lecture Notes in Computer Science (LNCS) together with the annual lab overviews.

For the 2020 edition, ImageCLEF organizes 4 main tasks with a global objective of promoting the evaluation of technologies for annotation, indexing and retrieval of visual data with the aim of providing information access to large collections of images in various usage scenarios and application domains: lifelogging, nature, medicine, and Internet.

Target communities involve (but are not limited to): information retrieval (e.g., text, vision, audio, multimedia, social media, sensor data), machine learning, deep learning, data mining, natural language processing, image and video processing; with special emphasis on the challenges of multi-modality, multi-linguality, and interactive search.

Download the ImageCLEF 2020 call-for-participation flyer here.

Stay tuned with us for the latest information and updates by joining us on the ImageCLEF social media accounts: Twitter #imageclef, and Facebook @ImageClef.

ImageCLEF schedule

Each of the tasks sets its own schedule, so please check the corresponding task webpage for specific dates. A (tentative) global schedule can be found below:

  • 20.12.2019: registration opens for all ImageCLEF tasks (until 27.04.2020)
  • 20.12.2019: development data release starts (depends on the task)
  • 16.03.201927.03.2020: test data release starts (depends on the task)
  • 11.05.2020: deadline for submitting the participants runs (depends on the task)
  • 18.05.2020: release of the processed results by the task organizers (depends on the task)
  • 25.05.2020: deadline for submission of working notes papers by the participants
  • 15.06.2020: notification of acceptance of the working notes papers
  • 29.06.2020: camera ready working notes papers
  • 22-25.09.2020: CLEF 2020, Thessalonik, Greece

The CLEF Conference

CLEF 2020 CLEF Initiative

ImageCLEF lab and all its tasks are part of the Conference and Labs of the Evaluation Forum: CLEF 2020. CLEF 2020 consists of an independent peer-reviewed workshops on a broad range of challenges in the fields of multilingual and multimodal information access evaluation, and a set of benchmarking activities carried in various labs designed to test different aspects of mono and cross-language information retrieval systems. More details about the conference can be found here. Also there is more information about the Clef Initiative.

Programme of ImageCLEF at the CLEF 2020 Conference

#will be displayed after the benchmark#

Participant registration

  1. Each participant has to register on (https://www.aicrowd.com) with username, email and password. A representative team name should be used
    as username.
  2. In order to be compliant with the CLEF requirements, participants also have to fill in the following additional fields on their profile:
    • First name
    • Last name
    • Affiliation
    • Address
    • City
    • Country
  3. Participants now have to access the 'Resources tab' on the challenge page, where they find a download link to the task's End User Agreement (EUA). At the same place they will also be able to upload a filled in and signed EUA.

    Participants have to fill in and submit one EUA for each ImageCLEF task they want to participate in. An ImageCLEF participant is considered as registered for a task as soon as he/she has uploaded a valid EUA that was approved by an ImageCLEF organizer (examples of how the EUAs for the medical task should be filled in can be found here: Caption 2019 EUA example, Tuberculosis 2019 EUA example and VQA 2019 EUA example).

    Registrations are handled on a per-task basis. This means if a task has multiple challenges (subtasks), a participant can automatically access the data of all challenges in that task because there is one common dataset per task. We do not separate datasets on a per-challenge basis.

PS: You do not have to remember all of the steps mentioned above as you will be given instructions on what to do as soon as you try to access a challenge's 'Resouces' tab.

The Tasks

ImageCLEF 2020 proposes 4 main tasks:

  • ImageCLEFlifelog: An increasingly wide range of personal devices that allow capturing pictures, videos, and audio clips for every moment of our lives, are becoming available. In this context, the task addresses the problems of lifelogging data retrieval and summarization.
  • ImageCLEFcoral: The increasing use of structure-from-motion photogrammetry for modelling large-scale environments from action cameras has driven the next generation of visualization techniques. The task addresses the problem of automatically segmenting and labeling a collection of images that can be used in combination to create 3D models for the monitoring of coral reefs.
  • ImageCLEFmedical: Medical images can be used in a variety of scenarios and this task will combine the most popular medical tasks of ImageCLEF and continue the last year idea of combining various applications, namely: automatic image captioning and scene understanding, medical visual question answering and decision support on tuberculosis. This allows to explore synergies between the tasks.
  • ImageCLEFdrawnUI: Enabling people to create websites by drawing them on a piece of paper can make the webpage building process more accessible. The task addresses the problem of automatically recognizing hand drawn objects representing website UIs, that will be further translated into automatic website code.

The Organising Committee

Overall coordination

  • Bogdan Ionescu <bionescu(at)alpha.imag.pub.ro>, University Politehnica of Bucharest, Romania
  • Henning Müller <henning.mueller(at)hevs.ch>, University of Applied Sciences Western Switzerland, Sierre, Switzerland
  • Renaud Péteri <renaud.peteri(at)univ-lr.fr>, University of La Rochelle, France

Technical support

  • Ivan Eggel <ivan.eggel(at)hevs.ch>, University of Applied Sciences Western Switzerland, Sierre, Switzerland
  • Mihai Dogariu <dogariu_mihai8(at)yahoo.com>, University Politehnica of Bucharest, Romania
AttachmentSize
PDF icon flyer380.36 KB