You are here

ImageCLEF 2023

Sponsors

Motivation

Following the ImageCLEF 2003-2022 evaluation campaigns, ImageCLEF 2023 (https://www.imageclef.org/, https://www.facebook.com/imageclef, https://twitter.com/imageclef), the Multimodal Challenge organized as part of the CLEF Initiative Labs, continues the tradition and is set to promote the evaluation of technologies for #annotation, #indexing, #classification and #retrieval of multimodal data, with the objective of providing information access to large collections in various usage scenarios and domains.

The campaign offers several research tasks that welcome participation from teams around the world. ImageCLEF 2023 will focus again on a diversity of applications, namely medical, social media and Internet, and content recommendation, allowing to exploit synergies between different tasks. Like 2022, ImageCLEF 2023 will also lay the foundations of new innovative tasks, while some of the older tasks are discontinued.

The results of the campaign appear in the working notes proceedings, published by CEUR Workshop Proceedings (ceur-ws.org, e.g., 2022 http://ceur-ws.org/Vol-3180/). Selected contributions among the participants, will be invited for publication in the following year in the Springer Lecture Notes in Computer Science (LNCS) together with the annual lab overviews (e.g., 2022 https://link.springer.com/book/10.1007/978-3-031-13643-6).

Target communities involve (but are not limited to): information retrieval (e.g., text, vision, audio, multimedia, social media, sensor data), machine learning, deep learning, data mining, natural language processing, image and video processing; with special emphasis on the challenges of multi-modality, multi-linguality, and interactive search.

Stay tuned with us for the latest information and updates by joining us on the ImageCLEF social media accounts: Twitter #imageclef, and Facebook @ImageClef.

ImageCLEF2023 schedule

Each of the tasks sets its own schedule, so please check the corresponding task webpage for specific dates. A (tentative) global schedule can be found below:

  • 14.11.2022: registration opens for all ImageCLEF tasks
  • 17.01.2023: development data release starts (depends on the task)
  • 14.03.2023: test data release starts (depends on the task)
  • 10.05.2023: deadline for submitting the participants runs (depends on the task)
  • 17.05.2023: release of the processed results by the task organizers (depends on the task)
  • 05.06.2023: deadline for submission of working notes papers by the participants
  • 23.06.2023: notification of acceptance of the working notes papers
  • 07.07.2022: camera ready working notes papers
  • 18-21.09.2023: CLEF 2023, Thessaloniki, Greece

The CLEF Conference

ImageCLEF lab and all its tasks are part of the Conference and Labs of the Evaluation Forum: CLEF 2023. CLEF 2023 consists of an independent peer-reviewed workshops on a broad range of challenges in the fields of multilingual and multimodal information access evaluation, and a set of benchmarking activities carried in various labs designed to test different aspects of mono and cross-language information retrieval systems. More details about the conference can be found here. Also there is more information about the CLEF Initiative.

Programme of ImageCLEF at the CLEF 2023 Conference

More information will follow soon.

Participant registration

More information will follow soon.

The Tasks

ImageCLEF 2023 proposes 4 main tasks:

  • (5th edition) ImageCLEFmedical: Medical information can be used in a variety of scenarios and this task will combine the most popular medical task of ImageCLEF with two new tasks and continue the idea of 2019 by mixing various applications, namely:
  • (3rd edition) ImageCLEFaware: The images available on social networks can be exploited in ways users are unaware of when initially shared, including situations that have serious consequences for the users’ real lives. The task addresses the development of algorithms which raise the users’ awareness about real-life impact of online image sharing.
  • (2nd edition) ImageCLEFfusion: Despite the current advances in knowledge discovery, single learners do not produce satisfactory performances when dealing with complex data, such as class imbalance, high-dimensionality, concept drift, noisy data, multimodal data, subjective annotations, etc. This task aims to fill this gap by exploiting novel and innovative late fusion techniques for producing a powerful learner based on the expertise of a pool of classifiers.
  • (new) ImageCLEFrecommending: This task focuses on content-recommendation for cultural heritage content in 15 broad themes that have been curated by experts in the Europeana Platform (https://www.europeana.eu/en/themes). Despite current advances, there is limited understanding how well these perform and how relevant they are for the final end users. This task aims to fill this gap by developing ground truth data of recommendations in the above themes and by allowing benchmarking different recommendation systems and methods.

Overview Paper

More information will follow soon.

The Organising Committee

Overall coordination

  • Bogdan Ionescu <bogdan.ionescu(at)upb.ro>, Politehnica University of Bucharest, Romania
  • Henning Müller <henning.mueller(at)hevs.ch>, University of Applied Sciences Western Switzerland, Sierre, Switzerland
  • Ana-Maria Drăgulinescu <ana.dragulinescu(at)upb.ro>, Politehnica University of Bucharest, Romania

Technical support

  • Ivan Eggel <ivan.eggel(at)hevs.ch>, University of Applied Sciences Western Switzerland, Sierre, Switzerland