You are here

Home › ImageCLEF 2027 › ImageCLEFmedical

ImageCLEF MEDVQA-GI

Motivation

The MEDVQA-GI challenge, now in its fifth iteration, continues to advance research in Visual Question Answering (VQA) for gastrointestinal (GI) endoscopy with a strong emphasis on clinical relevance, explainability, and safety. Building on insights and outcomes from previous editions, this year's challenge shifts focus from data generation toward trustworthy multimodal reasoning in realistic clinical settings.

The 2027 challenge emphasizes models that not only answer clinically relevant questions from GI endoscopy images, but also justify their answers in a manner aligned with medical reasoning while adhering to clinical safety principles. In addition, the challenge explicitly addresses emerging concerns related to overconfidence, hallucinations, and misleading explanations in medical AI systems. By integrating behavioral safety evaluation and retrieval-augmented reasoning, the challenge aims to promote the development of reliable, interpretable, and clinically robust VQA systems for endoscopy.

Task Description

We define two subtasks for this year's challenge.

Subtask 1: TBD

Subtask 2: TBD

Data

Information will be added soon.

Evaluation methodology

Information will be added soon.

Participant registration

Please refer to the general
ImageCLEF registration instructions.

Please also email steven@simula.no to register your interest.

Note: Thie task does not use the Ai4Media benchmarking platform for evaluation. Creating an account on the platform for this task is not required. Completing the registration form is still required, similar to the other tasks. You can also find the form here.

Preliminary Schedule

  • TBD: Registration opens for all ImageCLEF tasks
  • TBD: Development dataset released
  • TBD: Test dataset released
  • TBD: Registration closes for all ImageCLEF tasks
  • TBD: Deadline for submitting participant runs
  • TBD: Release of the processed results by the task organizers (depends on task)
  • TBD: Submission of participant papers [CEUR-WS]
  • TBD: Notification of acceptance
  • TBD: CLEF 2027, TBD

Submission Instructions

Please refer to our
GitHub page
for detailed submission instructions.

Results

CEUR Working Notes

Citations

Contact

Organizers:

ImageCLEF - Cross-language image retrieval evaluations