ImageCLEF 2019: Multimedia Retrieval in Lifelogging, Medical, Nature, and Security Applications

Abstract

This paper presents an overview of the foreseen ImageCLEF 2019 lab that will be organized as part of the Conference and Labs of the Evaluation Forum-CLEF Labs 2019. ImageCLEF is an ongoing evaluation initiative (started in 2003) that promotes the evaluation of technologies for annotation, indexing and retrieval of visual data with the aim of providing information access to large collections of images in various usage scenarios and domains. In 2019, the 17th edition of Image-CLEF will run four main tasks: (i) a Lifelog task (videos, images and other sources) about daily activities understanding, retrieval and summarization, (ii) a Medical task that groups three previous tasks (caption analysis, tuberculosis prediction, and medical visual question answering) with newer data, (iii) a new Coral task about segmenting and labeling collections of coral images for 3D modeling, and (iv) a new Security task addressing the problems of automatically identifying forged content

Rethinking the Test Collection Methodology for Personal Self-tracking Data

“…Within the past two decades, we have seen the emergence of various workshops and conferences that support community driven benchmarking activities. TREC [38], TRECVid [3], ImageCLEF [23], MediaEval [26], etc., all have played a part in supporting the community to generate test collections and coordinate such international comparative benchmarking efforts. In most cases, these activities have focused on the release of test collections that support the retrieval of online content, such as web pages, online or professional videos, blogs, and other crawlable content.…”