Advances in Lifelog Data Organisation and Retrieval at the NTCIR-14 Lifelog-3 Task

Abstract

Lifelogging refers to the process of digitally capturing a continuous and detailed trace of life activities in a passive manner. In order to assist the research community to make progress in the organisation and retrieval of data from lifelog archives, a lifelog task was organised at NTCIR since edition 12. Lifelog-3 was the third running of the lifelog task (at NTCIR-14) and the Lifelog-3 task explored three different lifelog data access related challenges, the search challenge, the annotation challenge and the insights challenge. In this paper we review the dataset created for this activity, activities of participating teams who took part in these challenges and we highlight learnings for the community from the NTCIR-Lifelog challenges.

Introduction to the Third Annual Lifelog Search Challenge (LSC'20)

“…LSC'20 uses a new multimodal dataset containing four months of lifelog data gathered by one active lifelogger. The dataset has been constructed by merging parts of the three NTCIR Lifelog datasets from 2016 [6], 2017 [7], and 2019 [8], with images from 2015, 2016 and 2018, respectively. It consists of an image dataset of 191,439 wearable camera images at 1024 x 768 resolution (38.5GB).…”

“…The Lifelog Search Challenge (LSC) comparative benchmarking workshop was founded in 2018 to answer a call for more robust and effective technologies to assist individuals in managing and locating content from these vast archives. The LSC workshop joins a number of related activities, such as the NTCIR-Lifelog tasks [8] (2016-2019) and the ImageCLEF Lifelog task [3] (2017-2019). Yet, it is different from these other challenges in that it focuses on evaluating approaches to real-time interactive retrieval from mediarich personal lifelogs [9], with a particular emphasis on evaluating the usability of the retrieval systems for novice users.…”

Activities of Daily Living Monitoring via a Wearable Camera: Toward Real-World Applications

“…It describes the life of only one graduate student using 19 different activities, therefore it does not allow to test generalization capabilities on other users. Several other datasets have been presented in the context of image retrieval challenges [13], [56]- [58]. Although they capture images from several weeks, the number of originally annotated classes and images is low and mostly describes transportation and ambulation activities.…”

“…This dataset was further used for another image retrieval task in [57]. Finally, a dataset consisting of two subjects and two distinct activities was introduced for the NTCIR-14 challenge [58]. The characteristics of the above described datasets and ours are summarized in Table 1.…”

Overview of the ImageCLEF 2020: Multimedia Retrieval in Medical, Lifelogging, Nature, and Internet Applications

“…This underlines the importance of evaluation campaigns for disseminating best scientific practices. We introduce here the four tasks that were run in the 2020 edition 22 , namely: ImageCLEFmedical, ImageCLEFlifelog, ImageCLEFcoral, and the new ImageCLEFdrawnUI.…”