Introduction to the Fourth Annual Lifelog Search Challenge, LSC'21

Gurrin, Cathal; Jónsson, Björn Þór; Schöffmann, Klaus; Dang-Nguyen, Duc-Tien; Lokoč, Jakub; Tran, Minh–Triet; Hürst, Wolfgang; Rossetto, Luca; Healy, Graham

doi:10.1145/3460426.3470945

Cited by 47 publications

(21 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The First Workshop on Lifelogging Tools and Applications (LTA) in 2016 [10], aimed to discuss approaches to lifelog data capture, analytics and applications and to identify opportunities and challenges for researchers in this new and challenging area. Ever since, workshops and tasks have been pursued to advance research onto some of its key challenges: The Second Workshop on Lifelogging Tools and Applications (LTA 2017) [9], NTCIR Lifelog Tasks [13,14], Image-CLEFlifelog [3][4][5]28], and the Lifelogging Search Challenges (LSC) [15][16][17]. All these events contributed to the development of efficient interactive lifelog retrieval systems.…”

Section: Related Researchmentioning

confidence: 99%

See 1 more Smart Citation

MEMORIA: A Memory Enhancement and MOment RetrIeval Application for LSC 2022

Ribiero

Trifan

Neves

2022

Proceedings of the 5th Annual on Lifelog Search Challenge

View full text Add to dashboard Cite

Research on retrieving data and analyzing lifelogs revealed to be a very complex task, and the interdisciplinary challenges to be tackled have boosted increasing attention from the scientific community in information retrieval and lifelogging. The Lifelog Search Challenge is an international competition for lifelog retrieval in which researchers propose their approaches and compete to solve lifelog retrieval challenges and evaluate the effectiveness of their systems. In this paper, we present the MEMORIA computational tool to participate for the first time in the Lifelog Search Challenge 2022. The information retrieval is based on the search of keywords and time periods and several computer vision methods are used to process visual lifelogs, from pre-processing algorithms to feature extraction methods, in order to enrich the annotation of the lifelogs. Preliminary experimental results of the user interaction with our retrieval module are presented, confirming the effectiveness of the proposed approach and showing the most relevant functionalities of the system. CCS CONCEPTS• Information systems → Search interfaces; • Human-centered computing → Interactive systems and tools.

show abstract

Section: Related Researchmentioning

confidence: 99%

“…In the last years, shared lifelogging retrieval tasks were set up on different continents [9,14,16,28] in order to bring the attention of a wider audience to lifelogging and to promote research into some of its key challenges. Although in a development stage, this research area has the potential to transform our society.…”

Section: Introductionmentioning

confidence: 99%

MEMORIA: A Memory Enhancement and MOment RetrIeval Application for LSC 2022

Ribiero

Trifan

Neves

2022

Proceedings of the 5th Annual on Lifelog Search Challenge

View full text Add to dashboard Cite

show abstract

“…While the LSC'22 dataset [8] is not a video dataset on its own, it is similar to one, in terms of size and temporal meaning. It is greater than the previous edition (roughly 725,000 images compared to 183,299 [7]) and poses a significant challenge to system developers [8].…”

Section: Introductionmentioning

confidence: 98%

Flexible Interactive Retrieval SysTem 3.0 for Visual Lifelog Exploration at LSC 2022

Hoang-Xuan

Trang-Trung

Nguyen

et al. 2022

Proceedings of the 5th Annual on Lifelog Search Challenge

Self Cite

View full text Add to dashboard Cite

Building a retrieval system with lifelogging data is more complicated than with ordinary data due to the redundancies, blurriness, massive amount of data, various sources of information accompanying lifelogging data, and especially the ad-hoc nature of queries. The Lifelog Search Challenge (LSC) is a benchmarking challenge that encourages researchers and developers to push the boundaries in lifelog retrieval. For LSC'22, we develop FIRST 3.0, a novel and flexible system that leverages expressive cross-domain embeddings to enhance the searching process. Our system aims to adaptively capture the semantics of an image at different levels of detail. We also propose to augment our system with an external search engine to help our system with initial visual examples for unfamiliar concepts. Finally, we organize image data in hierarchical clusters based on their visual similarity and location to assist users in data exploration. Experiments show that our system is both fast and effective in handling various retrieval scenarios. CCS CONCEPTS• Information systems → Search interfaces; Multimedia databases; • Human-centered computing → Interactive systems and tools.

show abstract

“…The scientific community has reacted to the high recall challenge with evaluation campaigns attracting research teams focusing on video retrieval. TRECVID [38], Video Browser Showdown (VBS) [37] and Lifelog Search Challenge [13] define retrieval tasks where both high recall and precision are essential to achieve a good score. Every year, the results of these campaigns confirm that achieving high recall in arbitrary tasks over general videos remains a hard problem.…”

Section: Introductionmentioning

confidence: 99%

“…Fig 13. Similar but differently judged AVS submissions, judged as incorrect (red border, on the left) vs. judged as correct (green border, on the right)…”

mentioning

confidence: 99%

Interactive video retrieval evaluation at a distance: comparing sixteen interactive video search systems in a remote setting at the 10th Video Browser Showdown

Heller

Gsteiger

Bailer

et al. 2022

Int J Multimed Info Retr

Self Cite

View full text Add to dashboard Cite

The Video Browser Showdown addresses difficult video search challenges through an annual interactive evaluation campaign attracting research teams focusing on interactive video retrieval. The campaign aims to provide insights into the performance of participating interactive video retrieval systems, tested by selected search tasks on large video collections. For the first time in its ten year history, the Video Browser Showdown 2021 was organized in a fully remote setting and hosted a record number of sixteen scoring systems. In this paper, we describe the competition setting, tasks and results and give an overview of state-of-the-art methods used by the competing systems. By looking at query result logs provided by ten systems, we analyze differences in retrieval model performances and browsing times before a correct submission. Through advances in data gathering methodology and tools, we provide a comprehensive analysis of ad-hoc video search tasks, discuss results, task design and methodological challenges. We highlight that almost all top performing systems utilize some sort of joint embedding for text-image retrieval and enable specification of temporal context in queries for known-item search. Whereas a combination of these techniques drive the currently top performing systems, we identify several future challenges for interactive video search engines and the Video Browser Showdown competition itself.

show abstract

Introduction to the Fourth Annual Lifelog Search Challenge, LSC'21

Cited by 47 publications

References 17 publications

MEMORIA: A Memory Enhancement and MOment RetrIeval Application for LSC 2022

MEMORIA: A Memory Enhancement and MOment RetrIeval Application for LSC 2022

Flexible Interactive Retrieval SysTem 3.0 for Visual Lifelog Exploration at LSC 2022

Interactive video retrieval evaluation at a distance: comparing sixteen interactive video search systems in a remote setting at the 10th Video Browser Showdown

Contact Info

Product

Resources

About