Virtual Reality Lifelog Explorer

2018

MultiMedia Modeling

Self Cite

Efficient retrieval of lifelog information is an ongoing area of research due to the multifaceted nature, and ever increasing size of lifelog datasets. Previous studies have examined lifelog exploration on conventional hardware platforms, but in this paper we describe a novel approach to lifelog retrieval using virtual reality. The focus of this research is to identify what aspects of lifelog retrieval can be effectively translated from a conventional to a virtual environment and if it provides any benefit to the user. The most widely available lifelog datasets for research are primarily image-based and focus on continuous capture from a first-person perspective. These large image corpora are often enhanced by image processing techniques and various other metadata. Despite the rapidly maturing nature of virtual reality as a platform, there has been very little investigation into user interaction within the context of lifelogging. The experiment outlined in this work seeks to evaluate four different virtual reality user interaction approaches to lifelog retrieval. The prototype system used in this experiment also competed at the Lifelog Search Challenge at ACM ICMR 2018 where it ranked first place.

Section: Resultsmentioning

confidence: 99%

User Interaction for Visual Lifelog Retrieval in a Virtual Environment

Duane

2018

MultiMedia Modeling

Self Cite

“…Lifelog data attracts new research and ideas on how to visualise and explore data in an interactive way to enhance user experience [7]. A virtual reality retrieval system [9] was developed and performed best in the first LSC challenge. In this work, the authors used virtual reality as a way to visualise lifelog data and perform search tasks based on a temporal filter and concepts selection.…”

Section: Oral Paper Sessionmentioning

confidence: 99%

Voxento: A Prototype Voice-controlled Interactive Search Engine for Lifelogs

Alateeq

Roantree

Proceedings of the Third Annual Workshop on Lifelog Search Challenge

2020

Self Cite

In this paper, we describe an interactive voice-based retrieval system for lifelogs which has been developed to participate in the third Lifelog Search Challenge LSC'20, at ACM ICMR'20. Based on a standard text-based retrieval methodology, the novelty of Voxento is in the interactive voice facility that allows a user to interact with a personal lifelog using simple voice commands. Voxento was developed as an initial prototype of a pervasive computing system that can be deployed for wearable technologies such as Google Glass. The version of Voxento described in this paper has been optimised for use with a desktop computer in order to be competitive at the LSC'20 challenge. CCS CONCEPTS • Information systems → Search interfaces; Multimedia DBs; • Human-centered computing → Sound-based input/output.

“…The primary goal was to determine a baseline design for a virtual reality application which incorporated conventions found in state-of-the-art lifelog retrieval applications and evaluate its effectiveness in comparison to a conventional alternative which contained the same features and targeted the same dataset. The research described in this paper is part of a larger body of work [6] [7] aimed at motivating virtual reality as a viable candidate for the development of lifelog interaction systems.…”

Section: Motivationmentioning

confidence: 99%

“…In this section we will provide an overview of both prototype systems in the context of their two main interactive elements; the user interface and the data visualisation. The design and approaches outlined in this section were the result of a series of iterative user studies [6] [7] which are outside the scope of this paper to be fully described in this overview.…”

Section: System Overviewmentioning

confidence: 99%

Baseline Analysis of a Conventional and Virtual Reality Lifelog Retrieval System

Duane

2019

MultiMedia Modeling

Self Cite

Continuous media capture via a wearable devices is currently one of the most popular methods to establish a comprehensive record of the entirety of an individual's life experience, referred to in the research community as a lifelog. These vast multimodal corpora include visual and other sensor data and are enriched by content analysis, to generate as extensive a record of an individual's life experience. However, interfacing with such datasets remains an active area of research, and despite the advent of new technology and a plethora of competing mediums for processing digital information, there has been little focus on newly emerging platforms such as virtual reality. In this work, we suggest that the increase in immersion and spatial dimensions provided by virtual reality could provide significant benefits to users when compared to more conventional access methodologies. Hence, we motivate virtual reality as a viable method of exploring multimedia archives (specifically lifelogs) by performing a baseline comparative analysis using a novel application prototype built for the HTC Vive and a conventional prototype built for a standard personal computer.