Impact of Video Summary Viewing on Episodic Memory Recall

Abstract

Reviewing lifelogging data has been proposed as a useful tool to support human memory. However, the sheer volume of data (particularly images) that can be captured by modern lifelogging systems makes the selection and presentation of material for review a challenging task. We present the results of a five-week user study involving 16 participants and over 69,000 images that explores both individual requirements for video summaries and the differences in cognitive load, user experience, memory experience, and recall experience between review using video summarisations and non-summary review techniques. Our results can be used to inform the design of future lifelogging data summarisation systems for memory augmentation.

Can Privacy-Aware Lifelogs Alter Our Memories?

“…Inspired by the methodology of Le et al [11], two researchers labeled each answer to the memory questionnaire's questions as: 1) correct when the answer is consistent with the expected one, 2) semi-correct when parts of the answer are correct (e.g., remembering the outfit of a participant instead of his name) and 3) wrong when the answer is incorrect. We also computed a custom metric, which we refer to as the Recall Correctness Score (RCS).…”

“…Session 2: Evaluating the recall Session 2 took place four to five days after session 1 to ensure a realistic decay of information in the memory [11], lasting for approximately 90 minutes. We re-invited the participants to individually review the lifelogs from session 1.…”

“…Lifelogging can support reminiscence, reflection, and searching past moments [3]. Images promote more detail-rich recall compared to other types of data [9] as they contain rich contextual information [11]. Thus, pictorial lifelogs were extensively researched as a means to augment human memory (e.g., [1,6,15]).…”

Impact of reviewing lifelogging photos on recalling episodic memories

“…: GPS logger mobile app), a dedicated laptop acting as a processing unit and a software for analyzing, selecting and generating a review (summary video). The extraction process of the key pictures is based on the requirements elicited in [8]. The video duration is approximately 2-3 minutes of key pictures.…”

“…Pictures have been a popular medium starting from pharaonic drawings on the walls of temples until cinematic visions of a brain-embedded chip that auto-records the life as a video 1 . Pictures are strong memory cues because they hold condensed and rich details about the context of a situation [8]. They support reminiscence, reflection, search and recall of missing details.…”