Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation Studies

Abstract

How to determine highly effective and intuitive gesture sets for interactive systems tailored to end users’ preferences? A substantial body of knowledge is available on this topic, among which gesture elicitation studies stand out distinctively. In these studies, end users are invited to propose gestures for specific referents, which are the functions to control for an interactive system. The vast majority of gesture elicitation studies conclude with a consensus gesture set identified following a process of consensus or agreement analysis. However, the information about specific gesture sets determined for specific applications is scattered across a wide landscape of disconnected scientific publications, which poses challenges to researchers and practitioners to effectively harness this body of knowledge. To address this challenge, we conducted a systematic literature review and examined a corpus of N = 267 studies encompassing a total of 187,265 gestures elicited from 6,659 participants for 4,106 referents. To understand similarities in users’ gesture preferences within this extensive dataset, we analyzed a sample of 2,304 gestures extracted from the studies identified in our literature review. Our approach consisted of (i) identifying the context of use represented by end users, devices, platforms, and gesture sensing technology, (ii) categorizing the referents, (iii) classifying the gestures elicited for those referents, and (iv) cataloging the gestures based on their representation and implementation modalities. Drawing from the findings of this review, we propose guidelines for conducting future end-user gesture elicitation studies.

Assessing the Acceptance of a Mid-Air Gesture Syntax for Smart Space Interaction: An Empirical Study

“…A smart kitchen was the target scenario for He et al [18], in which opinions from twenty-five participants were collected, with the most desired gestures being selected for the six tasks within the kitchen. A recent study [19] regarding the gesture elicitation literature across 267 works provided a review of the categories of referents (aka actions) and a classification of gestures for the referents.…”

Exploring Methods to Optimize Gesture Elicitation Studies: A Systematic Literature Review

“…Which areas require new or more GES? Subsequently, in 2024, Villarreal-Narvaez et al [17] expanded the review scope and examined the corpus of 267 studies up to 2021 to provide descriptive, comparative and generative analysis about many aspects of GES research, such as: distribution, involved body parts, referents, gesture datasets, indicators, terminologies. Tsandilas et al [18] investigated studies up to 2018 (the number of studies is unspecified), primarily focusing on consensus calculation methods, identifying some issues with existing methods, and suggesting improvements.…”