Exploring the Sensed and Unexpected: Not Looking in Gaze Interaction

Abstract

Gaze interaction paradigms rely on the user needing to look at objects in the interface to select them or trigger actions. "Not looking" is an atypical and unexpected interaction to perform, but the eye-tracker can sense it. We illustrate the use of "not looking" as an interaction dynamic with examples of gaze-enabled games. We created a framework containing a spectrum of five discrete categories for this unexpected use of gaze sensing. For each category, we analyse games that use gaze interaction and make the user look away from the game action up to the extent they close their eyes. The framework is described based on whether specific game events mean the player might not; cannot; should not; must not; or does not look. Finally, we discuss the outcomes of using unexpected gaze interactions and the potential of the proposed framework as a new approach to guide the design of sensing-based interfaces. CCS CONCEPTS • Human-centered computing → Human computer interaction (HCI); Interaction design theory, concepts and paradigms;

KryptonEyed: Playing with Gaze Without Looking

“…KryptoneEyed is deliberately challenging and aims to use gaze to leverage the capabilities of our visual system. We require players to do something that is unexpected [11], closing the eyes and not look at the game graphics. This relies on spatial perception and the estimation of target locations in the game, but also memory by somewhat remembering the targeted area while recharging with the eyes closed.…”

“…"Not looking" is an unexpected gaze interaction in games [11]. Some examples have used this concept to make the users look away, e.g.…”

Gaze+Hold: Eyes-only Direct Manipulation with Continuous Gaze Modulated by Closure of One Eye

“…However, closing one eye also presents an unusual form of input and constraint to vision and gaze. In this respect, Gaze+Hold relates to work exploring gaze under constraints, for example avoiding direct gaze and relying on peripheral vision [Ramirez Gomez and Gellersen 2019b], and forms of gaze interaction beyond conventional looking [Ramirez Gomez and Gellersen 2019a].…”