Look & touch

Abstract

While eye tracking has a high potential for fast selection tasks, it is often regarded as error-prone and unnatural, especially for gaze-only interaction. To improve on that, we propose gaze-supported interaction as a more natural and effective way combining a user's gaze with touch input from a handheld device. In particular, we contribute a set of novel and practical gaze-supported selection techniques for distant displays. Designed according to the principle gaze suggests, touch confirms they include an enhanced gaze-directed cursor, local zoom lenses and more elaborated techniques utilizing manual fine positioning of the cursor via touch. In a comprehensive user study with 24 participants, we investigated the potential of these techniques for different target sizes and distances. All novel techniques outperformed a simple gaze-directed cursor and showed individual advantages. In particular those techniques using touch for fine cursor adjustments (MAGIC touch) and for cycling through a list of possible close-to-gaze targets (MAGIC tab) demonstrated a high overall performance and usability.

Eye&Head

“…Where gaze shifts involve head movement, it is the eyes that reach a target first while the head follows more slowly [4]. However, eye movement is jittery and a variety of techniques employ gaze for coarse-grained positioning in combination with mouse, pen or touch for refinement [40,51,53,60]. While conventional pointing uses a cursor metaphor, it is less clear how best to provide feedback with gaze as eye movement is primarily engaged in information seeking rather than target identification [17].…”

Interaction for Immersive Analytics

“…Additional modalities, e. g., touch, are used to circumvent these limitations. We call such interfaces gaze-supported [139]. Stellmach et al [140] presented a system for the gaze-supported exploration of large image databases.…”

Near‐Eye Display and Tracking Technologies for Virtual and Augmented Reality

“…Under normal conditions, the eye is used to gain information about the environment, but not to trigger commands. However, different studies have shown the gain in task performance if gaze is combined with other modalities, such as touch or head gestures [SD12,MHP12]. Recently, gaze-based interaction has been employed for Locked-In Syndrome (LIS) patients combining eye movement and electroencephalogram (EEG) signals confirming or cancelling gaze-based actions [HLZ * 16].…”