EyeSeeThrough: Unifying Tool Selection and Application in Virtual Environments

Mardanbegi, Diako; Mayer, Benedikt; Pfeuffer, Ken; Jalaliniya, Shahram; Gellersen, Hans; Perzl, Alexander

doi:10.1109/vr.2019.8797988

Cited by 25 publications

(20 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In extension, head turning has been proposed for scalar input to controls fixated by gaze [36] and 3D target disambiguation [28]. In Eye-SeeThrough, head movement controls a toolglass that can be moved over gaze-fixated targets [29]. Other work has supplemented eye pointing with subsequent refinement of the selection by head movement [18,19,22,49].…”

Section: Combination Of Eye and Head Movementmentioning

confidence: 99%

Eye&Head

Sidenmark

Gellersen

2019

Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

Self Cite

View full text Add to dashboard Cite

Eye gaze involves the coordination of eye and head movement to acquire gaze targets, but existing approaches to gaze pointing are based on eye-tracking in abstraction from head motion. We propose to leverage the synergetic movement of eye and head, and identify design principles for Eye&Head gaze interaction. We introduce three novel techniques that build on the distinction of head-supported versus eyes-only gaze, to enable dynamic coupling of gaze and pointer, hover interaction, visual exploration around pre-selections, and iterative and fast confirmation of targets. We demonstrate Eye&Head interaction on applications in virtual reality, and evaluate our techniques against baselines in pointing and confirmation studies. Our results show that Eye&Head techniques enable novel gaze behaviours that provide users with more control and flexibility in fast gaze pointing and selection.

show abstract

Section: Combination Of Eye and Head Movementmentioning

confidence: 99%

Eye&Head

Sidenmark

Gellersen

2019

Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

Self Cite

View full text Add to dashboard Cite

show abstract

“…There have been also research on the use of eye gaze in social VR settings (Rivu et al, 2020, e.g. ), determining behavior (e.g., Pfeuffer et al, 2019) and for selection of tools through a see-though interface (Mardanbegi et al, 2019).…”

Section: Eye Tracking Techniques In Virtual Realitymentioning

confidence: 99%

Efficient and Accurate Object 3D Selection With Eye Tracking-Based Progressive Refinement

Wang

Kopper

2021

Front. Virtual Real.

View full text Add to dashboard Cite

Selection by progressive refinement allows the accurate acquisition of targets with small visual sizes while keeping the required precision of the task low. Using the eyes as a means to perform 3D selections is naturally hindered by the low accuracy of eye movements. To account for this low accuracy, we propose to use the concept of progressive refinement to allow accurate 3D selection. We designed a novel eye tracking selection technique with progressive refinement–Eye-controlled Sphere-casting refined by QUAD-menu (EyeSQUAD). We propose an approximation method to stabilize the calculated point-of-regard and a space partitioning method to improve computation. We evaluated the performance of EyeSQUAD in comparison to two previous selection techniques–ray-casting and SQUAD–under different target size and distractor density conditions. Results show that EyeSQUAD outperforms previous eye tracking-based selection techniques, is more accurate and can achieve similar selection speed as ray-casting, and is less accurate and slower than SQUAD. We discuss implications of designing eye tracking-based progressive refinement interaction techniques and provide a potential solution for multimodal user interfaces with eye tracking.

show abstract

“…However, they do not provide an empirical study on their methods. Eye See Through [29] combines eye tracking in VR with the 'see through interface', introduced earlier by Bier et al [2] for two-dimensional displays. Here, the user looks through a transparent menu at the target and can trigger the controller button for selection.…”

Section: Gaze Interaction In Vrmentioning

confidence: 99%

Empirical Evaluation of Gaze-enhanced Menus in Virtual Reality

Pfeuffer

Mecke

Rodriguez

et al. 2020

26th ACM Symposium on Virtual Reality Software and Technology

Self Cite

View full text Add to dashboard Cite

Many user interfaces involve attention shifts between primary and secondary tasks, e.g., when changing a mode in a menu, which detracts the user from their main task. In this work, we investigate how eye gaze input affords exploiting the attention shifts to enhance the interaction with handheld menus. We assess three techniques for menu selection: dwell time, gaze button, and cursor. Each represents a different multimodal balance between gaze and manual input. We present a user study that compares the techniques against two manual baselines (dunk brush, pointer) in a compound colour selection and line drawing task. We show that user performance with the gaze techniques is comparable to pointer-based menu selection, with less physical effort. Furthermore, we provide an analysis of the trade-off as each technique strives for a unique balance between temporal, manual, and visual interaction properties. Our research points to new opportunities for integrating multimodal gaze in menus and bimanual interfaces in 3D environments. CCS CONCEPTS • Human-centered computing → Human computer interaction (HCI); Virtual reality; Mixed / augmented reality.

show abstract

EyeSeeThrough: Unifying Tool Selection and Application in Virtual Environments

Cited by 25 publications

References 38 publications

Eye&Head

Eye&Head

Efficient and Accurate Object 3D Selection With Eye Tracking-Based Progressive Refinement

Empirical Evaluation of Gaze-enhanced Menus in Virtual Reality

Contact Info

Product

Resources

About