ARtention: A design space for gaze-adaptive user interfaces in augmented reality

Pfeuffer, Ken; Abdrabou, Yasmeen; Esteves, Augusto; Rivu, Radiah; Abdelrahman, Yomna; Meitner, Stefanie; Saadi, Amr; Alt, Florian

doi:10.1016/j.cag.2021.01.001

Cited by 66 publications

(16 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Gaze corresponds to the user's focus of attention which makes it natural and fast for pointing at objects of interest [4]. A wide range of work has harnessed gaze for implicit interaction, for example, to render interfaces attentive to the user [49] and adapt information displays [29]. Gaze has also been adopted for explicit input, based on interaction techniques that extend gaze pointing with a selection method equivalent to a mouse "click".…”

Section: Pointing In Gaze and Mid-air Interfacesmentioning

confidence: 99%

Gaze-Hand Alignment

Lystbæk

Rosenberg

Pfeuffer

et al. 2022

Proc. ACM Hum.-Comput. Interact.

Self Cite

View full text Add to dashboard Cite

Gaze and freehand gestures suit Augmented Reality as users can interact with objects at a distance without need for a separate input device. We propose Gaze-Hand Alignment as a novel multimodal selection principle, defined by concurrent use of both gaze and hand for pointing and alignment of their input on an object as selection trigger. Gaze naturally precedes manual action and is leveraged for pre-selection, and manual crossing of a pre-selected target completes the selection. We demonstrate the principle in two novel techniques, Gaze&Finger for input by direct alignment of hand and finger raised into the line of sight, and Gaze&Hand for input by indirect alignment of a cursor with relative hand movement. In a menu selection experiment, we evaluate the techniques in comparison with Gaze&Pinch and a hands-only baseline. The study showed the gaze-assisted techniques to outperform hands-only input, and gives insight into trade-offs in combining gaze with direct or indirect, and spatial or semantic freehand gestures.

show abstract

Section: Pointing In Gaze and Mid-air Interfacesmentioning

confidence: 99%

Gaze-Hand Alignment

Lystbæk

Rosenberg

Pfeuffer

et al. 2022

Proc. ACM Hum.-Comput. Interact.

Self Cite

View full text Add to dashboard Cite

show abstract

“…This app introduces the concept of design space for gaze-input-based interfaces for AR environments [10]. It is a form of input that interacts with the world based on where the user is looking.…”

Section: Artentionmentioning

confidence: 99%

Augmented Reality Fraction Apps for Low Vision Alpha Generation Based on Affective Design Principles

Aziz¹,

Ahmad²,

Rahman³

et al. 2022

TEM Journal

View full text Add to dashboard Cite

The advancement of affective computing and augmented reality (AR) have been growing rapidly in the Information and Communication Technology (ICT) domain. Even though the trend of both subresearch domains is increasing however most of the existing AR apps fail to stimulate affective interactions particularly in terms of feeling, thought, emotion, and action which is highly needed by the low vision alpha generation particularly to understand the fraction concept. Therefore, the objective of this study is to develop an Affective Augmented Reality Fraction Apps for Low Vision Alpha Generation (ARFA4LV).The 3-Phases Development Model which consisted of (i) pre-production, (ii) production, and (iii) postproduction has been utilized to develop the ARFA4LV. In addition, User-Centred Design (UCD) approach has been utilized throughout the development phase. The finding of this study is the ARFA4LV. The future work of this study is to provide the heuristic evaluation and user experience testing on ARFA4LV.

show abstract

“…Pham and Stuerzlinger propose comparing the different controllers, focusing on the flexibility in using the 3D pen for VR and AR applications [105]. Electronic skins have recently been investigated as one of the most promising device solutions for future VR/AR devices [106], while the ARtention project [107] illustrates how input information can come directly from retinal motion. Finally, the MARVIS project proposes integrating HMDs and mobile devices for optimized data management in augmented reality [108].…”

Section: Network Connectivitymentioning

confidence: 99%

“…They do not detect user input but define an active perception of the system towards specific signals appropriately encoded and read by the system. Standard sensors include motion detection [135], gaze tracking [107], and speech recognition for visual content [136]. Most of these sensors have little presence in the AR world.…”

Section: Sensor-based Interfacesmentioning

confidence: 99%

AR in the Architecture Domain: State of the Art

Russo

2021

Applied Sciences

View full text Add to dashboard Cite

Augmented reality (AR) allows the real and digital worlds to converge and overlap in a new way of observation and understanding. The architectural field can significantly benefit from AR applications, due to their systemic complexity in terms of knowledge and process management. Global interest and many research challenges are focused on this field, thanks to the conjunction of technological and algorithmic developments from one side, and the massive digitization of built data. A significant quantity of research in the AEC and educational fields describes this state of the art. Moreover, it is a very fragmented domain, in which specific advances or case studies are often described without considering the complexity of the whole development process. The article illustrates the entire AR pipeline development in architecture, from the conceptual phase to its application, highlighting each step’s specific aspects. This storytelling aims to provide a general overview to a non-expert, deepening the topic and stimulating a democratization process. The aware and extended use of AR in multiple areas of application can lead a new way forward for environmental understanding, bridging the gap between real and virtual space in an innovative perception of architecture.

show abstract

ARtention: A design space for gaze-adaptive user interfaces in augmented reality

Cited by 66 publications

References 39 publications

Gaze-Hand Alignment

Gaze-Hand Alignment

Augmented Reality Fraction Apps for Low Vision Alpha Generation Based on Affective Design Principles

AR in the Architecture Domain: State of the Art

Contact Info

Product

Resources

About