Selection and Manipulation Methods for a Menu Widget on the Human Forearm

Azai, Takumi; Ogawa, Shuichi; Otsuki, Mai; Shibata, Fumihisa; Kimura, Asako

doi:10.1145/3027063.3052959

Cited by 18 publications

(8 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Other approaches include leveraging body parts and body motion for menu selection. This includes the use of the palm of the hand [3], the forearm [2,52], the face [54] for direct commands access, as well as motion such as directional walking [59] for menu selection. On-body interactions offer a physical delimiter for interaction, and they usually tend to limit fatigue [52], but require most often the use of an external device to detect the body related gestures.…”

Section: Interactions Techniques For Menus In Xr Environnementsmentioning

confidence: 99%

HoloBar: Rapid Command Execution for Head-Worn AR Exploiting Around the Field-of-View Interaction

Saidi

Dubois

Serrano

2021

Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

Figure 1: A) By default, the HoloBar is not displayed; B) as soon as the user lifts up the smartphone (SP) inside the activation zone, the HoloBar is displayed and a top-level item is selected; C) the user can select other top-level items by translating the SP under the HoloBar, while second-level items are previewed on the SP. Finally, touching an item on the SP selects and validates the command.

show abstract

Section: Interactions Techniques For Menus In Xr Environnementsmentioning

confidence: 99%

HoloBar: Rapid Command Execution for Head-Worn AR Exploiting Around the Field-of-View Interaction

Saidi

Dubois

Serrano

2021

Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…Comme expliqué par Bailly et al, les contacts directs avec un objet non stérile et les commandes vocales ne sont pas adaptées à ce contexte [3]. Les techniques d'interaction basées sur le corps de l'utilisateur [2] posent également problème vis à vis de la stérilité des gants du chirurgien. De plus, laisser autant que possible les mains libres du chirurgien leur permettrait de se concentrer sur les gestes chirurgicaux au lieu d'interrompre leur travail afin de saisir un outil spécifique pour interagir avec le système.…”

Section: Motivation : Contexte De La Chirurgie Augmentéeunclassified

Exploration de la Physicalité des Widgets pour l’Interaction Basée sur des mouvements de la Tête le Cas des Menus en Réalité Mixte

Bailly

Leitner

Nigay

2021

32e Conférence Francophone Sur l'Interaction Homme-Machine

View full text Add to dashboard Cite

Mixed Reality with a Head-Mounted Display (HMD) offers unique perspectives for head-based interaction with virtual content and widgets. Besides virtual widgets, physical objects can be anchors (mixed widgets) or directly materialised widgets (physical widgets). The physicality (virtual-mixed-physical) of widgets defines a new dimension for Mixed Reality (MR) interaction that extends existing taxonomies of widgets in MR. As a first step to explore this new dimension, we focus on a commonly used widget: a menu. We thus evaluate the performance and usability of head pointing to a virtual, a mixed and a physical menu. Results suggest that pointing to a physical menu was on average 2s faster than pointing to a mixed or a virtual menu and preferred by participants. Virtual and mixed menus led to similar performances, but 11 participants over 15 preferred mixed menus over virtual ones. Based on our findings, we provide recommendations (benefits/limitations) for virtual, mixed and physical menus in MR. CCS CONCEPTS• Human-centered computing → Mixed / augmented reality; Pointing.

show abstract

“…Direct touch interaction: For the same reasons as before, interaction based on tangibles or body direct touch is not adapted to augmented surgery or maintenance. In the case of surgery, strict sterility constraints prevent direct touch interaction on the body [5]. Furthermore, all objects in the operating field must be sterilized before the surgery.…”

Section: Interaction Techniques In Mrmentioning

confidence: 99%

Head-Controlled Menu in Mixed Reality with a HMD

Bailly

Leitner

Nigay

2019

Human-Computer Interaction – INTERACT 2019

View full text Add to dashboard Cite

We present a design-space and three new techniques for headbased interaction with menus in Mixed Reality (MR) with a Head-Mounted Display (HMD). Usual input modalities such as hand gestures and voice commands are not suitable in noisy MR contexts where the users have both hands occupied as in augmented surgery and machine maintenance. To address the two issues of noisy MR contexts and hand-free interaction, we systematically explore the design space of headcontrolled menu interaction by considering two design factors: 1) headcontrolled menu versus head-controlled cursor 2) virtual targets versus mixed targets anchored on physical objects. Based on the design space, we present three novel menu techniques that we compared with a baseline head-controlled cursor technique. Experimental results suggest that head-controlled menu and head-controlled cursor techniques offer similar performance. In addition, the study found that mixed targets do not impact ultimate user performance when users are trained enough, but improve the learning phase. When using virtual targets, users still progressed after the training phase by reducing their mean selection time by 0.84s. When using mixed targets, the improvement was limited to 0.3s.

show abstract

Selection and Manipulation Methods for a Menu Widget on the Human Forearm

Cited by 18 publications

References 4 publications

HoloBar: Rapid Command Execution for Head-Worn AR Exploiting Around the Field-of-View Interaction

HoloBar: Rapid Command Execution for Head-Worn AR Exploiting Around the Field-of-View Interaction

Exploration de la Physicalité des Widgets pour l’Interaction Basée sur des mouvements de la Tête le Cas des Menus en Réalité Mixte

Head-Controlled Menu in Mixed Reality with a HMD

Contact Info

Product

Resources

About