Eliciting Mid-Air Gestures for Wall-Display Interaction

Wittorf, Markus L.; Jakobsen, Mikkel R.

doi:10.1145/2971485.2971503

Cited by 33 publications

(18 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…None of the participants reported arm fatigue during the study, what might indicate that our short-contact gestures mitigate this effect which is important for the usability during extended analysis sessions at large high-resolution displays [AEYN11,WJ16].…”

Section: Resultsmentioning

confidence: 89%

Short‐Contact Touch‐Manipulation of Scatterplot Matrices on Wall Displays

Riehmann

León

Reibert

et al. 2020

Computer Graphics Forum

View full text Add to dashboard Cite

This paper presents a short‐contact multitouch vocabulary for interacting with scatterplot matrices (SPLOMs) on wall‐sized displays. Fling‐based gestures overcome central interaction challenges of such large displays by avoiding long swipes on the typically blunt surfaces, frequent physical navigation by walking for accessing screen areas beyond arm's reach in the horizontal direction and uncomfortable postures for accessing screen areas in the vertical direction. Furthermore, we make use of the display's high resolution and large size by supporting the efficient specification of two‐tiered focus + context regions which are consistently propagated across the SPLOM. These techniques are complemented by axis‐centered and lasso‐based selection techniques for specifying subsets of the data. An expert review as well as a user study confirmed the potential and general usability of our seamlessly integrated multitouch interaction techniques for SPLOMs on large vertical displays.

show abstract

Section: Resultsmentioning

confidence: 89%

Short‐Contact Touch‐Manipulation of Scatterplot Matrices on Wall Displays

Riehmann

León

Reibert

et al. 2020

Computer Graphics Forum

View full text Add to dashboard Cite

show abstract

“…Among the diverse gesture types, "grab and move" and bimanual "handle bar metaphor" were reported as the intuitive gestures for object manipulation tasks [1,2,25]. In addition, users often preferred using gestures resembling physical manipulation for wall-sized displays [26]. Therefore, the two-hand gesture with grabbing while moving apart/close to each other was applied to enlarging/shrinking the 3D virtual car (Fig.…”

Section: Methodsmentioning

confidence: 99%

Identifying the Usability Factors of Mid-Air Hand Gestures for 3D Virtual Model Manipulation

Chen

Cheng

Chu

et al. 2017

Universal Access in Human–Computer Interaction. Designing Novel Interactions

View full text Add to dashboard Cite

Abstract. Although manipulating 3D virtual models with mid-air hand gestures had the benefits of natural interactions and free from the sanitation problems of touch surfaces, many factors could influence the usability of such an interaction paradigm. In this research, the authors conducted experiments to study the visionbased mid-air hand gestures for scaling, translating, and rotating a 3D virtual car displayed on a large screen. An Intel RealSense 3D Camera was employed for hand gesture recognition. The two-hand gesture with grabbing then moving apart/close to each other was applied to enlarging/shrinking the 3D virtual car. The one-hand gesture with grabbing then moving was applied to translating a car component. The two-hand gesture with grabbing and moving relatively along the circumference of a horizontal circle was applied to rotating the car. Seventeen graduate students were invited to participate in the experiments and offer their evaluations and comments for gesture usability. The results indicated that the width and depth of detection ranges were the key usability factors for two-hand gestures with linear motions. For dynamic gestures with quick transitions and motions from open to close hand poses, ensuring gesture recognition robustness was extremely important. Furthermore, given a gesture with ergonomic postures, inappropriate control-response ratio could result in fatigue due to repetitive exertions of hand gestures for achieving the precise controls of 3D model manipulation tasks.

show abstract

“…Wobbrock et al [ 30 ] proposed a unified approach to elicit gestures from users with the aim of maximizing and evaluating the guessability of gestures. A study on the guessability of input gestures on a three-meter wide display was conducted by Wittorf and Jakobsen [ 31 ]. They found that participants would like to vary gestures for pointing, grabbing, and swiping, and, 55% of the proposed gestures were physical in nature.…”

Section: Related Workmentioning

confidence: 99%

Investigating the Performance of Gesture-Based Input for Mid-Air Text Entry in a Virtual Environment: A Comparison of Hand-Up versus Hand-Down Postures

Wang

Yue-yang

Chen

et al. 2021

Sensors

View full text Add to dashboard Cite

Although the interaction technology for virtual reality (VR) systems has evolved significantly over the past years, the text input efficiency in the virtual environment is still an ongoing problem. We deployed a word-gesture text entry technology based on gesture recognition in the virtual environment. This study aimed to investigate the performance of the word-gesture text entry technology with different input postures and VR experiences in the virtual environment. The study revealed that the VR experience (how long or how often using VR) had little effect on input performance. The hand-up posture has a better input performance when using word-gesture text entry technology in a virtual environment. In addition, the study found that the perceived exertion to complete the text input with word-gesture text entry technology was relatively high. Furthermore, the typing accuracy and perceived usability for using the hand-up posture were obviously higher than that for the hand-down posture. The hand-up posture also had less task workload than the hand-down posture. This paper supports that the word-gesture text entry technology with hand-up posture has greater application potential than hand-down posture.

show abstract

Eliciting Mid-Air Gestures for Wall-Display Interaction

Cited by 33 publications

References 14 publications

Short‐Contact Touch‐Manipulation of Scatterplot Matrices on Wall Displays

Short‐Contact Touch‐Manipulation of Scatterplot Matrices on Wall Displays

Identifying the Usability Factors of Mid-Air Hand Gestures for 3D Virtual Model Manipulation

Investigating the Performance of Gesture-Based Input for Mid-Air Text Entry in a Virtual Environment: A Comparison of Hand-Up versus Hand-Down Postures

Contact Info

Product

Resources

About