User Elicitation on Single-hand Microgestures

Chan, Edwin Sy; Seyed, Teddy; Stuerzlinger, Wolfgang; Yang, Xing-Dong; Maurer, Frank

doi:10.1145/2858036.2858589

Cited by 118 publications

(125 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…For example, they considered nger movements that could be performed when the hands were grasping a car steering wheel. Chan et al [5] de ned micro-gestures as "detailed gestures in a small interaction space". ey focused on the miniaturisation of hand movements to allow users to gesture in more subtle and discreet ways, not necessarily whilst performing another task.…”

Section: Related Workmentioning

confidence: 99%

Rhythmic micro-gestures: discreet interaction on-the-go

Freeman

Griffiths

Brewster

2017

Proceedings of the 19th ACM International Conference on Multimodal Interaction

View full text Add to dashboard Cite

We present rhythmic micro-gestures, micro-movements of the hand that are repeated in time with a rhythm. We present a user study that investigated how well users can perform rhythmic microgestures and if they can use them eyes-free with non-visual feedback. We found that users could successfully use our interaction technique (97% success rate across all gestures) with short interaction times, rating them as low di culty as well. Simple audio cues that only convey the rhythm outperformed animations showing the hand movements, supporting rhythmic micro-gestures as an eyes-free input technique.

show abstract

Section: Related Workmentioning

confidence: 99%

Rhythmic micro-gestures: discreet interaction on-the-go

Freeman

Griffiths

Brewster

2017

Proceedings of the 19th ACM International Conference on Multimodal Interaction

View full text Add to dashboard Cite

show abstract

“…Thumb-to-finger interaction methods present a promising input mechanism that is suitable to perform subtle, natural, and socially acceptable gestures. In particular, prior studies on hand gestures [35,43] have found that both thumb and index fingers are preferred over the middle, ring, and pinky fingers. As explained by Wolf et al [43] the thumb is opposable and has the ability to rotate and be able to touch other fingers on the same hand.…”

Section: Hand-worn Clothing-based Interfacesmentioning

confidence: 98%

“…Thus, interface metaphors of HMD AR are not suitable for HAR displays. In terms of interactions based on single hand thumb-to-fingers, Chan et al [35] presented a study of user-elicited single hand gestures using two or more fingers. They reported that both thumb and index fingers were highly involved in the interactions of their gesture set.…”

Section: Participatory Elicitation Studiesmentioning

confidence: 99%

“…As explained by Wolf et al [43] the thumb is opposable and has the ability to rotate and be able to touch other fingers on the same hand. Similarly, the muscles involved in moving each finger and the biomechanics make the index finger well suited for independent movement [35]. In particular, Yoon et al [24] proposed "Timmi", a finger-worn piezoresistive fabric-based prototype which supports thumb-to-finger multimodal input.…”

Section: Hand-worn Clothing-based Interfacesmentioning

confidence: 99%

See 1 more Smart Citation

Design of Interactions for Handheld Augmented Reality Devices Using Wearable Smart Textiles: Findings from a User Elicitation Study

Nanjappan

Shi

et al. 2019

Applied Sciences

View full text Add to dashboard Cite

Advanced developments in handheld devices' interactive 3D graphics capabilities, processing power, and cloud computing have provided great potential for handheld augmented reality (HAR) applications, which allow users to access digital information anytime, anywhere. Nevertheless, existing interaction methods are still confined to the touch display, device camera, and built-in sensors of these handheld devices, which suffer from obtrusive interactions with AR content. Wearable fabric-based interfaces promote subtle, natural, and eyes-free interactions which are needed when performing interactions in dynamic environments. Prior studies explored the possibilities of using fabric-based wearable interfaces for head-mounted AR display (HMD) devices. The interface metaphors of HMD AR devices are inadequate for handheld AR devices as a typical HAR application require users to use only one hand to perform interactions. In this paper, we aim to investigate the use of a fabric-based wearable device as an alternative interface option for performing interactions with HAR applications. We elicited user-preferred gestures which are socially acceptable and comfortable to use for HAR devices. We also derived an interaction vocabulary of the wrist and thumb-to-index touch gestures, and present broader design guidelines for fabric-based wearable interfaces for handheld augmented reality applications. Appl. Sci. 2019, 9, 3177 2 of 21 and portable enough to be carried wherever users go. With this ubiquitous availability, HAR allows us to develop and design innovative applications in navigation, education, gaming, tourism, interactive shopping, production, marketing, and others [3]. Thus, smartphones have been identified as an ideal platform for HAR experiences in various outdoor and indoor environments [4][5][6].In order to interact with the virtual world using HAR displays, a user needs to position and orientate the device using one hand and manipulate the virtual 3D objects with the other hand. In general, the touchscreen is used as a primary interface to interact with AR content [7,8]. In addition, the various built-in sensors in the handheld devices-such as cameras, GPS, compass, accelerometers, and gyroscope-enable to precisely determine the position and orientation of the device in the real world (e.g., [8][9][10]). Furthermore, the device's camera is used to naturally capture the user's mid-air hand movements while holding the device [11,12].Like in HMD AR, manipulations such as selecting and moving virtual 3D information are primary interactions in HAR devices [13]. The existing HAR interaction methods, such as touch input, offer promising solutions to manipulate virtual content (e.g., [14]). However, they still have substantial limitations. For instance, touch input is limited by the device's physical boundary and usability suffers as on-screen content becomes occluded by finger (i.e., finger occlusions [15,16]). Also, 2D inputs on the touch surface do not directly support manipulating the six degrees of freedom of a virt...

show abstract

“…User defined gestures sets have been developed for surface computing Wobbrock et al (2009), motion gestures for mobile interaction Ruiz et al (2011), free-hand TV control Vatavu (2012), multi-display environments Seyed et al (2012), augmented reality Piumsomboon et al (2013), and single-hand microgestures Chan et al (2016). However, very few gesture sets exist for mid-air hand interaction.…”

Section: Introductionmentioning

confidence: 99%