Understanding Gesture Input Articulation with Upper-Body Wearables for Users with Upper-Body Motor Impairments

Vatavu, Radu-Daniel; Ungurean, Ovidiu-Ciprian

doi:10.1145/3491102.3501964

Cited by 15 publications

(6 citation statements)

References 95 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Previous research has explored gesture-based interactions for individuals with upper-body motor impairments, utilizing readily available devices (e.g., smartphones [10,11,62] and wearables [52]) or custom technologies (e.g. [13,15,22,41]).…”

Section: Upper-body Gestures Input For People With Motor Impairmentsmentioning

confidence: 99%

“…Empirical research indicates that individuals with motor impairments can accurately perform these gestures with devices worn on the wrist, finger, and head, although challenges related to repetition exist [51,52]. Moreover, the performance of stroke gestures for individuals with motor impairments can be enhanced through computer modeling and synthesis [49].…”

Section: Upper-body Gestures Input For People With Motor Impairmentsmentioning

confidence: 99%

“…Compared to the accessible gesture inputs for users with upper-body motor impairments for smartphone [10,11,62] and wearable devices [52], our study is unique in three aspects. Firstly, our gestures are designed for VR, which is beneficial [12] but inaccessible [26] for people with motor impairments.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VR

Tian,

Wang,

et al. 2024

Proceedings of the CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

Fig. 1. Twelve people with Spinal Muscular Atrophy designed upper-body gestures for VR commands. Two of them participated in person, while the other ten joined remotely. All participants actively took part in this research, and Participant 6 preferred to conduct the experiments without turning on the camera.Recent research proposed gaze-assisted gestures to enhance interaction within virtual reality (VR), providing opportunities for people with motor impairments to experience VR. Compared to people with other motor impairments, those with Spinal Muscular Atrophy (SMA) exhibit enhanced distal limb mobility, providing them with more design space. However, it remains unknown what gaze-assisted upper-body gestures people with SMA would want and be able to perform. We conducted an elicitation study in which

show abstract

Section: Upper-body Gestures Input For People With Motor Impairmentsmentioning

confidence: 99%

Section: Upper-body Gestures Input For People With Motor Impairmentsmentioning

confidence: 99%

See 1 more Smart Citation

Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VR

Tian,

Wang,

et al. 2024

Proceedings of the CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…Research mainly explores two approaches: Gesture interaction systems [6] and fingertip touch interfaces [7]. Studies on gesture interaction have focused on obtaining the spatial position and pose of fingers through motion-tracking devices for virtual object operations [8] or emotional communication [9]. Such tasks require the whole finger to move for input operations, making it impossible to achieve intimate and subtle interactions solely relying on fingertips [10].…”

Section: Introductionmentioning

confidence: 99%

OneTip Is Enough: A Non-Rigid Input Device for Single-Fingertip Human-Computer Interaction With 6-DOF

Li,

Zhou,

Zhang

et al. 2024

Preprint

View full text Add to dashboard Cite

With the development of novel display technologies such as 3-D graphical applications, virtual and augmented reality, there are new demands for more efficient and natural multi-degree-of-freedom (DOF) interaction devices. However, traditional rigid touchscreens provide only the 2-D position of the touch point as input information, which cannot meet the needs of high DOF interactions, and many of the existing interaction technologies suffer from the problems of low resolution and lack of information. At the same time, non-rigid interaction interfaces provide deformability for input and have been shown to extend the richness of input vocabulary. This article proposes a new non-rigid input device, OneTip, for single-fingertip human-computer interaction with 6-DOF. In terms of design and manufacture, OneTip employs the bio-inspired design of Skin-On interfaces to mimic the sensitivity of human skin and provide 6-DOF interaction capabilities. In terms of sensing, OneTip uses the visuotactile sensing technique based on the marker displacement method to achieve high-resolution and multi-modal measurements. We propose a novel fingertip pose estimation method based on incipient slip detection, a non-learning algorithm that does not require registration and priori information. Experiments show that OneTip had good 6-D pose estimation accuracy, with RMSEs of translation and rotation not exceeding 0.1mm and 2.6°, respectively, within the linear interval. Extensive experiments were also conducted to explore the application of OneTip in typical virtual manipulation tasks and the possibility of combining it with other interaction devices. This work is intended to serve as a reference for other researchers exploring innovative interaction techniques.

show abstract

“…Though there is extensive research on the use of wearable technology for people with disabilities [6][7][8][9][10][11] and wearable technology for games for rehabilitation [10,[12][13][14][15][16],…”

Section: Introduction 11 Overview Of Problem Spacementioning

confidence: 99%

Accessible Gaming Wearables: Opportunities for Players with Upper Limb Motor Disabilities

Loewen

View full text Add to dashboard Cite

There has been increased interest in how wearables can offer new avenues of interaction in video games. However, understanding how wearable devices can support accessible gaming is missing. My research aims to explore this potential with users with upper limb motor disabilities to understand their experiences with video games and wearable devices. My thesis is divided into two parts. Firstly, I interviewed gamers with upper limb motor disabilities to understand their lived experiences in playing video games and using wearable technology. Secondly, I explored the design space of accessible gaming wearables using participatory design fiction sessions to envision the future of wearable technology and accessible video games. My study also offers methodological contributions to the HCI community by demonstrating how dialogic/performance analysis can be applied to participatory design fiction research.Though narrative inquiry is often used in HCI, specifically using the method of dialogic/performance analysis to analyze narrative inquiry data is less often used. This research provides a detailed example of how this analysis method can be utilized in HCI research.

show abstract

Understanding Gesture Input Articulation with Upper-Body Wearables for Users with Upper-Body Motor Impairments

Cited by 15 publications

References 95 publications

Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VR

Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VR

OneTip Is Enough: A Non-Rigid Input Device for Single-Fingertip Human-Computer Interaction With 6-DOF

Accessible Gaming Wearables: Opportunities for Players with Upper Limb Motor Disabilities

Contact Info

Product

Resources

About