Comparison on user experience of mid-air gesture interaction and traditional remotes control

Li, Xuan; Guan, Daisong; Zhou, Moli; Zhang, Jingya; Xingtong, Liu; Si-qi, LI

doi:10.1145/3332169.3333570

Cited by 9 publications

(2 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Compared to the communication modalities of using hand gestures and speaking, the traditional communication style of button pressing elicited significantly less mental stress, as confirmed by both objective and subjective assessments. Similarly, in a study recently conducted by Xuan (2019), it was noted that using gestures to control a TV in a home environment setting caused more mental stress than using a remote button control panel. In addition, there was no significant difference found between using hand gestures and verbal commands.…”

Section: Discussionmentioning

confidence: 90%

The effects of human-robot interaction modality on workers’ mental stress

Su,

Jung,

et al. 2023

Proceedings of the Human Factors and Ergonomics Society Annual

View full text Add to dashboard Cite

Advances in robotics have contributed to the prevalence of human-robot collaboration (HRC). Working and interacting with collaborative robots in close proximity can be psychologically stressful. Therefore, it is important to understand the impacts of human-robot interaction (HRI) on mental stress to promote psychological well-being at the workplace. To this end, this study investigated how the HRI presence, complexity, and modality affect psychological stress in humans and discussed possible HRI design criteria during HRC. An experimental setup was implemented in which human operators worked with a collaborative robot on a Lego assembly task, using different interaction paradigms involving pressing buttons, showing hand gestures, and giving verbal commands. The NASA-Task Load Index, as a subjective measure, and the physiological galvanic skin conductance response, as an objective measure, were used to assess the levels of mental stress. The results revealed that the introduction of interactions during HRC helped reduce mental stress and that complex interactions resulted in higher mental stress than simple interactions. Meanwhile, the use of certain interaction modalities, such as verbal commands or hand gestures, led to significantly higher mental stress than pressing buttons, while no significant difference on mental stress was found between showing hand gestures and giving verbal commands.

show abstract

Section: Discussionmentioning

confidence: 90%

The effects of human-robot interaction modality on workers’ mental stress

Su,

Jung,

et al. 2023

Proceedings of the Human Factors and Ergonomics Society Annual

View full text Add to dashboard Cite

show abstract

“…All these studies have not implemented the gestures, but they analyze several of their properties and make design recommendations. Some more recent studies combine elicitation with Wizard of Oz experiments, such as the work of Xuan et al, who compares mid-air gestures to remote control, collected data on perceived usability and experience, and concluded that "gesture control puts more mental stress and cognitive load on users, but it could improve the overall experience, compared to remote control" [13]. One major constraint of these types of studies is that they have not progressed to a more realistic context of the use of gestural interaction with interactive prototyping of gesture control accompanied by digital content, device indicators, etc.…”

Section: Related Workmentioning

confidence: 99%

Mid-Air Gesture Control of Multiple Home Devices in Spatial Augmented Reality Prototype

Vogiatzidakis

Koutsabasis

2020

MTI

View full text Add to dashboard Cite

Touchless, mid-air gesture-based interactions with remote devices have been investigated as alternative or complementary to interactions based on remote controls and smartphones. Related studies focus on user elicitation of a gesture vocabulary for one or a few home devices and explore recommendations of respective gesture vocabularies without validating them by empirical testing with interactive prototypes. We have developed an interactive prototype based on spatial Augmented Reality (AR) of seven home devices. Each device responds to touchless gestures (identified from a previous elicitation study) via the MS Kinect sensor. Nineteen users participated in a two-phase test (with and without help provided by a virtual assistant) according to a scenario that required from each user to apply 41 gestural commands (19 unique). We report on main usability indicators: task success, task time, errors (false negative/positives), memorability, perceived usability, and user experience. The main conclusion is that mid-air interaction with multiple home devices is feasible, fairly easy to learn and apply, and enjoyable. The contributions of this paper are (a) validation of a previously elicited gesture set; (b) development of a spatial AR prototype for testing of mid-air gestures, and (c) extensive assessment of gestures and evidence in favor of mid-air interaction in smart environments.

show abstract