Gesture-Controlled User Input to Complete Questionnaires on Wrist-Worn Watches

Abstract

Abstract. The aim of this work was to investigate arm gestures as an alternative input modality for wrist-worn watches. In particular we implemented a gesture recognition system and questionnaire interface into a watch prototype. We analyzed the wearer's effort and learning performance to use the gesture interface and compared their performance to a classical button-based solution. Moreover we evaluated the system performance to spot wearer gestures and the system responsiveness. Our wearer study showed that the watch achieved a recognition accuracy of more than 90%. Completion times showed a clear decrease from 3 min in the first repetition to 1 min, 49 sec in the last one. Similarly, variance of completion times between wearers decreased during repetitions. Completion time using the button interface was 36 sec. Ratings of physical and concentration effort decreased during the study. Our results confirm that wearer training state is rather reflected in completion time than recognition performance.

Performance Analysis of an HMM-Based Gesture Recognition Using a Wristwatch Device

“…Although this practice phase was short, users quickly adopted the gestures during this time. In a related analysis users rated physical effort constantly while the focus on the gestures decreased when performing multiple gesture repetitions [17]. This indicates that such a practicing step is a useful approach for specifically designed gestures, as they are used here.…”

“…In a related study of user ratings we observed that while the focus on performing the gestures decreases, the effort to execute them remains constant [17]. Hence it is essential to restrict the number of gestures to maintain usability even over weeks and months of continuous usage.…”

“…

Tröster, G. (2009). Performance analysis of an HMM-based gesture recognition using a wristwatch device.

…”

A simple wristband based on capacitive sensors for recognition of complex hand motions

“…al. use motion sensors embedded in a wrist worn device as input for a questionnaire [1]. However, most gestures in the related work are quite crude compared to the ones used in this paper [9], [14].…”

“…There are also quite a number of data gloves and wearable keyboards. Unfortunately, they all require heavy augmentation of the user's wrist/hand [6], [1], [10], [11]. Additionally, all of these devices use a combination of motion sensors, cameras/light sensors and microphones to perform input or context recognition.…”