Eyes-free interaction with free-hand gestures and auditory menus

Kajastila, Raine; Lokki, Tapio

doi:10.1016/j.ijhcs.2012.11.003

Cited by 26 publications

(18 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These systems have the potential to reduce eyes-off-the-road ACM ISBN 978-1-4503-2138-9. DOI: 10.1145/1235 time compared to traditional touch based interactions [15,25]. Car manufacturers like BMW, VW, Cadillac, and Hyundai are investing in mid-air gesture interfaces 1 for in-car interaction.…”

Section: Introductionmentioning

confidence: 99%

Novel Multimodal Feedback Techniques for In-Car Mid-Air Gesture Interaction

Shakeri

Williamson

Brewster

2017

Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

View full text Add to dashboard Cite

This paper presents an investigation into the effects of different feedback modalities on mid-air gesture interaction for infotainment systems in cars. Car crashes and near-crash events are most commonly caused by driver distraction. Mid-air interaction is a way of reducing driver distraction by reducing visual demand from infotainment. Despite a range of available modalities, feedback in mid-air gesture systems is generally provided through visual displays. We conducted a simulated driving study to investigate how different types of multimodal feedback can support in-air gestures. The effects of different feedback modalities on eye gaze behaviour, and the driving and gesturing tasks are considered. We found that feedback modality influenced gesturing behaviour. However, drivers corrected falsely executed gestures more often in non-visual conditions. Our findings show that non-visual feedback can reduce visual distraction significantly.

show abstract

Section: Introductionmentioning

confidence: 99%

Novel Multimodal Feedback Techniques for In-Car Mid-Air Gesture Interaction

Shakeri

Williamson

Brewster

2017

Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

View full text Add to dashboard Cite

show abstract

“…The recent focus on the research of affective-computing relies on sensing emotions from multiple modalities, because natural human-human interaction is multi-modal: people communicate through speech and use body language, such as posture, facial expressions, and gaze, to express emotion. But our works only considers a respect micro-expression to capture the emotional state [17][18][19][20][21]. In addition, the model of reappraisal strategy makes emotional cognition analysis with only two preset parameters, so if the more thorough cognitive reappraisal strategy is used, results are more nature and effective.…”

Section: Discussionmentioning

confidence: 99%

Cognitive Regulation and Emotion Modeling for Micro-expression

Xie¹,

Liu²,

Yang³

et al. 2016

IJCA

View full text Add to dashboard Cite

show abstract

“…Participants found visual feedback somewhat distracting, but had no issues with the audio feedback. Kajastila and Lokki (2013) found that a circular auditory menu reproduced with headphones can be as good as or even slightly better than a visual menu in a task where items are selected from a virtual menu surrounding the user's head. The circular menu was controlled by smooth round gestures around a centre point, or by using a direct stroke from the centre towards the menu item (a sector in the circular menu).…”

Section: Feedback For Different Input/interaction Modalitiesmentioning

confidence: 96%

Effects of auditory, haptic and visual feedback on performing gestures by gaze or by hand

Köpsel

Majaranta

Isokoski

et al. 2016

Behaviour & Information Technology

View full text Add to dashboard Cite

Modern interaction techniques like non-intrusive gestures provide means for interacting with distant displays and smart objects without touching them. We were interested in the effects of feedback modality (auditory, haptic or visual) and its combined effect with input modality on user performance and experience in such interactions. Therefore, we conducted two exploratory experiments where numbers were entered, either by gaze or hand, using gestures composed of four stroke elements (up, down, left and right). In Experiment 1, a simple feedback was given on each stroke during the motor action of gesturing: an audible click, a haptic tap or a visual flash. In Experiment 2, a semantic feedback was given on the final gesture: the executed number was spoken, coded by haptic taps or shown as text. With simultaneous simple feedback in Experiment 1, performance with hand input was slower but more accurate than with gaze input. With semantic feedback in Experiment 2, however, hand input was only slower. Effects of feedback modality were of minor importance; nevertheless, semantic haptic feedback in Experiment 2 showed to be useless at least without extensive training. Error patterns differed between both input modes, but again not dependent on feedback modality. Taken together, the results show that in designing gestural systems, choosing a feedback modality can be given a low priority; it can be chosen according to the task, context and user preferences. ARTICLE HISTORY

show abstract

Eyes-free interaction with free-hand gestures and auditory menus

Cited by 26 publications

References 26 publications

Novel Multimodal Feedback Techniques for In-Car Mid-Air Gesture Interaction

Novel Multimodal Feedback Techniques for In-Car Mid-Air Gesture Interaction

Cognitive Regulation and Emotion Modeling for Micro-expression

Effects of auditory, haptic and visual feedback on performing gestures by gaze or by hand

Contact Info

Product

Resources

About