Head pointing and speech control as a hands-free interface to desktop computing

Malkewitz, Rainer

doi:10.1145/274497.274531

Cited by 22 publications

(7 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A text entry facility (S12), which 'predicts' the words a user is entering by looking for the most relevant key combination in its internal dictionary (Minneman 1986, Garay-Vitoria andAbascal 2005) has also been adopted to speed up input. Multi-modal interfaces (S29) which combine a number of modalities such as head movement and speech for motor impaired users (Malkewitz 1998) and handwriting and speech for small device users (Serrano et al 2006) have also been suggested as possible input solutions, and are gaining popularity. Some solutions exist for motor impaired users, but not for small-device users: One-handed keyboards (S6), trackballs (S8), eye-tracking (S10) and switch interfaces (S25) as well as predefined texts or graphical icons (S30).…”

Section: Similar Solutions?mentioning

confidence: 99%

Mobile device impairment … similar problems, similar solutions?

Harper

Yeşi̇lada

Chen

2011

Behaviour & Information Technology

View full text Add to dashboard Cite

Previous studies have defined a new type of impairment in which an able-bodied user's behaviour is impaired by both the characteristics of a device and the environment in which it is used. This behavioural change is defined as a situationally-induced impairment and is often associated with small devices used in a mobile setting or constrained environment. Relatively little is known of its extent or the magnitude of the problems faced by the user. Here, we place the work that has been undertaken into a comparative framework of impairment in the context of data input. Our survey finds that 12 problems exist which define all impaired input and we look to understand the similarities and possible solutions in the new impairment group of small device users. For instance, from the literature, we find that users who are both situationally and motor impaired: press keys more than once, do not use enough force and so a key is not activated, and accidentally type keys in reverse order. A wealth of other errors exist in the motor impaired domain but work does not exist to support their existence in the situational domain. However, if commonalities exist for some -it seems work should be enacted to uncover the commonalities of all. Establishing these possible commonalities is important because solutions from one domain can be leveraged into another thereby saving the need to reinvent interventions which already exist elsewhere.

show abstract

Section: Similar Solutions?mentioning

confidence: 99%

Mobile device impairment … similar problems, similar solutions?

Harper

Yeşi̇lada

Chen

2011

Behaviour & Information Technology

View full text Add to dashboard Cite

show abstract

“…It also allows us to use head gestures as an interaction technique: head movements such as nods or shakes can be used to make selections in the audio space. Head pointing is more common for desktop users with physical disabilities [11], but has many advantages for all users, as head movements are very expressive.…”

Section: Potential Solutionsmentioning

confidence: 99%

Multimodal 'eyes-free' interaction techniques for wearable devices

Brewster¹,

Lumsden²,

Bell³

et al. 2003

Proceedings of the Conference on Human Factors in Computing Systems - CHI '03

View full text Add to dashboard Cite

Mobile and wearable computers present input/output problems due to limited screen space and interaction techniques. When mobile, users typically focus their visual attention on navigating their environment -making visually demanding interface designs hard to operate. This paper presents two multimodal interaction techniques designed to overcome these problems and allow truly mobile, 'eyes-free' device use. The first is a 3D audio radial pie menu that uses head gestures for selecting items. An evaluation of a range of different audio designs showed that egocentric sounds reduced task completion time, perceived annoyance, and allowed users to walk closer to their preferred walking speed. The second is a sonically enhanced 2D gesture recognition system for use on a belt-mounted PDA. An evaluation of the system with and without audio feedback showed users' gestures were more accurate when dynamically guided by audio-feedback. These novel interaction techniques demonstrate effective alternatives to visual-centric interface designs on mobile devices.

show abstract

“…A range of devices exist for remote pointing but our interest is in computer vision methods that support users in pointer control without the need for mediating devices. Related work generally assumes use of the hands for pointing (e.g., [61,52,5,34,13]) but work in other areas has shown that humans are equally natural at pointing with other parts of their body (literally, from head [45,38] to toe [58]). We reflect this in an approach that is input-agnostic and supports any body movement to be adopted for pointing, contrasting existing systems that are optimised for specific modalities such as tracking of hand gestures [48], head pose [54], or feet [56].…”

Section: Background and Related Workmentioning

confidence: 99%

MatchPoint

Clarke

Gellersen

2017

Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

View full text Add to dashboard Cite

Figure 1. Spontaneous spatial coupling is a hybrid technique of motion-matching and pointing. Controls in the form of moving targets are presented to the user (A). When the user synchronises their movement with a target (B), a spatial coupling is created between the input modality (C) and the control (D). The technique enables ad hoc appropriation of any part of their body, or any object they hold, as a pointing device.

show abstract

Head pointing and speech control as a hands-free interface to desktop computing

Cited by 22 publications

References 8 publications

Mobile device impairment … similar problems, similar solutions?

Mobile device impairment … similar problems, similar solutions?

Multimodal 'eyes-free' interaction techniques for wearable devices

MatchPoint

Contact Info

Product

Resources

About