Acoustic control of mouse pointer

Sporka, J.; Kurniawan, Hastuti; Slavik, Pavel

doi:10.1007/s10209-005-0010-z

Cited by 28 publications

(17 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To address these limitations, several research systems have recently been developed that use the non-speech parameters of human vocalization such as loudness, pitch, and vowel sounds for continuous control of the mouse cursor [4,8,13,15,19].…”

Section: Speech As a Primary Input Modalitymentioning

confidence: 99%

Longitudinal study of people learning to use continuous voice-based cursor control

Harada

Wobbrock

Malkin

et al. 2009

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

We conducted a 2.5 week longitudinal study with five motor impaired (MI) and four non-impaired (NMI) participants, in which they learned to use the Vocal Joystick, a voice-based user interface control system. We found that the participants were able to learn the mapping between the vowel sounds and directions used by the Vocal Joystick, and showed marked improvement in their target acquisition performance. At the end of the ten session period, the NMI group reached the same level of performance as the previously measured "expert" Vocal Joystick performance, and the MI group was able to reach 70% of that level. Two of the MI participants were also able to approach the performance of their preferred device, a touchpad. We report on a number of issues that can inform the development of further enhancements in the realm of voice-driven computer control.

show abstract

Section: Speech As a Primary Input Modalitymentioning

confidence: 99%

Longitudinal study of people learning to use continuous voice-based cursor control

Harada

Wobbrock

Malkin

et al. 2009

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…Sporka et al [31] describes the design and implementation of a system for controlling a mouse pointer using non-verbal sounds such as whistling and humming. Two control modes have been implemented-an orthogonal mode (where the pointer moves with variable speed either horizontally or vertically at any one time) and a melodic mode (where the pointer moves with fixed speed in any direction).…”

Section: Mapping Paralinguistic Voice To Visual Displaysmentioning

confidence: 99%

“…Vocal paralinguistic control induces a new style of human computer interaction. It enables users to interact with computers in an expressive manner by executing explicit vocal expressions [1,16,31]. Due to the restrictions of limited language and particular accents, such improvised interaction may never be possible in speech recognition-based systems.…”

Section: Implications For Technologymentioning

confidence: 99%

“…Various strategies have been employed to establish novel mapping techniques between visual properties and voice characteristics. Al Hashimi [1], Igarashi and Hughes [14] and Sporka et al [31] have successfully investigated paralinguistic voice interfaces for control of cursor movement, scrolling, clicking on icons and control of output devices such as plotters.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Supporting the creative drive: investigating paralinguistic voice as a mode of interaction for artists with upper limb disabilities

Perera

Eales

Blashki

2008

Univ Access Inf Soc

View full text Add to dashboard Cite

For people with upper limb disabilities visual art is an important activity that allows for expression of individuality and independence. They show remarkable endurance, patience and determination to adapt their remaining capabilities to create visual art. There are significant advantages of digital technologies in assisting artists with upper limb disabilities. Paralinguistic voice recognition technologies have proven to be a particularly promising mode of interaction. Despite these benefits, technological support for people with upper limb disabilities to create visual art is scarce. This paper reports on a number of case studies of several artists with upper limb disabilities. These case studies illustrate the struggles they face to be creative and also show the significant advantages of digital technologies in assisting such artists. An investigation into people's ability to use the volume of their voice to control cursor movement to create drawings on the screen is also reported. With motivation, training and practise, use of volume to control drawing tasks shows great promise. It is believed that paralinguistic voice has wider implications beyond assisting artists with upper limb disabilities, such as: an alternative mode of interaction for disabled people to perform tasks other than creating visual art, alternative mode of interaction for hands busy environments and as a voice training system for people with speech impairments.

show abstract

“…A program described in [21] was used to launch predefined UNIX commands upon reception of corresponding melodies. Also, the non-speech input has already been successfully employed to emulate standard mouse [2,17,19] and keyboard [16].…”

Section: Introductionmentioning

confidence: 99%

Non-speech input and speech recognition for real-time control of computer games

Sporka

Kurniawan

Mahmud

et al. 2006

Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility

Self Cite

View full text Add to dashboard Cite

This paper reports a comparison of user performance (time and accuracy) when controlling a popular arcade game of Tetris using speech recognition or non-speech (humming) input techniques. The preliminary qualitative study with seven participants shows that users were able to control the game using both methods but required more training and feedback for the humming control. The revised interface, which implemented these requirements, was positively responded by users. The quantitative test with 12 other participants shows that humming excelled in both time and accuracy, especially over longer distances and advanced difficulty levels.

show abstract

Acoustic control of mouse pointer

Cited by 28 publications

References 12 publications

Longitudinal study of people learning to use continuous voice-based cursor control

Longitudinal study of people learning to use continuous voice-based cursor control

Supporting the creative drive: investigating paralinguistic voice as a mode of interaction for artists with upper limb disabilities

Non-speech input and speech recognition for real-time control of computer games

Contact Info

Product

Resources

About