Face as mouse through visual face tracking

Tu, Jilin; Tao, Hai; Huang, Thomas S.

doi:10.1016/j.cviu.2006.11.007

Cited by 74 publications

(40 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Mouse-replacement systems that have been tested with people with motion impairments are Sina from Spain [34,54] and Nouse from Canada [33]. For other promising research systems [55][56][57][58][59][60], tests with users with motion impairments have not been conducted but are reportedly planned.…”

Section: Discussionmentioning

confidence: 99%

Adaptive sliding menubars make existing software more accessible to people with severe motion impairments

Kwan

Paquette

Magee

et al. 2013

Univ Access Inf Soc

View full text Add to dashboard Cite

The graphical user interfaces of popular software are often inaccessible to people with severe motion impairments, who cannot use the traditional keyboard and mouse, and require an alternative input device. Reaching for buttons and selecting menu items, in particular, can be difficult for nonverbal individuals with quadriplegia, who control the mousepointer with head motion via a mouse-replacement system. This paper proposes interaction techniques that can be used with mouse-replacement systems and enable the creation of accessible graphical user interfaces. To illustrate these techniques, the paper presents an image editing application, named Camera Canvas, that uses a sliding toolbar as its universal menu controller. The parameters of the toolbar automatically adapt to the movement abilities of the specific user. Individuals with and without disabilities and of a variety of ages were observed using Camera Canvas. It was found that the developed techniques worked across many different movement abilities and experience levels. Then, it was investigated how such techniques could be used to ''retrofit'' existing Windows applications with new graphical user interfaces. A tool called Menu Controller was created that can automatically re-render the menus of some existing applications into adaptive sliding toolbars. Menu Controller enables users of mouse-replacement systems to select menu entries that were otherwise inaccessible to them.

show abstract

Section: Discussionmentioning

confidence: 99%

Adaptive sliding menubars make existing software more accessible to people with severe motion impairments

Kwan

Paquette

Magee

et al. 2013

Univ Access Inf Soc

View full text Add to dashboard Cite

show abstract

“…The mouse-emulation system Nouse, for example, uses two web cameras to track the 3D position of the nose of the user and was tested with 15 users with motion impairments [15]. Another 3D approach was proposed by Tu et al [38], which tracked one subject's face using a 3D model with 12 facial motion parameters. Based on the experiments with users with motion disabilities, Gorodnichy et al [15] pointed out that the smoothness and range of the users' head movements are often overestimated by developers of camera-based interfaces.…”

Section: Related Workmentioning

confidence: 99%

Using kernels for a video-based mouse-replacement interface

Epstein

Missimer

Betke

2012

Pers Ubiquit Comput

View full text Add to dashboard Cite

“…Regardless of the significant advances recently made in vision-based face detection, of which we acknowledge the following techniques as the ones contributing the most to the field: developed for automatic detection of faces [24] and eyes [14], 3D-face-model-based tracking [30] and robust sub-pixel precision nose tracking [12] should be specially acknowledged, the desired hands-free face-tracking-based cursor control has not been achieved yet.…”

Section: Problematicmentioning

confidence: 99%