Adaptive sliding menubars make existing software more accessible to people with severe motion impairments

Abstract

The graphical user interfaces of popular software are often inaccessible to people with severe motion impairments, who cannot use the traditional keyboard and mouse, and require an alternative input device. Reaching for buttons and selecting menu items, in particular, can be difficult for nonverbal individuals with quadriplegia, who control the mousepointer with head motion via a mouse-replacement system. This paper proposes interaction techniques that can be used with mouse-replacement systems and enable the creation of accessible graphical user interfaces. To illustrate these techniques, the paper presents an image editing application, named Camera Canvas, that uses a sliding toolbar as its universal menu controller. The parameters of the toolbar automatically adapt to the movement abilities of the specific user. Individuals with and without disabilities and of a variety of ages were observed using Camera Canvas. It was found that the developed techniques worked across many different movement abilities and experience levels. Then, it was investigated how such techniques could be used to ''retrofit'' existing Windows applications with new graphical user interfaces. A tool called Menu Controller was created that can automatically re-render the menus of some existing applications into adaptive sliding toolbars. Menu Controller enables users of mouse-replacement systems to select menu entries that were otherwise inaccessible to them.

Pervasive technologies and assistive environments: cognitive systems for assistive environments: special issue of PETRA 2010 and 2011 conferences

“…More specifically, Kwan et al [8] in their paper propose interaction techniques that can be used with mousereplacement systems to enable the creation of accessible graphical user interfaces. To illustrate these techniques, they created Camera Canvas, an image editing application that uses a sliding toolbar as its universal menu controller.…”