Gestural Interfaces for Hearing-Impaired Communication

Abstract

Abstract. Gestural interfaces, besides providing natural means of humancomputer interaction for everyone, enable the hearing impaired to use sign language or better understand speech through vision. This chapter overviews (1) the various modalities involved in gestured languages (2) the mean to automatically apprehend them individually and (3) to fuse them in order to provide a communication medium adapted to hearing-impaired. We present two example applications, a sign language tutoring tool and a cued speech interpreter and discuss theoretical and practical aspects.