There have been many recent studies on gaze recognition system in the field of HCI (Human Computer Interaction). This system will be the most natural and intuitive HCI system due to the application of gaze direction or biomedical Signals. We propose a multimodal user interface system using the nine directional gaze recognition based on image, EOG (Electrooculography) signal and speech recognition. In this paper, we use DFA (Deterministic Finite Accepter), Haar-like feature and Adaboost algorithm, SVM (Support Vector Machine) for gaze recognition based on the EOG signal and image. Furthermore, the CHMM (Continuous Hidden Markov Model) based speech recognition system has been linked for inputting speech commands. The proposed multimodal user interface system solves the problem of constraint of single modal recognition systems. As a result, the proposed system achieves higher recognition performance and more natural interface using speech commands.
This paper describes a PDA-based MMCR (Multi-Modal Command Recognizer for PDA control and handling) using double-touching with a finger by coupling embedded speech and KSSL recognizer, and suggests an improved synchronization method between multi-modalities for simultaneous multi-modality, for a pattern recognition-based neo multi-modal HCI. The MMCR fuses and recognizes 16 word-based command models that are represented by stylus, speech and KSSL (Korean Standard Sign Language), and then translates the recognition result into synthetic speech and visual illustration, for multi-modal PDA handling and interaction. Fifth International Conference on Software Engineering Research, Management and Applications 0-7695-2867-8/07 $25.00
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.