Rational Design of a Novel Smart Mobile Communication System for Arabian Deaf and Dumb

Abstract

The deaf impairment is among the most substantial health problem worldwide, that can lead to various personal, economical, and social crisis. Therefore, it is critical for developing an efficient way to facilitate communication between deaf-dumb impaired and normal people. Herein, we have rationally designed a new digitally computerized and mobile smart system as an efficient communication tool between deaf impaired and normal Arabian people. This is based on two main steps, including creating a digital output for the hand gestures using gloves flex sensors equipped with a three-axis accelerometer that is controlled using a microcontroller. The digital results are compared to that in a words-based “database”, where Arabs use expressions not alphabet in their communication. The second step is translation or conversion the outputs of the first stage into written texts and voices. The newly developed system allows Arabian deaf to translate words of ordinary people into gestures using a speech recognition system with an impressive accuracy over 90 % without the needing for a webcam, colored gloves, and/or online translator. The presented system can be used on any android or windows.