SignBot, Sign-Language Performing Robot, Based on Sequential Motion of Servo Motor Arrays

Abstract

This paper presents the development of SignBot, a 3D printed robot which can perform Malaysian Sign Language (MSL). This work is the first attempt to eliminate the barriers of communication between hearing impaired individuals and the mainstream society as it is the first robot to perform MSL. The signing, in this work, can be done with two hands. The robot hands were developed with detailed finger joints. Micro servo motors were installed to allow for the signing motions for the relevant joints of selected letters, numbers as well as phrases for emergency cases. The sequential movements of the servo motor arrays are stored in the database to represent particular signs, and retrieved by the microcontroller based on the speech input detected, and finally executed accordingly by the servo motors to perform the sign. © Springer International Publishing AG, part of Springer Nature 2019. Indexed keywords

The Use of Humanoid Robots with Multilingual Interaction Skills in Teaching a Foreign Language: Opportunities, Research Challenges and Future Research Directions

“…However, if humanoid robots are going to be used in schools, they must be able to monitor everything that is happening in the classroom setting, to understand and interpret human language the way it is spoken, and to detect the emotions of each student. Another situation in which humanoid robots can be used is the teaching of sign language to hearing-impaired students (Al-Khulaidi et al, 2019).…”