GyGSLA: A Portable Glove System for Learning Sign Language Alphabet

Abstract

The communication between people with normal hearing with those having hearing or speech impairment is difficult. Learning a new alphabet is not always easy, especially when it is a sign language alphabet, which requires both hand skills and practice. This paper presents the GyGSLA system, standing as a completely portable setup created to help inexperienced people in the process of learning a new sign language alphabet. To achieve it, a computer/mobile game-interface and an hardware device, a wearable glove, were developed. When interacting with the computer or mobile device, using the wearable glove, the user is asked to represent alphabet letters and digits, by replicating the hand and fingers positions shown in a screen. The glove then sends the hand and fingers positions to the computer/mobile device using a wireless interface, which interprets the letter or digit that is being done by the user, and gives it a corresponding score. The system was tested with three completely inexperience sign language subjects, achieving a 76 % average recognition ratio for the Portuguese sign language alphabet.

Jogos para o ensino de línguas de sinais/línguas orais escritas para surdos: uma revisão sistemática da literatura

“…Percebemos que, dos nove estudos que apresentam jogos voltados apenas para o ensino do alfabeto manual ou dos números, seis deles (TORRES, CARVALHO, SOARES, 2018;PARREÑO et al, 2017;SOUSA et al, 2016;SOARES et al, 2015B;GAMEIRO, CARDOSO, RYBARCZYK, 2014;MADEO, 2011) tem suas pesquisas voltadas para o uso das tecnologias no desenvolvimento de jogos (dispositivo de captura de gestos, webcam e/ou luvas sensoriais) e, portanto, não são estudos desenvolvidos na área da educação de surdos, o que pode justificar o pouco aprofundamento nas questões relevantes para o ensino das línguas de sinais.…”

Jogos digitais educativos em línguas de sinais: uma revisão sistemática da literatura

“…GyGSLA (Sousa et al, 2016) Jogo de correspondência Usuário deve repetir um sinal apresentado em texto, em desenho e por um avatar. O sistema reconhece através de luva.…”

Sign Voice Bi-Directional Communication System (SVBi) for Blind, Deaf/Dumb and Normal People

“…The image is then segmented based on skin color. Then image is transformed from RGB into any of YCbCr space by straight forward linear transformation resulting in an invariant to human race skin detectors [3]. All these color spaces separate the illumination channel (Y) from two orthogonal chrominance channels (CbCr).…”

“…Moreover, they suffer from hard and long time to adapt with the hardware used from the user's perspective. Tessa [3] system translates English UK accent sentences clerks into British Sign Language (BSL) signs, by using a 3D virtual human. Transactions time is longer that is worse than transactions handled without the system.…”