Malaysian Sign Language Mobile Learning Application : A recommendation app to communicate with hearing-impaired communities

Hafit, Hanayanti; Xiang, Chiam Wui; Yusof, Munirah Mohd; Wahid, Norfaradilla; Kassim, Shahreen

doi:10.11591/ijece.v9i6.pp5512-5518

Cited by 14 publications

(9 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The modes of communication are different depending on the students' preferences or the language that they are familiar with. However, the most used mode is the sign language [27], [28].…”

Section: Hearing-impaired Students In Esl Classroommentioning

confidence: 99%

Exploring the Potential Usage of Mobile Technologies Among the Hearing-Impaired Students in Learning English as a Second Language (ESL)

Nasir

Hashim

Rashid

et al. 2021

Int. J. Interact. Mob. Technol.

View full text Add to dashboard Cite

<p>With the emergence of mobile technologies in education, the special needs students are gaining the infinite benefits that could enhance their learning sessions. Numerous studies are conducted on the usage of mobile technologies among the special needs students including their acceptance towards the technologies, its advantages as well as the obstacles on the utilisation of mobile technologies. However, fewer studies are done on the usage of mobile technologies among the hearing-impaired (HI) students. There is a need for more studies on that as the number of hearing-impaired people are increasing continuously around the globe. Hence, the aims of the study are to explore the hearing-impaired students’ perspectives on the usa of mobile technologies in learning ESL. In-depth interviews are conducted among the selected ten hearing-impaired students from four different secondary schools in Malaysia and the notable finding demonstrates the majority of them believed that mobile technologies assist them in learning. This study provides the insights for the education stakeholders, especially the policy makers and inventors to create the solutions and improvise the features of mobile technologies that are more user-friendly towards the hearing-impaired students.</p>

show abstract

“…The modes of communication are different depending on the students' preferences or the language that they are familiar with. However, the most used mode is the sign language [27], [28].…”

Section: Hearing-impaired Students In Esl Classroommentioning

confidence: 99%

Exploring the Potential Usage of Mobile Technologies Among the Hearing-Impaired Students in Learning English as a Second Language (ESL)

Nasir

Hashim

Rashid

et al. 2021

Int. J. Interact. Mob. Technol.

View full text Add to dashboard Cite

show abstract

“…With the aim of educating deaf students, in 1964, American Sign Language (ASL) was made available in Johor, while Kod Tangan Bahasa Malaysia (KTBM) started to settle in Penang in 1978 when Total Communication was introduced into education for deaf students [13]. BIM has been the main form of communication amongst the deaf population in Malaysia for many years since it was first developed [14][15][16].…”

Section: Introductionmentioning

confidence: 99%

“…This includes the numerous assistive technologies available to the deaf/mute, such as speech-totext and speech-to-visual technologies and sign language, which are portable and simple. Several applications are accessible to normal people; however, each has a set restriction today [16,23]. Additionally, there is a shortage of excellent smartphone translation programs that encourage sign language translation [14] between deaf/mute and normal people.…”

Section: Introductionmentioning

confidence: 99%

Interpretation of Bahasa Isyarat Malaysia (BIM) Using SSD-MobileNet-V2 FPNLite and COCO mAP

et al. 2023

View full text Add to dashboard Cite

This research proposes a study on two-way communication between deaf/mute and normal people using an Android application. Despite advancements in technology, there is still a lack of mobile applications that facilitate two-way communication between deaf/mute and normal people, especially by using Bahasa Isyarat Malaysia (BIM). This project consists of three parts: First, we use BIM letters, which enables the recognition of BIM letters and BIM combined letters to form a word. In this part, a MobileNet pre-trained model is implemented to train the model with a total of 87,000 images for 29 classes, with a 10% test size and a 90% training size. The second part is BIM word hand gestures, which consists of five classes that are trained with the SSD-MobileNet-V2 FPNLite 320 × 320 pre-trained model with a speed of 22 s/frame rate and COCO mAP of 22.2, with a total of 500 images for all five classes and first-time training set to 2000 steps, while the second- and third-time training are set to 2500 steps. The third part is Android application development using Android Studio, which contains the features of the BIM letters and BIM word hand gestures, with the trained models converted into TensorFlow Lite. This feature also includes the conversion of speech to text, whereby this feature allows converting speech to text through the Android application. Thus, BIM letters obtain 99.75% accuracy after training the models, while BIM word hand gestures obtain 61.60% accuracy. The suggested system is validated as a result of these simulations and tests.

show abstract

“…The online courses and videos have a limitation where the youngsters are less interested. Currently, the mobile application for learning sign language has become a trend (Hafit et al, 2019), and it can be a great resource to a broader range of users. Mobile application is flexible because the learning process can be done at any time without pressure to complete it.…”

Section: Introductionmentioning

confidence: 99%

Enhancing Sign Language Learning with Augmented Reality

Ekhsan

Khairi

Hamid

2022

JCRINN

View full text Add to dashboard Cite

Sign language is the communication language used by people with disabilities, especially deaf and hearing-impaired people. The communication between normal and disabled people using sign language will help them carry out their daily activities. Unfortunately, normal people are not aware of the importance of sign language because they are not directly dealing with disabled persons. Besides, some normal people found that sign language is difficult to learn. This study focuses on developing a mobile application for sign language with augmented reality features. This application is targeted at normal people as a sign language learning tool, and augmented reality will make the learning process effective and exciting. The methodology for this study is the ADDIE model that consists of five phases, namely Analysis, Design, Development, Implementation, and Evaluation. This application will assist the users in learning sign language interactively and interestingly. The evaluation of the application was done by the expert in the related background and the normal people. The usability test result revealed that the sign language application is usable for normal people to know and learn the basic sign language. In conclusion, the sign language application is an interesting application for normal people to use and learn sign language.

show abstract

Malaysian Sign Language Mobile Learning Application : A recommendation app to communicate with hearing-impaired communities

Cited by 14 publications

References 5 publications

Exploring the Potential Usage of Mobile Technologies Among the Hearing-Impaired Students in Learning English as a Second Language (ESL)

Exploring the Potential Usage of Mobile Technologies Among the Hearing-Impaired Students in Learning English as a Second Language (ESL)

Interpretation of Bahasa Isyarat Malaysia (BIM) Using SSD-MobileNet-V2 FPNLite and COCO mAP

Enhancing Sign Language Learning with Augmented Reality

Contact Info

Product

Resources

About