Let’s Talk: An Assistive Mobile Technology for Hearing and Speech Impaired Persons

Seebun, Girisha Reeya; Nagowah, Leckraj

doi:10.1109/elecom49001.2020.9297026

Cited by 7 publications

(5 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…One type of technology that helps with voice and speech disorders is the STT service. Such services help in maintaining a satisfactory conversation between people living with such disabilities, by capturing their voice and transcribing it into written text that can be read by another person (Seebun and Nagowah, 2020 ). A form of such disability is also the Functional Speech Disorder (FSD), which is the inability to correctly learn to pronounce specific sounds, such as “s, z, r, l, and th”.…”

Section: Ai Technologies That Support Communication and Learning Assi...mentioning

confidence: 99%

“…Study by Itagi et al ( 2019 ) shows how Random Forest Classifier performs better than other algorithms, such as, Fuzzy Decision Tree and Logistic Regression, when detecting and correcting in real-time FSD cases. These services benefit from the Natural Language Processing (NLP) applied in the STT, which utilizes Google Speech API to convert spoken words into text (Seebun and Nagowah, 2020 ).…”

Section: Ai Technologies That Support Communication and Learning Assi...mentioning

confidence: 99%

See 1 more Smart Citation

Cutting-edge communication and learning assistive technologies for disabled children: An artificial intelligence perspective

Zdravkova

Krasniqi²,

Dalipi³

et al. 2022

Front. Artif. Intell.

View full text Add to dashboard Cite

In this study we provide an in-depth review and analysis of the impact of artificial intelligence (AI) components and solutions that support the development of cutting-edge assistive technologies for children with special needs. Various disabilities are addressed and the most recent assistive technologies that enhance communication and education of disabled children, as well as the AI technologies that have enabled their development, are presented. The paper summarizes with an AI perspective on future assistive technologies and ethical concerns arising from the use of such cutting-edge communication and learning technologies for children with disabilities.

show abstract

Section: Ai Technologies That Support Communication and Learning Assi...mentioning

confidence: 99%

Section: Ai Technologies That Support Communication and Learning Assi...mentioning

confidence: 99%

Cutting-edge communication and learning assistive technologies for disabled children: An artificial intelligence perspective

Zdravkova

Krasniqi²,

Dalipi³

et al. 2022

Front. Artif. Intell.

View full text Add to dashboard Cite

show abstract

“…This inquiry delves into the profound alterations witnessed in social interactions, educational paradigms, entertainment mediums, and modern workplace dynamics [21], recognizing the difficulties and technical developments associated with incorporating NLP into Metaverse platforms. Lastly, the integration's ethical, cultural, and societal ramifications will be evaluated by examining how it affects language relationships and digital socializing in an increasingly interconnected world [22].…”

Section: Introductionmentioning

confidence: 99%

Natural Language Processing Influence on Digital Socialization and Linguistic Interactions in the Integration of the Metaverse in Regular Social Life

Sumon,

Uddin,

Akter

et al. 2024

Electronics

View full text Add to dashboard Cite

The Metaverse and Natural Language Processing (NLP) technologies have combined to fundamentally change the nature of digital sociability. Our understanding of social interaction needs to be reevaluated as the Metaverse’s influence spreads into more areas of daily life, such as AI-driven gaming, interactive training companions, museum exhibits, personalized fitness coaching, virtual mental health assistance, language translation services, virtual tour guiding, and virtual conferencing. This study analyzes how NLP is changing social relationships in these Metaverse applications. We examine how NLP algorithms influence societal norms, individual behaviors, interpersonal connections, and improve the user experience using a multi-method approach incorporating user surveys and sentiment analysis. Our study’s findings show how NLP can enhance interactive experiences while also pointing out related issues like potential bias and moral problems. Our study provides a foundational analysis, shedding light on the challenges of negotiating a social environment in the Metaverse that is molded by cutting-edge NLP. It offers stakeholders in academia and public policy essential assistance that helps them understand and manage the complex ramifications of this changing socio-technological paradigm.

show abstract

“…Today, there are many applications available for deaf/mute individuals to communicate with non-deaf/mute individuals. Despite all the benefits of state-of-the-art technology, each application has certain limitations [23,24], and there are fewer BIM mobile translation applications on the market [7]. This is because BIM is little known amongst Malaysians, and existing sign language translation platforms are inefficient, not to mention the incomplete functionality of existing mobile translation applications on the market [16].…”

Section: Introductionmentioning

confidence: 99%

“…This is because BIM is little known amongst Malaysians, and existing sign language translation platforms are inefficient, not to mention the incomplete functionality of existing mobile translation applications on the market [16]. Therefore, people with hearing and speech disabilities cannot fully benefit from them [24]. The main challenge in this study is the availability of a recognisable character database.…”

Section: Introductionmentioning

confidence: 99%

Interpretation of Bahasa Isyarat Malaysia (BIM) Using SSD-MobileNet-V2 FPNLite and COCO mAP

et al. 2023

View full text Add to dashboard Cite

This research proposes a study on two-way communication between deaf/mute and normal people using an Android application. Despite advancements in technology, there is still a lack of mobile applications that facilitate two-way communication between deaf/mute and normal people, especially by using Bahasa Isyarat Malaysia (BIM). This project consists of three parts: First, we use BIM letters, which enables the recognition of BIM letters and BIM combined letters to form a word. In this part, a MobileNet pre-trained model is implemented to train the model with a total of 87,000 images for 29 classes, with a 10% test size and a 90% training size. The second part is BIM word hand gestures, which consists of five classes that are trained with the SSD-MobileNet-V2 FPNLite 320 × 320 pre-trained model with a speed of 22 s/frame rate and COCO mAP of 22.2, with a total of 500 images for all five classes and first-time training set to 2000 steps, while the second- and third-time training are set to 2500 steps. The third part is Android application development using Android Studio, which contains the features of the BIM letters and BIM word hand gestures, with the trained models converted into TensorFlow Lite. This feature also includes the conversion of speech to text, whereby this feature allows converting speech to text through the Android application. Thus, BIM letters obtain 99.75% accuracy after training the models, while BIM word hand gestures obtain 61.60% accuracy. The suggested system is validated as a result of these simulations and tests.

show abstract

Let’s Talk: An Assistive Mobile Technology for Hearing and Speech Impaired Persons

Cited by 7 publications

References 12 publications

Cutting-edge communication and learning assistive technologies for disabled children: An artificial intelligence perspective

Cutting-edge communication and learning assistive technologies for disabled children: An artificial intelligence perspective

Natural Language Processing Influence on Digital Socialization and Linguistic Interactions in the Integration of the Metaverse in Regular Social Life

Interpretation of Bahasa Isyarat Malaysia (BIM) Using SSD-MobileNet-V2 FPNLite and COCO mAP

Contact Info

Product

Resources

About