IoT based Assistive Device for Deaf, Dumb and Blind People

Karmel, A.; Sharma, Aastha; pandya, Muktak; Garg, Diksha

doi:10.1016/j.procs.2020.01.080

Cited by 46 publications

(10 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Karmal et al designed an application for blind, deaf, and dumb people that takes images, audio, and text through the customized keyboard as an input. Feedback to the user is provided in the form of voice and text [33] [34].…”

Section: Braille Input Mechanismmentioning

confidence: 99%

Deep learning scheme for character prediction with position-free touch screen-based Braille input method

Shokat

Riaz

Rizvi

et al. 2020

Hum. Cent. Comput. Inf. Sci.

View full text Add to dashboard Cite

Smart devices are effective in helping people with impairments, overcome their disabilities, and improve their living standards. Braille is a popular method used for communication by visually impaired people. Touch screen smart devices can be used to take Braille input and instantaneously convert it into a natural language. Most of these schemes require location-specific input that is difficult for visually impaired users. In this study, a position-free accessible touchscreen-based Braille input algorithm is designed and implemented for visually impaired people. It aims to place the least burden on the user, who is only required to tap those dots that are needed for a specific character. The user has input English Braille Grade 1 data (a–z) using a newly designed application. A total dataset comprised of 1258 images was collected. The classification was performed using deep learning techniques, out of which 70%–30% was used for training and validation purposes. The proposed method was thoroughly evaluated on a dataset collected from visually impaired people using Deep Learning (DL) techniques. The results obtained from deep learning techniques are compared with classical machine learning techniques like Naïve Bayes (NB), Decision Trees (DT), SVM, and KNN. We divided the multi-class into two categories, i.e., Category-A (a–m) and Category-B (n–z). The performance was evaluated using Sensitivity, Specificity, Positive Predicted Value (PPV), Negative Predicted Value (NPV), False Positive Rate (FPV), Total Accuracy (TA), and Area under the Curve (AUC). GoogLeNet Model, followed by the Sequential model, SVM, DT, KNN, and NB achieved the highest performance. The results prove that the proposed Braille input method for touch screen devices is more effective and that the deep learning method can predict the user's input with high accuracy.

show abstract

Section: Braille Input Mechanismmentioning

confidence: 99%

Deep learning scheme for character prediction with position-free touch screen-based Braille input method

Shokat

Riaz

Rizvi

et al. 2020

Hum. Cent. Comput. Inf. Sci.

View full text Add to dashboard Cite

show abstract

“…IoT based systems are presented in studies that provide communication assistance to the disabled people who are dumb deaf and blind for communication with normal people. Systems use sign language to speech conversion [47,48], similarly text to audio/speech for blind and image to test to audio conversion [49] . Framework proposed in [50] aids the disable for surround feel by converting the voice from the environment into text using IoT and ML for deaf people to know what's happening.…”

Section: E Assistive Technology For the Disabledmentioning

confidence: 99%

Internet of Things for Industrial Workspace and 4 Other Fields-Key Technologies and Applications

Bander Al Rayaan,

Abdullah H Alshehri

2022

IJEAST

View full text Add to dashboard Cite

— IoT along with sensors holds a great potential for providing cutting edge solutions for innovative services in. Assistive technology for disabled, Independent living for Elderly, Industrial workspace, Mobility and Automotive Industry. In a typical IoT based system, smart sensor nodes or devices collect large amount of data for processing, and communicate with each other using transmission link for exchange of data and providing innovative services. In context to the current stance of IoT, IoT evolution, different technologies and applications of IoT for these domains are systematically accessed in this paper using the published literature. After the rigorous review, challenges that exist in the domains are also highlighted along with future direction for the researchers to evaluate current standing of IoT and to improve or contribute to these applications.

show abstract

“…Karmel, Sharma, and Garg [4] developed a single device solution that was simple, quick, accurate, and costeffective. The device's major goal was to help differently abled persons feel self-sufficient and confident by seeing, hearing, and speaking for them.…”

Section: Literature Reviewmentioning

confidence: 99%

An Assistance System for Deaf, Dumb, Blind, and Learning Disability Individuals

Patel¹

2022

IJSREM

View full text Add to dashboard Cite

There is always some kind of barrier to impaired individuals in performing daily chores. It is difficult for them to perform and carry out even the simplest of tasks with ease. Whether it may be reading, writing, communicating, or studying, it becomes an impossible job for them to execute. Systems are separately designed for people with different types of impairments, but there lacks a system that can solve all problems as a whole. The purpose of our research work is to create one single system which is able solve all issues for deaf, dumb, blind, and learning disability individuals, which is not only simple to use but also provides accurate results. By using the developed system, people with different disabilities can perform simple daily activities with much ease than before. The developed system, which is a website, helps impaired individuals to read, write, communicate, etc. through various application programming interfaces (APIs). Key Words: Assistance system, application programming interface, deaf, dumb, blind, learning disability

show abstract

IoT based Assistive Device for Deaf, Dumb and Blind People

Cited by 46 publications

References 6 publications

Deep learning scheme for character prediction with position-free touch screen-based Braille input method

Deep learning scheme for character prediction with position-free touch screen-based Braille input method

Internet of Things for Industrial Workspace and 4 Other Fields-Key Technologies and Applications

An Assistance System for Deaf, Dumb, Blind, and Learning Disability Individuals

Contact Info

Product

Resources

About