Perception Assistance for the Visually Impaired Through Smart Objects: Concept, Implementation, and Experiment Scenario

Connier, Jean; Zhou, Haijiang; Vaulx, Christophe de; Li, Jian-Jin; Shi, Hongling; Vaslin, Philippe; Hou, Kun Mean

doi:10.1109/access.2020.2976543

Cited by 12 publications

(9 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The accessible research has been minimal in the last few years, but there is a recent uptrend. By analysing the significant studies from 2016 to 2020 1 , we find that the recent hike is attributed to deep learning. This work provides insight into the following: Redesigning the graphs to improve perception.…”

Section: Contributionsmentioning

confidence: 99%

“…According to World health Organisation (WHO), at least 2.2 billion people have a vision impairment or blind-ness, of whom at least 1 billion have a vision impairment that could have been prevented or has yet to be addressed. Connier et al in 2020 [1] discusses the various applications of smart objects for assisting the visually impaired people and they claim that though there is an increasing number of smart devices, little work is done to make use of these resources to the VIP. SeeingAI [111] is an app by Microsoft which helps them to read the bar code of products, identify currency and also describe a scene in front of him/her.…”

Section: Applications and Future Directionsmentioning

confidence: 99%

“…Visually disabled persons have access to information by touch or voice. Connier et al [1] discusses the incorporation of different assistive technology devices into the Internet of Things (IoT). A new model is introduced, linking an AT device with Smart Objects and their cloud to enhance VIP's perception.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Towards Assisting the Visually Impaired: A Review on Techniques for Decoding the Visual Data From Chart Images

Shahira

Lijiya

2021

IEEE Access

View full text Add to dashboard Cite

The textual data of a document is supplemented by the graphical information in it. To make communication easier, they contain tables, charts and images. However, it excludes a section of our population -the visually impaired. With technological advancements, the blind can access the documents through text to speech software solutions. In this method, even images can be conveyed by reading out the figure captions. However, charts and other statistical comparisons which involve critical information are difficult to be "read" out this way. Aim of this paper is to analyse various methods available to solve this vexatious issue. We survey the state-of-the-art works that do the exact opposite of graphing tools. In this paper, we explore the existing literature in understanding the graphs and extracting the visual encoding from them. We classify these approaches into modality-based approaches, conventional and deep-learning based methods. The survey also contains comparisons and analyses relevant study datasets. As an outcome of this survey, we observe that: (i) All existing works under each category need decoding in a variety of graphs. (ii) Among the approaches, deep learning performs remarkably well in localisation and classification. However, it needs further improvements in reasoning from chart images. (iii) Research works are still in progress to access data from vector images. Recreating data from the raster images has unresolved issues. Based on this study, the various applications of decoding the graphs, challenges and future possibilities are also discussed. This paper explores current works in the extraction of chart data, which seek to enable researchers in Human Computer Interaction to achieve human-level perception of visual data by machines. In this era of visual summarisation of data, the AI approaches can automate the underlying data extraction and hence provide the natural language descriptions to support visually disabled users.

show abstract

Section: Contributionsmentioning

confidence: 99%

Section: Applications and Future Directionsmentioning

confidence: 99%

See 1 more Smart Citation

Towards Assisting the Visually Impaired: A Review on Techniques for Decoding the Visual Data From Chart Images

Shahira

Lijiya

2021

IEEE Access

View full text Add to dashboard Cite

show abstract

“…Authors in 36 proposed a smart assistance system by utilizing the progress of smart objects (SOs). The SO2SEES system is designed to act as interface between user and the neighboring smart objects.…”

Section: Major Problem Statementmentioning

confidence: 99%

Multi-obstacle aware smart navigation system for visually impaired people in fog connected IoT-cloud environment

Mueen

Awedh

Zafar

2022

Health Informatics J

View full text Add to dashboard Cite

Design of smart navigation for visually impaired/blind people is a hindering task. Existing researchers analyzed it in either indoor or outdoor environment and also it’s failed to focus on optimum route selection, latency minimization and multi-obstacle presence. In order to overcome these challenges and to provide precise assistance to visually impaired people, this paper proposes smart navigation system for visually impaired people based on both image and sensor outputs of the smart wearable. The proposed approach involves the upcoming processes: (i) the input query of the visually impaired people (users) is improved by the query processor in order to achieve accurate assistance. (ii) The safest route from source to destination is provided by implementing Environment aware Bald Eagle Search Optimization algorithm in which multiple routes are identified and classified into three different classes from which the safest route is suggested to the users. (iii) The concept of fog computing is leveraged and the optimal fog node is selected in order to minimize the latency. The fog node selection is executed by using Nearest Grey Absolute Decision Making Algorithm based on multiple parameters. (iv) The retrieval of relevant information is performed by means of computing Euclidean distance between the reference and database information. (v) The multi-obstacle detection is carried out by YOLOv3 Tiny in which both the static and dynamic obstacles are classified into small, medium and large obstacles. (vi) The decision upon navigation is provided by implementing Adaptive Asynchronous Advantage Actor-Critic (A3C) algorithm based on fusion of both image and sensor outputs. (vii) Management of heterogeneous is carried out by predicting and pruning the fault data in the sensor output by minimum distance based extended kalman filter for better accuracy and clustering the similar information by implementing Spatial-Temporal Optics Clustering Algorithm to reduce complexity. The proposed model is implemented in NS 3.26 and the results proved that it outperforms other existing works in terms of obstacle detection and task completion time.

show abstract

“…An innovative blind stick that allows visually challenged people to navigate with ease using advanced technology is proposed in this work. Safety features with GSM Module to help the guardian of the visually aided people to track their location [6][7][8]. This is designed in a way of receiving an SMS about the location to their phone if the person is lost somewhere else or is in a panic situation.…”

Section: Introductionmentioning

confidence: 99%

Performance Analysis of Smart Stick Designed for Visually Impaired People Using GSM and GPS

Priya¹,

Raj²,

Siva³

et al. 2021

AJEAT

View full text Add to dashboard Cite

Visual impairment burdens the people heavily in today’s fast-moving culture. Although there are several measures for this impairment, many people skip such chances in fear of their economic condition. In view of helping those people, a sophisticated stick is designed using sensors like ultrasonic sensor, IR sensor and Arduino ICs. Electronically designed walking stick helps to trace the locations using GPS module and to avoid collisions through detection of objects at a certain range of distance from the person in all directions. Sensor placed beneath the bottom of the stick enables the identification of pits/hindrances on the ground. The visually impaired person will be alerted with a voice message generated using the voice recorder which records the response of all the sensors operating in different tracks. In this paper, GSM and sensors together have initiated the role of smart walking stick in the life of several human kinds.

show abstract

Perception Assistance for the Visually Impaired Through Smart Objects: Concept, Implementation, and Experiment Scenario

Cited by 12 publications

References 25 publications

Towards Assisting the Visually Impaired: A Review on Techniques for Decoding the Visual Data From Chart Images

Towards Assisting the Visually Impaired: A Review on Techniques for Decoding the Visual Data From Chart Images

Multi-obstacle aware smart navigation system for visually impaired people in fog connected IoT-cloud environment

Performance Analysis of Smart Stick Designed for Visually Impaired People Using GSM and GPS

Contact Info

Product

Resources

About