Assistive device for the blind based on object recognition

Parlouar, Rémi; Dramas, Florian; Macé, Marc M-J; Jouffrais, Christophe

doi:10.1145/1639642.1639688

Cited by 28 publications

(12 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…A working prototype of this system has been tested on the issue of currency bill recognition. Experiments have demonstrated that the usability of the system was good enough for such a device to be used in daily situations [29].…”

Section: The Navig Prototype Preliminary Evaluations and Future Workmentioning

confidence: 99%

Navigation and space perception assistance for the visually impaired: The NAVIG project

Kammoun¹,

Parseihian²,

Gutierrez³

et al. 2012

IRBM

View full text Add to dashboard Cite

Section: The Navig Prototype Preliminary Evaluations and Future Workmentioning

confidence: 99%

Navigation and space perception assistance for the visually impaired: The NAVIG project

Kammoun¹,

Parseihian²,

Gutierrez³

et al. 2012

IRBM

View full text Add to dashboard Cite

“…These are real problems for the blind and highlight the need to decipher some visual information, such as color, form, or text. As a use case of similar objects identification, Parlouar et al 13 designed a SpikeNet-based currency bill reader that met the interest of many blind people who evaluated it.…”

Section: Identifying Similar Objectsmentioning

confidence: 99%

Artificial Vision for the Blind: A Bio-Inspired Algorithm for Objects and Obstacles Detection

Dramas

Thorpe

Jouffrais

2010

Int. J. Image Grap.

Self Cite

View full text Add to dashboard Cite

Although artificial vision systems could potentially provide very useful input to assistive devices for blind people, such devices are rarely used outside of laboratory experiments. Many current systems attempt to reproduce the visual image via an alternative sensory modality (often auditory or somatosensory), but this dominant "scoreboard" approach, is often difficult to interpret for the user. Here, we propose to offload the recognition problem onto a separate image processing system that then provides the user with just the essential information about the location of objects in the surrounding environment. Specifically, we show that a bio-inspired image processing algorithm (SpikeNet) can not only robustly, precisely, and rapidly recognize and locate key objects in the image, but also in space if the objects are in a stereoscopic field of view. In addition, the bio-inspired algorithm allows real-time calculation of optic flow. We hence propose that this system, coupled with a restitution interface allowing localization in space (i.e. three-dimensional virtual sounds synthesis) can be used to restore essential visuomotor behaviors such as grasping desired objects and navigating (finding directions, avoiding obstacles) in unknown environments.

show abstract

“…Finally, assistive devices or software on the market solving this issue has been limited and usually very expensive. In [2,4,5] researchers have attempted to use specific and specialized techniques for locating and identifying certain regions or the actual numbers on bills. However, any such specialized techniques can be fragile and hard to port from one type of currency to another.…”

Section: Introductionmentioning

confidence: 99%

Recognizing currency bills using a mobile phone

Paisios

Rubinsteyn

Vyas

et al. 2011

Proceedings of the 24th Annual ACM Symposium Adjunct on User Interface Software and Technology

View full text Add to dashboard Cite

Despite the rapidly increasing use of credit cards and other electronic forms of payment, cash is still widely used for everyday transactions due to its convenience, perceived security and anonymity. However, the visually impaired might have a hard time telling each paper bill apart, since, for example, all dollar bills have the exact same size and, in general, currency bills around the world are not distinguishable by any tactile markings. We propose the use of a broadly available tool, the camera of a smart-phone, and an adaptation of the SIFT algorithm to recognize partial and even distorted images of paper bills. Our algorithm improves memory efficiency and the speed of SIFT key-point classification by using a k-means clustering approach. Our results show that our system can be used in real-world scenarios to recognize unknown bills with a high accuracy.

show abstract

Assistive device for the blind based on object recognition

Cited by 28 publications

References 2 publications

Navigation and space perception assistance for the visually impaired: The NAVIG project

Navigation and space perception assistance for the visually impaired: The NAVIG project

Artificial Vision for the Blind: A Bio-Inspired Algorithm for Objects and Obstacles Detection

Recognizing currency bills using a mobile phone

Contact Info

Product

Resources

About