Clearspeech: A Display Reader for the Visually Handicapped

Morris, Tim; Blenkhorn, Paul; Crossey, L.; Ngo, Quang; Ross, M.; Werner, Deb; Wong, Chun Yu

doi:10.1109/tnsre.2006.881538

Cited by 29 publications

(13 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For instance, the KNFB Reader [12] is a popular application for iOS that helps users frame text in the camera's view, and then reads text that is captured. Other systems have been built to help blind people recognize faces [18,19], identify products [14,18,19], count money notes [13,18], or read the LCD panels on appliances [7,16,24].…”

Section: Computer Vision For Accessibilitymentioning

confidence: 99%

Investigating Cursor-based Interactions to Support Non-Visual Exploration in the Real World

Guo

McVea

Wang

et al. 2018

Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

View full text Add to dashboard Cite

Figure 1. We define and compare cursor-based interactions that support non-visual attention to items within a complex visual scene: (a) window cursor, in which the user moves the device itself to scan the scene and receives information about what is in the center of the image; (b) vertical window cursor, a variation of window cursor that sacrifices the granularity on the vertical axis, but potentially facilitates locating the direction of a specific object; (c) finger cursor, in which the user moves their finger on the real world object they want to access and receives information about details near (or under) their fingertip; and (d) touch cursor, in which the visual scene is brought onto the device screen and the user moves their finger on the touchscreen to receive information about what they touch on the live camera image. ABSTRACTThe human visual system processes complex scenes to focus attention on relevant items. However, blind people cannot visually skim for an area of interest. Instead, they use a com bination of contextual information, knowledge of the spatial layout of their environment, and interactive scanning to find and attend to specific items. In this paper, we define and com pare three cursor-based interactions to help blind people attend to items in a complex visual scene: window cursor (move their phone to scan), finger cursor (point their finger to read), and touch cursor (drag their finger on the touchscreen to explore). We conducted a user study with 12 participants to evaluate the three techniques on four tasks, and found that: window cur sor worked well for locating objects on large surfaces, finger cursor worked well for accessing control panels, and touch cursor worked well for helping users understand spatial lay outs. A combination of multiple techniques will likely be best for supporting a variety of everyday tasks for blind users.

show abstract

Section: Computer Vision For Accessibilitymentioning

confidence: 99%

Investigating Cursor-based Interactions to Support Non-Visual Exploration in the Real World

Guo

McVea

Wang

et al. 2018

Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

View full text Add to dashboard Cite

show abstract

“…The main problems with these work is accessing the multilingual content. Tim Morris [22] and his team have reported on a prototype screen reader that is intended to vocalize the information displayed on the LCD or LED screen of home or office equipment. Tadayoshi Fujiki, 2006 [23], Developed a new tool easy bar to cater the needs of the visually handicapped users.…”

Section: Literature Surveymentioning

confidence: 99%

Development of an Agent Based Specialized Multi-Lingual Web Browser for Visually Handicapped

Ramalingam¹,

Babu²,

Chitralekha³

2014

INT J COMPUT COMMUN, Int. J. Comput. Commun. Control

View full text Add to dashboard Cite

Abstract:In the modern age everyone needs access to Internet; Visually handicapped are not an exception for that. SPECS (SPEcialized Computer System) is a system developed to give access to the visually handicapped. It has a Braille shell. The user can enter his spoken language. After the selection of the language the user can present his request to the browser through chosen language in Braille. The output generated by the browser is given out as voice message. The effectiveness of this system is measured based on number of requests processed, access speed and precision of the system.

show abstract

“…One past approach is the Clearspeech system [7], which runs on a desktop PC and requires that special markers be affixed around the borders of each LED/LCD display to guide the system to the location of the display characters. Our approach builds on [9] on a cell phone-based LED/LCD display reader, which requires no such modification of the display.…”

Section: Related Workmentioning

confidence: 99%

Real-time detection and reading of LED/LCD displays for visually impaired persons

Tekin

Coughlan

Shen

2011

2011 IEEE Workshop on Applications of Computer Vision (WACV)

View full text Add to dashboard Cite

Modern household appliances, such as microwave ovens and DVD players, increasingly require users to read an LED or LCD display to operate them, posing a severe obstacle for persons with blindness or visual impairment. While OCR-enabled devices are emerging to address the related problem of reading text in printed documents, they are not designed to tackle the challenge of finding and reading characters in appliance displays. Any system for reading these characters must address the challenge of first locating the characters among substantial amounts of background clutter; moreover, poor contrast and the abundance of specular highlights on the display surface – which degrade the image in an unpredictable way as the camera is moved – motivate the need for a system that processes images at a few frames per second, rather than forcing the user to take several photos, each of which can take seconds to acquire and process, until one is readable. We describe a novel system that acquires video, detects and reads LED/LCD characters in real time, reading them aloud to the user with synthesized speech. The system has been implemented on both a desktop and a cell phone. Experimental results are reported on videos of display images, demonstrating the feasibility of the system.

show abstract

Clearspeech: A Display Reader for the Visually Handicapped

Cited by 29 publications

References 3 publications

Investigating Cursor-based Interactions to Support Non-Visual Exploration in the Real World

Investigating Cursor-based Interactions to Support Non-Visual Exploration in the Real World

Development of an Agent Based Specialized Multi-Lingual Web Browser for Visually Handicapped

Real-time detection and reading of LED/LCD displays for visually impaired persons

Contact Info

Product

Resources

About