2018
DOI: 10.7554/elife.37841
|View full text |Cite
|
Sign up to set email alerts
|

Abstract: To restore vision for the blind, several prosthetic approaches have been explored that convey raw images to the brain. So far, these schemes all suffer from a lack of bandwidth. An alternate approach would restore vision at the cognitive level, bypassing the need to convey sensory data. A wearable computer captures video and other data, extracts important scene knowledge, and conveys that to the user in compact form. Here, we implement an intuitive user interface for such a device using augmented reality: each… Show more

Help me understand this report
View preprint versions

Search citation statements

Order By: Relevance

Paper Sections

Select...
3
2

Citation Types

2
27
0
1

Year Published

2019
2019
2023
2023

Publication Types

Select...
6
3

Relationship

0
9

Authors

Journals

citations
Cited by 41 publications
(30 citation statements)
references
References 35 publications
2
27
0
1
Order By: Relevance
“…A high acuity is necessary to solve complex visual tasks, e.g. face recognition, or navigating in complex environments (but see [4]). Several studies have suggested that expressing light sensitive proteins in ganglion cells could be an efficient way to restore vision [5][6][7][8][9][10], by stimulating these newly light-sensitive cells with patterned light to evoke visual perception.…”
Section: Introductionmentioning
confidence: 99%
“…A high acuity is necessary to solve complex visual tasks, e.g. face recognition, or navigating in complex environments (but see [4]). Several studies have suggested that expressing light sensitive proteins in ganglion cells could be an efficient way to restore vision [5][6][7][8][9][10], by stimulating these newly light-sensitive cells with patterned light to evoke visual perception.…”
Section: Introductionmentioning
confidence: 99%
“…For example, LiDAR sensors [54] provide high-precision object localization. Other devices such as HoloLense AR goggles and stereovision cameras also provide depth measurements [55].…”
Section: Discussionmentioning
confidence: 99%
“…It takes a few sentences for a verbal cue to describe a static scene. If the user is moving continuously, the voice prompt is unable to pass sufficient information in real time without hampering the user's mobility [48,55,60]. Moreover, it is hard to provide intuitive spatial information via descriptive sentences.…”
Section: Discussionmentioning
confidence: 99%
“…With the recent boom of technological advancements in cameras and headwear, many companies have been approaching the problem by combining augmented reality with headworn devices such as Glass (Google, Mountain View, CA) and HoloLens (Microsoft, Redmond, WA). [13][14][15][16][17] Aira (available in the public domain at https://aira.io/; Aira Tech Corporation, La Jolla, CA) uses on-demand augmented reality assistive wearable technology designed for the SVI but relies on human-human intelligence instead of computed artificial intelligence or unidirectional output as its method of assistance. The user wears glasses with a video camera mounted that, when activated, livestreams to an "agent" who assists the user in the specified task.…”
Section: Introductionmentioning
confidence: 99%