Using an Augmented Reality Device as a Distance-based Vision Aid—Promise and Limitations

Abstract

SIGNIFICANCEFor people with limited vision, wearable displays hold the potential to digitally enhance visual function. As these display technologies advance, it is important to understand their promise and limitations as vision aids.PURPOSEThe aim of this study was to test the potential of a consumer augmented reality (AR) device for improving the functional vision of people with near-complete vision loss.METHODSAn AR application that translates spatial information into high-contrast visual patterns was developed. Two experiments assessed the efficacy of the application to improve vision: an exploratory study with four visually impaired participants and a main controlled study with participants with simulated vision loss (n = 48). In both studies, performance was tested on a range of visual tasks (identifying the location, pose and gesture of a person, identifying objects, and moving around in an unfamiliar space). Participants' accuracy and confidence were compared on these tasks with and without augmented vision, as well as their subjective responses about ease of mobility.RESULTSIn the main study, the AR application was associated with substantially improved accuracy and confidence in object recognition (all P < .001) and to a lesser degree in gesture recognition (P < .05). There was no significant change in performance on identifying body poses or in subjective assessments of mobility, as compared with a control group.CONCLUSIONSConsumer AR devices may soon be able to support applications that improve the functional vision of users for some tasks. In our study, both artificially impaired participants and participants with near-complete vision loss performed tasks that they could not do without the AR system. Current limitations in system performance and form factor, as well as the risk of overconfidence, will need to be overcome.

Ability of Head-Mounted Display Technology to Improve Mobility in People With Low Vision: A Systematic Review

“…Only 10 of the studies reviewed involved a quantitative assessment of mobility performance and of these, 8 of them [45][46][47][48][52][53][54]77 recorded a significant reduction in efficiency with vision enhancement. Of the other two studies, which observed similar or better efficiency, in both of them, 68,76 the mobility courses were relatively simple with large walkable areas and a small number of relatively large obstacles.…”

“…OSTs 45,60 are the most commonly used type of displays in AR environments as they allow users to see the real-world enhanced with virtual objects or holograms (e.g. Magic Leap, Microsoft HoloLens, Google Glass, and Epson Moverio BT-300).…”

“…By reducing visual clutter, users can focus on essential features, such as obstacles in the scene. Six studies, [45][46][47][48]53,65 summa-rized in Appendix Table A1, assessed the effect of scene simplification on mobility and mobility-related visual tasks.…”

A Parametric Perceptual Deficit Modeling and Diagnostics Framework for Retina Damage Using Mixed Reality

“…Current research indicates that there are a number of barriers that prevent the current technologies to provide each individual patient with specialized assistance in enhancing the remaining vision, [13]. For example, there is a need to systematically examine how acuity level and visual field loss is associated with specific eye conditions, and how to utilize this connection to deliver specialized visual aid.…”

Quality of Life Assessment of Severely Visually Impaired Individuals Using Aira Assistive Technology System

“…With the recent boom of technological advancements in cameras and headwear, many companies have been approaching the problem by combining augmented reality with headworn devices such as Glass (Google, Mountain View, CA) and HoloLens (Microsoft, Redmond, WA). [13][14][15][16][17] Aira (available in the public domain at https://aira.io/; Aira Tech Corporation, La Jolla, CA) uses on-demand augmented reality assistive wearable technology designed for the SVI but relies on human-human intelligence instead of computed artificial intelligence or unidirectional output as its method of assistance. The user wears glasses with a video camera mounted that, when activated, livestreams to an "agent" who assists the user in the specified task.…”