NAVIG: Guidance system for the visually impaired using virtual augmented reality

Abstract

Finding ones way to an unknown destination, navigating complex routes, finding inanimate objects; these are all tasks that can be challenging for the visually impaired. The project NAVIG (Navigation Assisted by artificial VIsion and GNSS) is directed towards increasing the autonomy of visually impaired users in known and unknown environments, exterior and interior, large scale and small scale, through a combination of a Global Navigation Satellite System (GNSS) and rapid visual recognition with which the precise position of the user can be determined. Relying on geographical databases and visually identified objects, the user is guided to his or her desired destination through spatialized semantic audio rendering, always maintained in the head-centered reference frame. This paper presents the overall project design and architecture of the NAVIG system. In addition, details of the new type of detection and localization device are presented in relation to guidance directives developed through participative design with potential users and educators for the visually impaired. A fundamental concept in this project is the belief that this type of assistive device is able to solve one of the major problems faced by the visually impaired: their difficulty in localizing specific objects.

Navigation and space perception assistance for the visually impaired: The NAVIG project

“…Using a high performance 3D audio rendering engine [27], a particular sonification strategy has been developed for different objects and events. Through a newly developed concept of sonic morphology, termed morphocons (morphological earcons), different users can chose the type of sounds they prefer, while the basic syntax remains the same across individual sound palettes [14].…”

“…Thus, designing an assistive device for VI people requires taking into account the perceptual specificities of these individuals together with the problems they usually face, and the specific needs the device should respond to. In order to achieve these goals, the CESDV-IJA was actively involved in the ergonomic experiments and prototype evaluations ( [14] for further details on the participatory design phases).…”

“…• data used for more accurate navigation and space perception [14]; • data used for user positioning (visual reference points).…”

“…In 2010, the NAVIG system was presented [13], with additional details in [14]. The specific objectives of the NAVIG project were multiple: analyzing the behavior and the needs of VI pedestrians during navigation tasks, improving global positioning to make it compatible with guidance for the VI, developing embedded vision for both micro-and macroguidance, designing non visual feedback output based on audio augmented reality and evaluating a functional prototype in challenging situations.…”

Object recognition for blind people based on features extraction

“…In fact, since the 1970s, systems based on video camera have evolved considerably, making new tools for visual substitution. Devices for the visually impaired [1], [2], [3], [4], [5], [6], [7], [8] often using the idea of sensory substitution, are based on the conversion of own stimulus to a sensory modality : vision, hearing, touch and smell into another own sense stimuli. In addition, the majority of existing systems are aids of mobility and obstacle detection.…”