Real-time Video Processing by a Car-mounted Camera and Its Application to Car Navigation Systems by an Augmented Reality-based Display Method

Abstract

We propose a car navigation system using an Augmented Reality (AR) technique that consists in (I) taking a real-time video using an equipped camera on front of the vehicle, (II) extracting road geometry information from the video by a Computer Vision technique, (III) modeling three-dimensional Computer Graphics (3D-CG) by a CG technique, and (IV) overlaying the 3D-CG into the real-time video. There are two advantages in our system. One is the reduction in cost to model detailed 3D-CG data by collecting and analyzing road geometry information in real-time. The other is to improve high instantaneous visibility in car navigation display by an AR technique. The result of the investigation of comparing an ordinary display method with our display method for availability for car navigation is that 85% of 100 examinees have preferred our display method instead of the ordinary 3D-CG display method. The challenges and future works of the proposed method simple AR system are described by the experimental result of an implementation in prototype phase and a simulation of our method. :

A Study and Evaluation on Route Guidance of a Car Navigation System Based on Augmented Reality

“…Sawano et al describes how they showed test subjects some simulated video footage for intersection guidance, which was generated by using augmented reality technology, and guidance displayed by conventional CG-Navi. From comparisons by questionnaire, they found that the display of generated video footage was easier to understand [5]. The research done by Sawano et al evaluated the ease of understanding of information presented by car navigation systems that used augmented reality technology, which is the same as in our research.…”

Smart sensing and mobility analysis for improved transportation efficiency

“…So far, the AR technique has been used in many fields, such as game [76], medicine [57], education [67], user interface [83], etc. [82] proposed a method to accelerate the rendering process in a head-mounted-display (HMD). Researchers also employ AR-based indoor tour system on smart phones [46].…”

“…Some researchers combine the real world video with expensive computer graphical models to provide AR navigation information [82]. Different from these works, we propose a mobile-…”