Looking-In and Looking-Out of a Vehicle: Computer-Vision-Based Enhanced Vehicle Safety

Abstract

Abstract-This paper presents investigations into the role of computer-vision technology in developing safer automobiles. We consider vision systems, which cannot only look out of the vehicle to detect and track roads and avoid hitting obstacles or pedestrians but simultaneously look inside the vehicle to monitor the attentiveness of the driver and even predict her intentions. In this paper, a systems-oriented framework for developing computervision technology for safer automobiles is presented. We will consider three main components of the system: environment, vehicle, and driver. We will discuss various issues and ideas for developing models for these main components as well as activities associated with the complex task of safe driving. This paper includes a discussion of novel sensory systems and algorithms for capturing not only the dynamic surround information of the vehicle but also the state, intent, and activity patterns of drivers.

Vision-Based Lane Analysis: Exploration of Issues and Approaches for Embedded Realization

“…Reliable and trustworthy driver assistance systems require accurate and efficient means for capturing states of vehicle surroundings, vehicle dynamics as well as state of the driver in a holistic manner [12].…”

“…lane estimation and tracking, aids in localizing the ego-vehicle motion, which is the one of the very first and primary steps in most IDAS like lane departure warning (LDW), lane change assistance etc. [12,7]. Next, lane analysis is also shown to aid other vehicle surround analysis modules.…”

“…For example in [10] lanes are used to detect vehicles more robustly because vehicles are assumed to be localized to their ego lanes. Similarly lane detection is shown to play a significant role in predicting driver intentions before lane changes occur [12,7] etc.…”

Pedal error prediction by driver foot gesture analysis: A vision-based inquiry

“…In the long run, the foot behavior analysis should also be combined with driver behavior analysis at different levels (e.g. driver posture, head, and hand) [21] as well as other looking-in, looking-out information to develop holistic driver assistance systems [22] and improve the lives of drivers around the world.…”

Developing and Validating a Simulation Model for Counting and Classification of Vehicles

“…Some of the applications of video base surveillance include vehicle tracking, counting the number of vehicles, calculating vehicle velocity, finding vehicle trajectory, classifying the vehicles, estimating the traffic density, finding the traffic flow, license plate recognition, etc. (Puan et al 2014) and (Trivedi et al 2007). Tracking is the process of measurements obtained from a target in order to maintain an estimate of its current state.…”