Evaluating Complementary Strengths and Weaknesses of ADAS Sensors

On-road behavior analysis is a crucial and challenging problem in the autonomous driving vision-based area. Several endeavors have been proposed to deal with different related tasks and it has gained wide attention recently. Much of the excitement about on-road behavior understanding has been the labor of advancement witnessed in the fields of computer vision, machine, and deep learning. Remarkable achievements have been made in the Road Behavior Understanding area over the last years. This paper reviews 100+ papers of on-road behavior analysis related work in the light of the milestones achieved, spanning over the last 2 decades. This review paper provides the first attempt to draw smart mobility researchers’ attention to the road behavior understanding field and its potential impact on road safety to the whole road agents such as: drivers, pedestrians, stuffs, etc. To push for an holistic understanding, we investigate the complementary relationships between different elementary tasks that we define as the main components of road behavior understanding to achieve a comprehensive understanding of approaches and techniques. For this, five related topics have been covered in this review, including situational awareness, driver-road interaction, road scene understanding, trajectories forecast, driving activities, and status analysis. This paper also reviews the contribution of deep learning approaches and makes an in-depth analysis of recent benchmarks as well, with a specific taxonomy that can help stakeholders in selecting their best-fit architecture. We also finally provide a comprehensive discussion leading us to identify novel research directions some of which have been implemented and validated in our current smart mobility research work. This paper presents the first survey of road behavior understanding-related work without overlap with existing reviews.

Section: Discussionunclassified

Section: Introductionmentioning

confidence: 99%

Recent Advances in Vision-Based On-Road Behaviors Understanding: A Critical Survey

Trabelsi

Khemmar

Decoux

et al. 2022

“…In particular, compared to radar, cameras perform less reliably under adverse weather conditions and at night. However, the camera is considered the most reliable perception sensor when it comes to object classification, lane detection, and traffic light recognition [10].…”

Section: Role Of Cameras In Adas/ad Functionsmentioning

confidence: 99%

Development and Experimental Validation of an Intelligent Camera Model for Automated Driving

Genser

Muckenhuber

Solmaz

et al. 2021

The virtual testing and validation of advanced driver assistance system and automated driving (ADAS/AD) functions require efficient and realistic perception sensor models. In particular, the limitations and measurement errors of real perception sensors need to be simulated realistically in order to generate useful sensor data for the ADAS/AD function under test. In this paper, a novel sensor modeling approach for automotive perception sensors is introduced. The novel approach combines kernel density estimation with regression modeling and puts the main focus on the position measurement errors. The modeling approach is designed for any automotive perception sensor that provides position estimations at the object level. To demonstrate and evaluate the new approach, a common state-of-the-art automotive camera (Mobileye 630) was considered. Both sensor measurements (Mobileye position estimations) and ground-truth data (DGPS positions of all attending vehicles) were collected during a large measurement campaign on a Hungarian highway to support the development and experimental validation of the new approach. The quality of the model was tested and compared to reference measurements, leading to a pointwise position error of 9.60% in the lateral and 1.57% in the longitudinal direction. Additionally, the modeling of the natural scattering of the sensor model output was satisfying. In particular, the deviations of the position measurements were well modeled with this approach.

“…Similarly, based on indoor experiments [ 164 ], the authors experimentally researched the effects of rain and showed that raindrops lead to an increase in the average intensity of the image and a decrease in contrast. The study presented in [ 165 ], develops an approach to quantifying the vulnerabilities of the camera, based on empirical measurements and the concluding results show that camera principal output loss occurs in lighting and precipitation, which is calculated to increase performance errors by 50 percent. The authors in [ 166 ], outlined that rainfall is visible only in the near-field and has the characteristics of fog when far away.…”

Section: Sensorsmentioning

confidence: 99%

The Perception System of Intelligent Ground Vehicles in All Weather Conditions: A Systematic Literature Review

Mohammed

Amamou

Ayevide

et al. 2020

Perception is a vital part of driving. Every year, the loss in visibility due to snow, fog, and rain causes serious accidents worldwide. Therefore, it is important to be aware of the impact of weather conditions on perception performance while driving on highways and urban traffic in all weather conditions. The goal of this paper is to provide a survey of sensing technologies used to detect the surrounding environment and obstacles during driving maneuvers in different weather conditions. Firstly, some important historical milestones are presented. Secondly, the state-of-the-art automated driving applications (adaptive cruise control, pedestrian collision avoidance, etc.) are introduced with a focus on all-weather activity. Thirdly, the most involved sensor technologies (radar, lidar, ultrasonic, camera, and far-infrared) employed by automated driving applications are studied. Furthermore, the difference between the current and expected states of performance is determined by the use of spider charts. As a result, a fusion perspective is proposed that can fill gaps and increase the robustness of the perception system.