With the rapid development of intelligent vehicles and Advanced Driver-Assistance Systems (ADAS), a new trend is that mixed levels of human driver engagements will be involved in the transportation system. Therefore, necessary visual guidance for drivers is vitally important under this situation to prevent potential risks. To advance the development of visual guidance systems, we introduce a novel vision-cloud data fusion methodology, integrating camera image and Digital Twin information from the cloud to help intelligent vehicles make better decisions. Target vehicle bounding box is drawn and matched with the help of the object detector (running on the ego-vehicle) and position information (received from the cloud). The best matching result, a 79.2% accuracy under 0.7 intersection over union threshold, is obtained with depth images served as an additional feature source. A case study on lane change prediction is conducted to show the effectiveness of the proposed data fusion methodology. In the case study, a multi-layer perceptron algorithm is proposed with modified lane change prediction approaches. Human-in-the-loop simulation results obtained from the Unity game engine reveal that the proposed model can improve highway driving performance significantly in terms of safety, comfort, and environmental sustainability.
Intelligent vehicles and Advanced Driver Assistance Systems (ADAS) are being developed rapidly over the past few years. Many applications such as vehicle localization, environment perception, and path planning have shown promising potentialities. While there is great interest in migrating from complete human-controlled vehicles towards fully autonomous vehicles, it is natural that researchers spending more effort trying to understand the interaction between vehicles with various levels of automation in large-scale traffic scenarios. Next-generation vehicles are expected to have the capacity of evaluating driver conditions, vehicle capabilities, surrounding traffic contexts, and take advantage of such knowledge to ensure safe and efficient driving. Three general research questions are raised to achieve this goal, which are (i) how can we acquire sufficient data, (ii) how to evaluate and understand driving behavior, and (iii) how to deliver information effectively to drivers. In this article, we present a review of previous studies from the UTDrive project attempts to answer above questions.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.