Deep Learning-Based Object Detection and Classification for Autonomous Vehicles in Different Weather Scenarios of Quebec, Canada

Abstract

The rapid development of self-driving vehicles requires integrating a sophisticated sensing system to address the various obstacles posed by road traffic efficiently. While several datasets are available to support object detection in autonomous vehicles, it is crucial to carefully evaluate the suitability of these datasets for different weather conditions across the globe. In response to this requirement, we present a novel dataset named the Canadian Vehicle Datasets (CVD). Subsequently, we present deep learning models that use this dataset. The CVD comprises street-level videos which were recorded by Thales, Canada. These videos were collected with high-quality cameras mounted on a vehicle in the Canadian province of Quebec. The recordings were made during daytime and nighttime, capturing weather conditions such as hazy, snowy, rainy, gloomy, nighttime and sunny days. A total of 10000 images of vehicles and other road assets are extracted from the collected videos. A total of 8388 images were annotated with corresponding generated labels 27766 with their respective 11 different classes. We analyzed the performance of the YOLOv8 model trained using the existing RoboFlow dataset. Then, we compared it with the model trained on the expanded version of RoboFlow using the proposed weather-specific dataset, CVD. Final values of improved accuracy of 73.26 %, 72.84 %, and 73.47 % (Precision/Recall/mAP) were reported upon adding the proposed dataset. Finally, the model trained on this diverse dataset exhibits heightened robustness and proves highly beneficial for both autonomous and conventional vehicle operations, making it applicable not only in Canada but also in other countries with comparable weather conditions.