A Deep-Learning-Based Vehicle Detection Approach for Insufficient and Nighttime Illumination Conditions

Abstract

Most object detection models cannot achieve satisfactory performance under nighttime and other insufficient illumination conditions, which may be due to the collection of data sets and typical labeling conventions. Public data sets collected for object detection are usually photographed with sufficient ambient lighting. However, their labeling conventions typically focus on clear objects and ignore blurry and occluded objects. Consequently, the detection performance levels of traditional vehicle detection techniques are limited in nighttime environments without sufficient illumination. When objects occupy a small number of pixels and the existence of crucial features is infrequent, traditional convolutional neural networks (CNNs) may suffer from serious information loss due to the fixed number of convolutional operations. This study presents solutions for data collection and the labeling convention of nighttime data to handle various types of situations, including in-vehicle detection. Moreover, the study proposes a specifically optimized system based on the Faster region-based CNN model. The system has a processing speed of 16 frames per second for 500 × 375-pixel images, and it achieved a mean average precision (mAP) of 0.8497 in our validation segment involving urban nighttime and extremely inadequate lighting conditions. The experimental results demonstrated that our proposed methods can achieve high detection performance in various nighttime environments, such as urban nighttime conditions with insufficient illumination, and extremely dark conditions with nearly no lighting. The proposed system outperforms original methods that have an mAP value of approximately 0.2.

Moving Object Detection from Moving Camera Image Sequences Using an Inertial Measurement Unit Sensor

“…Yazdi and Bouwmans [20] compared various moving object detection methods with a focus on the case of a moving camera. Some studies utilized training techniques to detect objects from video [21][22][23]. Zhang et al used a structural feature to construct a shape model to detect objects [24].…”

Detection of Road Objects With Small Appearance in Images for Autonomous Driving in Various Traffic Situations Using a Deep Learning Based Approach

“…Their methods significantly outperformed the original SSD detection model. Leung et al modified the faster region-based CNN model to detect vehicles in nighttime and insufficient illumination conditions [21]. The experimental results demonstrated that the proposed method could achieve high detection accuracy in various illumination conditions.…”

A Real-Time Vehicle Detection System under Various Bad Weather Conditions Based on a Deep Learning Model without Retraining

“…Another approach for this issue is to collect specific data to retrain the deep learning model. Leung et al [ 25 ] collected nighttime images by themselves and labeled all of them to develop a nighttime vehicle dataset. With the dataset, they trained the neural network and obtained a model that achieved the purpose of detecting vehicles with multiple classes.…”