Thermal Infrared Single-Pedestrian Tracking for Advanced Driver Assistance System

Abstract

Tracking algorithms with low computational complexity and reliable performance are important in developing advanced driver assistance systems (DAS). This paper proposes a method of single-pedestrian tracking using thermal infrared cameras to meet the needs of DAS operating in nighttime and lowvisibility conditions. The proposed algorithm uses the background-aware correlation filter (BACF) as the basic tracking framework. In order to address the problem that directly introducing the convolutional features leads to tracking performance degradation in the BACF framework, this paper proposes a fusion scheme to integrate handcrafted and convolutional features to make full use of the advantages of both the features. The proposed scheme combines response maps from convolutional and handcrafted features through fusion coefficients to improve the performance of the trackers based on the single features. In order to calculate fusion coefficients, a novel approach of searching the main peak and interference peaks of a response map is proposed by using local binary pattern values of the response map to locate all local maximum points. Experimental results show that the proposed algorithm outperforms the existing 9 competing tracking algorithms and can be used in vehicle platforms as a module of DAS to improve the safe level of driving in nighttime.

Low-Light Enhancer for UAV Night Tracking Based on Zero-DCE++

“…The importance of nighttime target tracking research has been increasingly recognized, but the majority of previous studies have attempted to solve this issue by altering the data source. For example, complex sensors such as infrared cameras [18], low-light cameras [19], and event cameras [20] were used to acquire images. Some scholars have made efforts to solve the night tracking problem from the visible light perspective.…”

TIR‐YOLO‐ADAS: A thermal infrared object detection framework for advanced driver assistance systems

“…However, compared with colour images taken by RGB sensors, TIR images have clear disadvantages, such as low resolution, low signal-to-noise ratio, lack of texture and colour information, and blurred edges. These shortcomings increase the difficulty of achieving autonomous image understanding in an ADAS [6]. Kukkala et al indicated that object detection is a major part of vision-based ADAS [7].…”