Detector–Tracker Integration Framework for Autonomous Vehicles Pedestrian Tracking

Abstract

Pedestrian tracking is an important aspect of autonomous vehicles environment perception in a vehicle running environment. The performance of the existing pedestrian tracking algorithms is limited by the complex traffic environment, the changeable appearance characteristics of pedestrians and the frequent occlusion interaction, which leads to the insufficient accuracy and stability of tracking. Therefore, this paper proposes a detector–tracker integration framework for autonomous vehicle pedestrian tracking. Firstly, a pedestrian objects detector based on the improved YOLOv7 network was established. Space-to-Depth convolution layer was adopted to improve the backbone network of YOLOv7. Then, a novel appearance feature extraction network is proposed, which integrates the convolutional structural re-parameterization idea to construct a full-scale feature extraction block, which is the optimized DeepSORT tracker. Finally, experiments were carried out on MOT17 and MOT20 public datasets and driving video sequences, and the tracking performance of the proposed framework was evaluated by comparing it with the most advanced multi-object tracking algorithms. Quantitative analysis results show that the framework has high tracking accuracy. Compared with DeepSORT, MOTA improves by 2.3% in the MOT17 dataset and MOTA improves by 4.2% in the MOT20 dataset. Through qualitative evaluation on real driving video sequences, the framework proposed in this paper is robust in a variety of climate environments, and can be effectively applied to the pedestrian tracking of autonomous vehicles.

Robust pedestrian multi-object tracking in the intelligent bus environment

“…The introduction of pedestrian multi-object tracking algorithms provides crucial support for the safety and robustness of intelligent bus, making it not only a 'hotspot' in academic research but also a 'high demand' in practical applications [6]. Pedestrian multi-object tracking algorithms can track pedestrians over time, and predict future trajectories to avoid collisions [7].…”

An Enhanced Detector for Vulnerable Road Users Using Infrastructure-Sensors-Enabled Device

“…In more detail, Nikhil et al [ 13 ] used the YOLO algorithm to detect triple riding and speed violations on two-wheelers. Wang et al [ 14 ] developed a cohesive framework for both detection and tracking, facilitating precise pedestrian detection. Chandan et al [ 15 ] presented a fast and efficient approach to VRU detection and pose estimation for real-time AD applications.…”