Infrared Multi-Pedestrian Tracking in Vertical View via Siamese Convolution Network

Abstract

Target tracking has become one of the research hotspots in the field of computer vision in recent years. In this paper, a new intelligent algorithm of infrared multi-pedestrian tracking in vertical view is proposed. In the algorithm, the pedestrians in the infrared image can be quickly detected and located with the method of the Faster Regions with CNN features (RCNN) and then are tracked with the improved Siamese network. The tracking method based on Siamese network transforms the tracking problem into a similarity verification problem and evaluates the similarity score between new frame feature and target frame feature by convolution network. The candidate region with the highest score is considered as the current position of the target. In this paper, the Siamese network is combined with Faster RCNN for multi-pedestrian tracking. In addition, the tracking results of adjacent frames are introduced into the similarity evaluation of current frames to improve the tracking accuracy when the pedestrian posture changes. The experimental results show that the algorithm has good robustness and tracking result and achieves competitive performance. INDEX TERMS Computer vision, Siamese network, infrared detection, pedestrian tracking, convolution network.

ST-AFN: a spatial-temporal attention based fusion network for lane-level traffic flow prediction

“…Tong et al (2017) used taxi trajectory data to forecast taxi demand. Shen et al (2019) used Siamese CNN for multi-pedestrian tracking.…”

Classification of Infrared Objects in Manifold Space Using Kullback-Leibler Divergence of Gaussian Distributions of Image Points

“…Many different approaches have been proposed for infrared object tracking such as saliency extraction [9], multiscale patch-based contrast measure and a temporal variance filter [14], feature learning and fusion, reliability weight estimation based on nonnegative matrix factorization [15], Poisson reconstruction and the Dempster-Shafer theory [16], three-dimensional scalar field [17], a double-layer region proposal network (RPN) [18], Siamese convolution network [19], a mixture of Gaussians with modified flux density [20], spatial-temporal total variation regularization and weighted tensor [21], two-stage U-skip context aggregation network [22], histogram similarity map based on the Epanechnikov kernel function [23], quaternion discrete cosine transform [24], non-convex optimization [25], Mexican-hat distribution of pixels [26], and Schatten regularization with reweighted sparse enhancement [27].…”

PGA: An Efficient Adaptive Traffic Signal Timing Optimization Scheme Using Actor-Critic Reinforcement Learning Algorithm

“…It is of great importance to design and implement advanced signal timing scheme to reduce traffic congestion and pollution, and to achieve optimization and coordination of urban traffic. In recent decades, the blooming development of artificial intelligence makes the remarkable progress of modern intelligent transportation systems (ITS), e.g., intelligent signal control [1], big data analysis [2], [3], traffic flow prediction [4], pedestrian detection [5], etc.…”