Research on Background Learning Correlation Filtering Algorithm With Multi-Feature Fusion

Abstract

Aiming at the problems of occlusion, drift, and background change in target tracking, a background learning correlation filtering algorithm based on multi-feature fusion is proposed. In the framework of correlation filtering, multi-feature fusion, multi-template update, and background learning regularization are used to improve the performance of the filter in the problem of template contamination and object occlusion. The fast directional gradient histogram (FHOG), color feature (CN), and texture feature (ULBP) were extracted, and the feature channels were connected in series. Then the depth features of Conv4-4 and Conv5-4 layers were extracted through the VGG-19 network, and the appearance model of the target was constructed. To reduce the sensitivity of the filter to the sudden change of background, a background learning filter is constructed, and the alternate direction multiplier method (ADMM) is used to speed up the calculation of the filter. In the model update stage, aiming at the problem of pollution of the original template caused by target occlusion, a high-confidence multi-template fusion update strategy is proposed by fusing the template with the highest confidence in the current frame, the previous frame, and the history frame. Finally, the proposed algorithm is tested on OTB50, OTB100, UAV123, and TC128 experimental data sets, and some classical and latest algorithms. The experimental results show that the tracking accuracy and robustness of the correlation filtering algorithm are improved.INDEX TERMS Target tracking, Machine vision, Correlation filtering, Background learning, More templates.