In the field of computer vision, the signal tracking of moving objects is a highly representative problem. Therefore, how to accurately and quickly track the target unit has become the focus of the research. Based on this, a Cam Shift algorithm improved by Kalman filtering algorithm is introduced to realize fast tracking of moving targets. This method uses the prediction function of the Kalman filter to predict the moving target of the next frame, transforms the global search problem into a local search problem, and improves the real-time performance. The experimental results show that, in the case of complete occlusion, the trajectory of the unimproved algorithm will deviate compared with the actual trajectory of the improved trajectory tracking curve, but the improved algorithm has no trajectory deviation. The error of the improved algorithm is about 4%, while the maximum error of the unimproved algorithm is about 90%. The improved algorithm reached the expected target accuracy after 110 and 78 trainings in X and Y coordinates, respectively, while the CamShift algorithm without Kalman filtering still failed to reach the expected error after 200 trainings in X and Y coordinates. This indicates that the performance of the improved CamShift algorithm based on Kalman filter has been greatly improved. In conclusion, the improved algorithm proposed in this study is highly practical.