The necessary measures to ensure the safety of technical structures, freight/passenger stations and other transport infrastructure facilities include continuous video monitoring with a comprehensive analysis of the scene. In conditions of high density of numerous objects continuously moving through the observation area, one of the main available signs of detecting anomalies in their behavior is their trajectory of the object. In this paper, we propose an approach to building a system for analyzing the behavior of dynamic video surveillance objects based on their tracking, implemented by means of cognitive modeling. The proposed procedures for intelligent analysis of the nature of movement of video surveillance objects are based on a combination of neural network technologies and the logical inference mechanism of the expert system, which expands the basic algorithms for technical equipment of video surveillance systems. The practical significance of the considered solutions is to increase the efficiency of detecting suspicious situations in conditions of high traffic density by conducting a parallel analysis of the movement of numerous objects of the scene, which entails the prevention of possible illegal actions in places of mass presence of people, including transport infrastructure facilities.