Object interaction-based surveillance video synopsis

Zhang, Yunzuo; Tingting, Zheng

doi:10.1007/s10489-022-03477-5

Cited by 7 publications

(1 citation statement)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Moussa and Shoitan 16 defined two types of object relations, parallel and intersecting and added an object relation-based energy cost term to preserve interaction. Yunzuo and Tingting 17 considered the direction of the object as a factor for determining the interaction. The direction of object entry and exit within the video surveillance region was used as a reference point to determine object interactions.…”

Section: Related Workmentioning

confidence: 99%

Video synopsis method based on interaction determination using human pose estimation

Wang,

Yang,

Wang

et al. 2024

J. Electron. Imag.

View full text Add to dashboard Cite

Video synopsis aims to condense long videos containing temporal redundancy into a more compact form by rearranging the active objects in the video. However, since each object in the video belongs to a different tube, moving the objects during the tube rearrangement process may disrupt the interaction relationship between the objects. To address this issue, we proposed a video synopsis optimization method based on interaction determination using human pose estimation. First, the inverse perspective mapping method is used to calculate the distance between objects from a bird's-eye view. Then the body orientation is determined using the coordinates of human skeletal points obtained from the human pose estimation model. These two pieces of information are then combined to determine the interactions between objects. Second, the interaction energy cost term is introduced. By penalizing the cost term, the interactions between objects in the original video are preserved in the synopsis video. Finally, we propose a fusion optimization algorithm (FSOSA) that combines snake optimization and simulated annealing. FSOSA aims to minimize the energy cost function and achieve optimal tube rearrangement. Experimental results demonstrate that the proposed method effectively preserves the interactions between objects while improving the convergence speed.

show abstract

Section: Related Workmentioning

confidence: 99%