Parallax-Robust Surveillance Video Stitching

He, Botao; Yu, Shaohua

doi:10.3390/s16010007

Cited by 39 publications

(23 citation statements)

References 35 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Compared with image stitching, video stitching is more difficult, due to the camera motion, dynamic foreground and large parallax. For static camera settings, such as multi-camera surveillance [15], [16], videos from different cameras are aligned only once, and the main challenge is to avoid ghosting and artifacts caused by moving objects. For moving cameras with relatively fixed positions, such as a camera array fixed on a rig [17], cameras can be pre-calibrated for global stitching of videos, and spatio-temporally coherent warping and minimizing distortion are the main challenges due to the motion and parallax.…”

Section: Related Workmentioning

confidence: 99%

Content-Preserving Image Stitching With Piecewise Rectangular Boundary Constraints

Yun

Lai

Zhang

2021

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

This paper proposes an approach to contentpreserving image stitching with regular boundary constraints, which aims to stitch multiple images to generate a panoramic image with regular boundary. Existing methods treat image stitching and rectangling as two separate steps, which may result in suboptimal results as the stitching process is not aware of the further warping needs for rectangling. We address these limitations by formulating image stitching with regular boundaries in a unified optimization. Starting from the initial stitching results produced by traditional warping-based optimization, we obtain the irregular boundary from the warped meshes by polygon Boolean operations which robustly handle arbitrary mesh compositions, and by analyzing the irregular boundary construct a piecewise rectangular boundary. Based on this, we further incorporate straight line preserving and regular boundary constraints into the image stitching framework, and conduct iterative optimization to obtain an optimal piecewise rectangular boundary, thus can make the boundary of stitching results as close as possible to a rectangle, while reducing unwanted distortions. We further extend our method to selfie expansion and video stitching, by integrating the portrait preservation and temporal coherence into the optimization. Experiments show that our method efficiently produces visually pleasing panoramas with regular boundaries and unnoticeable distortions.

show abstract

Section: Related Workmentioning

confidence: 99%

Content-Preserving Image Stitching With Piecewise Rectangular Boundary Constraints

Yun

Lai

Zhang

2021

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

show abstract

“…Some of these papers used seam-driven methods. He's [1] group proposed use of the seam selection method to avoid moving the object at every frame. Li [4] proposed a method of video stitching based structure deformation using double seams.…”

Section: Video Stitchingmentioning

confidence: 99%

“…Figure 3 shows the relationship between the CP and BC. The CP is a product of the CMs, as expressed in (1). The BC is…”

Section: Basic Theorymentioning

confidence: 99%

See 1 more Smart Citation

Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement

Yoon

Lee

2017

Symmetry

View full text Add to dashboard Cite

We propose a novel real-time video stitching method using camera path estimation and homography refinement. The method can stably stitch multiple frames acquired from moving cameras in real time. In the proposed method, one initial between-camera (BC) homography and each camera path (CP) homography are used to estimate the BC homography at every frame. The BC homography is refined by using block matching to adjust the errors of estimated CPs (homography refinement). For fast processing, we extract features using the difference of intensities and use the optical flow to estimate camera motion (CM) homographies, which are multiplied with the previous CMs to calculate CPs (camera path estimations). In experiments, we demonstrated the performance of the CP estimation and homography refinement approach by comparing it with other methods. The experimental results show that the proposed method can stably stitch two image sequences at a rate exceeding 13 fps (frames per second).

show abstract

“…Video surveillance over the Internet is a real-time service that applies to very varied environments (underwater [ 4 ], Smart City [ 5 , 6 , 7 ], and Ambient Assisted Living for Smart Home [ 8 , 9 , 10 ] among others). We focus on Smart Home video surveillance assisted by sensors.…”

Section: Introductionmentioning

confidence: 99%

Low Cost Efficient Deliverying Video Surveillance Service to Moving Guard for Smart Home

Gualotuña

Macías

Suárez

et al. 2018

Sensors

View full text Add to dashboard Cite

Low-cost video surveillance systems are attractive for Smart Home applications (especially in emerging economies). Those systems use the flexibility of the Internet of Things to operate the video camera only when an intrusion is detected. We are the only ones that focus on the design of protocols based on intelligent agents to communicate the video of an intrusion in real time to the guards by wireless or mobile networks. The goal is to communicate, in real time, the video to the guards who can be moving towards the smart home. However, this communication suffers from sporadic disruptions that difficults the control and drastically reduces user satisfaction and operativity of the system. In a novel way, we have designed a generic software architecture based on design patterns that can be adapted to any hardware in a simple way. The implanted hardware is of very low economic cost; the software frameworks are free. In the experimental tests we have shown that it is possible to communicate to the moving guard, intrusion notifications (by e-mail and by instant messaging), and the first video frames in less than 20 s. In addition, we automatically recovered the frames of video lost in the disruptions in a transparent way to the user, we supported vertical handover processes and we could save energy of the smartphone's battery. However, the most important thing was that the high satisfaction of the people who have used the system.

show abstract

Parallax-Robust Surveillance Video Stitching

Cited by 39 publications

References 35 publications

Content-Preserving Image Stitching With Piecewise Rectangular Boundary Constraints

Content-Preserving Image Stitching With Piecewise Rectangular Boundary Constraints

Real-Time Video Stitching Using Camera Path Estimation and Homography Refinement

Low Cost Efficient Deliverying Video Surveillance Service to Moving Guard for Smart Home

Contact Info

Product

Resources

About