Synchronization of Multiple Camera Videos Using Audio-Visual Features

Shrestha, Prarthana; Barbieri, M.; Weda, Hans; Sekulovski, Dragan

doi:10.1109/tmm.2009.2036285

Cited by 40 publications

(45 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Authors of [19] proposed a multilayered audiovisual streaming scheme to deliver layered audiovisual data synchronously, which is called ML-AVSS. Authors of [20] proposed an automated synchronization approach based on detecting and matching audio and video features extracted from the recorded content. These work has focused on the multimedia stream synchronization within the traditional and homogeneous networks.…”

Section: Audio/visual Synchronizationmentioning

confidence: 99%

Design and Implementation of Enhanced Surveillance Platform with Low-Power Wireless Audio Sensor Network

Zhao

Sun

et al. 2012

International Journal of Distributed Sensor Networks

View full text Add to dashboard Cite

Video surveillance system, which can provide real-time display of the monitored scene and video playback, has been employed in many areas including commercial security, accident investigation, law enforcement, and emergency response. However, audio which carries important information not available in video is usually not taken seriously and used effectively. In this paper, we develop an enhanced surveillance platform by organically integrating the low-power wireless audio sensor network (WASN) with the traditional visual surveillance network. We can obtain more comprehensive and precise monitoring without the limitation of the line-of-sight and lighting condition. Moreover, this platform is designed and built for providing key support to varieties of applications in wireless multimedia sensor networks. This paper describes the platform architecture, including design, implementation, and performance. We describe the hardware and software components of the audio/video sensors. Then, we present the multimedia synchronization mechanism in the heterogeneous network which is the foundation of applications in the proposed platform. Besides, we describe a sample application and data management mechanism that we have implemented to show the usefulness of our platform. Our experiments include an in-depth analysis of the bottlenecks within the platform as well as measurements for the various components.

show abstract

Section: Audio/visual Synchronizationmentioning

confidence: 99%

Design and Implementation of Enhanced Surveillance Platform with Low-Power Wireless Audio Sensor Network

Zhao

Sun

et al. 2012

International Journal of Distributed Sensor Networks

View full text Add to dashboard Cite

show abstract

“…For the special case of videos capturing a scene with active sound sources in sufficient quality, audio-based approaches can also be considered for synchronization, as for instance proposed in [8].…”

Section: Related Workmentioning

confidence: 99%

Video synchronization using bit rate profiles

Schroth

Schweiger

Eichhorn

et al. 2010

2010 IEEE International Conference on Image Processing

View full text Add to dashboard Cite

We present a novel approach for the temporal synchronization of multiple videos which is based on cross-correlating bit rate profiles. The proposed scheme determines the temporal offset without major restrictions on viewing angles, camera properties and camera motion. We propose two extensions of the basic algorithm which reduce the influence of camera motion and distracting background objects. Additionally, we describe how to optimally combine different bit rate components in order to further improve the reliability of the synchronization scheme. The proposed approach, when combined with the three extensions, leads to a reliable, robust, and frame accurate temporal alignment of videos at remarkably low complexity.

show abstract

“…We address this problem by exploiting a novel projective-invariant descriptor based on the cross ratio to obtain the matched trajectory points between the two input videos. So far, numerous video synchronization methods have been presented in the previous works, which are mainly classified into two categories: intensity-based ones [9][10][11][12][13] and feature-based ones [14][15][16][17][18][19][20][21][22][23][24][25][26][27][28][29]. The intensity-based methods usually rely on colors, intensities, or intensity gradients to achieve the temporal synchronization of overlapping videos.…”

Section: Introductionmentioning

confidence: 99%

Video Synchronization Based on Projective-Invariant Descriptor

Zhang

Yang

et al. 2018

Neural Process Lett

View full text Add to dashboard Cite

In this paper, we present a novel trajectory-based method to synchronize two videos shooting the same dynamic scene, which are recorded by stationary un-calibrated cameras from different viewpoints. The core algorithm is carried out in two steps: projective-invariant descriptor construction and trajectory points matching. In the first step, a new five-coplanar-points structure is proposed to compute the cross ratio during the construction of the projective-invariant descriptor. The five points include one trajectory point and four fixed points induced from the background scene, which are co-planar in the 3D coordinate. In the second step, the matched trajectory points are initially estimated by the primitive nearest neighbor method, and are further refined by using epipolar geometric constraints and post processing. Experimental results demonstrate that the proposed method significantly outperforms the existing state-of-the-arts. More importantly, the proposed method is more generic in the sense that it works well for those videos captured under different conditions, including different frame rates, wide baseline, multiple moving objects, planar or non-planar motion trajectories.

show abstract

Synchronization of Multiple Camera Videos Using Audio-Visual Features

Cited by 40 publications

References 14 publications

Design and Implementation of Enhanced Surveillance Platform with Low-Power Wireless Audio Sensor Network

Design and Implementation of Enhanced Surveillance Platform with Low-Power Wireless Audio Sensor Network

Video synchronization using bit rate profiles

Video Synchronization Based on Projective-Invariant Descriptor

Contact Info

Product

Resources

About