Integration of Digital Stabilizer With Video Codec for Digital Video Cameras

An integrated architecture for adaptive image stabilization in zooming operation

“…While digital zooming entails complex image interpolation algorithms, the undesirable effect of increased latency is observed in the output sequence, especially in case of a concurrent use of image stabilization. Approaches for reducing the computational burden have been proposed in [38] and [9], where the stabilizer is integrated in video codec. The integration is performed using the motion vectors already calculated within the stabilizer or the encoder.…”

“…The cascading architecture in Fig. 3, found in most implementations [9], [14], shows that the stabilization and zooming are performed serial in the image signal processing module and the video encoder module, respectively. The data in the latency column of Table I, show that the total latency of the zoomed and stabilized sequence is higher than that of the only stabilized or only digitally zoomed sequence.…”

“…Following motion estimation, the motion compensation unit generates the compensating motion vector and shifts the current picking window according to the compensating motion vector to obtain a smoother image sequence. Motion compensation can take up 10% of the total computation of a digital stabilizer [9]. Various algorithms have been developed to estimate the local motion vectors, such as representative point matching [6], edge pattern matching [10], block matching [7] and bit plane matching [5].…”

Digital video stabilizer by adaptive fuzzy filtering

“…When such cameras are hand held or mounted on unstable platforms, the captured video generally looks shaky because of undesired camera motions. Unwanted video vibrations would lead to degraded view experience and also greatly affect the performances of applications such as video encoding [1][2][3][4] and video surveillance [5,6]. With recent advances in wireless technology, video stabilization systems are also considered for integration into wireless video communication equipments for the stabilization of acquired sequences before transmission, not only to improve visual quality but also to increase the compression performance [1].…”

“…Since both the video encoder and the digital stabilizer of a digital video camera use a ME unit, we can integrate digital stabilizer with video encoder [2,4,26] by making the two modules of a digital video camera share a common local motion vectors (LMVs) estimation process, as shown in Figure 1. The ME task in video encoders usually is implemented on frame blocks by a block matching process to estimate anMV for each block (BMV).…”