Integration of Image Stabilizer with Video Codec for Digital Video Cameras

Abstract

Electronic image stabilizer and video codec are two important components of a digital video camera. Both require motion information of the captured image sequence to perform their respective tasks. Since motion estimation is a computationally intensive operation, we propose three schemes for integrating the electronic image stabilizer with the video codec. The technical issues involved in the integration are discussed, and the simulation results are shown to illustrate the effectiveness of the integration schemes. I.

Adapting the Streaming Video Based on the Estimated Position of the Region of Interest

“…The frames are held in the buffer for reconstruction to the pixels that are outside the ROI. Linear interpolation [21] will be perform to reconstruct the dropped pixels (non-ROI) from the reference frames to return the frames to their original resolution, as shown in Fig. 9(b).…”

Digital video stabilizer by adaptive fuzzy filtering

“…When such cameras are hand held or mounted on unstable platforms, the captured video generally looks shaky because of undesired camera motions. Unwanted video vibrations would lead to degraded view experience and also greatly affect the performances of applications such as video encoding [1][2][3][4] and video surveillance [5,6]. With recent advances in wireless technology, video stabilization systems are also considered for integration into wireless video communication equipments for the stabilization of acquired sequences before transmission, not only to improve visual quality but also to increase the compression performance [1].…”

“…Since both the video encoder and the digital stabilizer of a digital video camera use a ME unit, we can integrate digital stabilizer with video encoder [2,4,26] by making the two modules of a digital video camera share a common local motion vectors (LMVs) estimation process, as shown in Figure 1. The ME task in video encoders usually is implemented on frame blocks by a block matching process to estimate anMV for each block (BMV).…”