Fast Mode Decision Algorithm Through Inter-View Rate-Distortion Prediction for Multiview Video Coding System

Abstract

Multiview video coding (MVC) has attracted great attention from industries and research institutes. MVC is used to encode stereoscopic video streams for 3D playout systems such as 3D television, digital cinema, and IP network applications. MVC is an extended version of H.264/AVC that improves the performance of multiview videos. Yet, when compared with single-view video coding, MVC consumes much more time when encoding large amounts of data. Speed-up algorithms, therefore, are essential for realizing related applications. This paper presents a fast mode decision algorithm to avoid the high computational complexity of MVC. The proposed approach aims to reduce candidate modes and make mode decision process more efficient. The minimum and maximum values of rate-distortion cost (RD cost) in the previously encoded view are used to compute a threshold for each mode in the current view. Compared with joint multiview video coding, the experimental results demonstrate that the proposed algorithm provides an average of 79% in time savings with negligible bit rate increase and peak signal-to-noise ratio decrease. Index Terms-Joint multivew video coding (JMVC), mode decision, multiple sensors, multiview video coding (MVC), rate-distortion (RD) cost, threshold. I. INTRODUCTION M ULTIPLE camera sense and three-dimensional (3D) video are the advancement in camera and display technology [1], [2]. Many applications such as intelligent video surveillance system require multiple cameras [3]-[6]. Because of the limited sources in sensor nodes, data must be encoded into multiview coding signals, which are available for storage to display as 3D videos such as 3D television (3DTV) and free viewpoint video [7]-[10]. Multiview video coding Manuscript

Improved depth coding for HEVC focusing on depth edge approximation

“…Although the encoding time saving of the PDCM is lower than the state-of-the-art methods presented in [36], [38], [39], and [40], the PDCM outperforms all these methods in terms of both improving the BD-PSNR i.e. +0.10dB and reducing the BD-BR i.e.…”

“…On the other hand, Lei's method performs almost similar to JMVC 8.5 where they only sacrifice on average 0.01dB BD-PSNR decrement and 0.34% BD-BR increment, while the average computational time saving is 77.56% [40]. Compared to the approaches of Yeh [39] or Lei [40], the proposed technique achieves lower percentage of encoding time savings for those four sequences (31.25%) against the HM15.0 as shown in Fig. 12.…”

“…Compared to the original H.264 JMVC encoder, they reduce on average 80.2% of average encoding time with peak signal-to-noise ratio (PSNR) loss of 0.08dB and the average bitrate increment of 0.60%. To speed-up the mode decision process, Yeh et al [39] attempt to reduce candidate modes by analyzing the RD cost of previously encoded view and determining a threshold for each of the modes in the current view. Compared to the JMVC 4.0, their simulation results reveal a reduction of 76.65% average encoding time by sacrificing 0.07dB PSNR and increasing 0.26% bit-rates.…”

“…14. The technique adopted by Yeh et al [39] sacrifice on average 0.10dB BD-PSNR and increases 2.66% BD-BR. These values go up to 0.23dB and 6.66% respectively for the Poznan_Street sequence.…”

Predictive Texture Synthesis-Based Intra Coding Scheme for Advanced Video Coding

“…Hence, High Efficiency Video Coding (HEVC) [2] developed by the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG) aims to save 50% bitrate when compared to H.264/AVC. HEVC uses a quadtree-based block coding structure, more advanced prediction techniques [3], transformation techniques [4], and post-processing filters to enhance the compression efficiency and reduce the bit rate of video streams.…”