Bayesian Early Mode Decision Technique for View Synthesis Prediction-Enhanced Multiview Video Coding

Khattak, Shadan; Hamzaoui, Raouf; Maugey, Thomas; Ahmad, Shakeel; Frossard, Pascal

doi:10.1109/lsp.2013.2281607

Cited by 5 publications

(4 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It was found that using the proposed technique, over 33% of the encoding time can be reduced without a noticeable degradation in the RD performance. The results of this contribution were published in [35]. VSP modes are expected to be included in upcoming video coding standards such as 3D-AVC [49].…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Low-complexity multiview video coding

Khattak

Hamzaoui

Ahmad

et al. 2012

2012 Picture Coding Symposium

View full text Add to dashboard Cite

Abstract3D video is a technology that has seen a tremendous attention in the recent years. Multiview Video Coding (MVC) is an extension of the popular H.264 video coding standard and is commonly used to compress 3D videos. It offers an improvement of 20% to 50% in compression efficiency over simulcast encoding of multiview videos using the conventional H.264 video coding standard. However, there are two important problems associated with it: (i) its superior compression performance comes at the cost of significantly higher computational complexity which hampers the real-world realization of MVC encoder in applications such as 3D live broadcasting and interactive Free Viewpoint Television (FTV), and (ii) compressed 3D videos can suffer from packet loss during transmission, which can degrade the viewing quality of the 3D video at the decoder. This thesis aims to solve these problems by presenting techniques to reduce the computational complexity of the MVC encoder and by proposing a consistent error concealment technique for frame losses in 3D video transmission.The thesis first analyses the complexity of the MVC encoder. It then proposes two novel techniques to reduce the complexity of motion and disparity estimation. The first method achieves complexity reduction in the disparity estimation process by exploiting the relationship between temporal levels, type of macroblocks and search ranges while the second method achieves it by exploiting the geometrical relationship between motion and disparity vectors in stereo frames. These two methods are then combined with other state-of-the-art methods in a unique framework where gains add up. Experimental results show that the proposed low-complexity framework can reduce the encoding time of the standard MVC encoder by over 93% while maintaining similar compression efficiency performance.The addition of new View Synthesis Prediction (VSP) modes to the MVC encoding framework improve the compression efficiency of MVC. However, testing additional modes comes at the cost of increased encoding complexity. In order to reduce the encoding complexity, the thesis, next, proposes a bayesian early mode decision technique for a VSP enhanced MVC coder. It exploits the statistical similarities between the RD costs of the VSP SKIP mode in neighbouring views to terminate the mode decision process early. Results indicate that the proposed technique can reduce the encoding time of the enhanced MVC coder by over 33% at similar compression efficiency levels.Finally, compressed 3D videos are usually required to be broadcasted to a large number of users where transmission errors can lead to frame losses which can degrade the video quality at the decoder. A simple reconstruction of the lost frames can lead to inconsistent reconstruction of the 3D scene which may negatively affect the viewing experience of a user. In order to solve this problem, the thesis proposes, at the end, a consistency model for recovering frames lost during transmission. The proposed consistency model is used to evaluate...

show abstract

Section: Discussionmentioning

confidence: 99%

“…• An early mode decision method for View Synthesis Prediction mode enhanced multiview video coding [35]. The method exploits the bayesian decision rule to minimize the number of candidate modes checked during…”

Section: Contributions Of the Thesismentioning

confidence: 99%

Low-complexity multiview video coding

Khattak

Hamzaoui

Ahmad

et al. 2012

2012 Picture Coding Symposium

View full text Add to dashboard Cite

show abstract

“…By combining the MVC methods in [19][20][21] with PDV-DE, a novel complexity reduction technique can be derived. The correlation of rate distortion (RD) costs among inter-views in SKIP mode are studied and used to reduce the computational complexity of MVC in [23]. Khattak et al have used the correlation between the RD costs of the SKIP mode in neighboring views and Bayesian decision theory to reduce the number of candidate coding modes for a given MB [24].…”

Section: Introductionmentioning

confidence: 99%

Fast Encoder Design for Multi-view Video

2014

KSII TIIS

View full text Add to dashboard Cite

Multi-view video coding is an international encoding standard that attains good performance by fully utilizing temporal and inter-view correlations. However, it suffers from high computational complexity. This paper presents a fast encoder design to reduce the level of complexity. First, when the temporal correlation of a group of pictures is sufficiently strong, macroblock-based inter-view prediction is not employed for the non-anchor pictures of B-views. Second, when the disparity between two adjacent views is above some threshold, frame-based inter-view prediction is disabled. Third, inter-view prediction is not performed on boundary macroblocks in the auxiliary views, because the references for these blocks may not exist in neighboring views. Fourth, finer partitions of inter-view prediction are cancelled for macroblocks in static image areas. Finally, when estimating the disparity of a macroblock, the search range is adjusted according to the mode size distribution of the neighboring view. Compared with reference software, these techniques produce an average time reduction of 83.65%, while the bit-rate increase and peak signal-to-noise ratio loss are less than 0.54% and 0.05dB, respectively.

show abstract

“…Computer vision is a discipline that studies how to make computers "see" like humans. In detail, it uses cameras and computers to replace the human eye, enabling the computer to achieve the functions of segmenting, classifying, identifying, tracking, and discriminating decisions like the human visual system [2,3]. On the basis of image and signal processing technology, probability statistical analysis, computational geometry, and neural network technology, the computer and its related equipment carry out biological vision simulation [4], with the purpose of enabling it to recognize three-dimensional environmental information through two-dimensional images.…”

mentioning

confidence: 99%

Human Memory Update Strategy: A Multi-Layer Template Update Mechanism for Remote Visual Monitoring

Liu

Wang

Liu

et al. 2021

IEEE Trans. Multimedia

225

View full text Add to dashboard Cite

In the era of rapid development of artificial intelligence, the integration of multimedia and human-artificial intelligence (H-AI) has become an important research hotspot. Especially in the multimedia environment, effective remote visual monitoring has become the exploration direction of many scholars. The use of traditional filtering algorithm (CF) for real-time monitoring in the context of multimedia is a practical strategy. However, most existing filtering-based visual monitoring algorithms still have the problems of insufficient robustness and effectiveness. Therefore, by considering the strategy of updating human memory, this paper proposes a multi-layer template update mechanism to achieve effective monitoring in a multimedia environment. In this strategy, the weighted template of the high-confidence matching memory is used as the confidence memory, and the unweighted template of the low-confidence matching memory is used as the cognitive memory. Through the alternate use of confidence memory, matching memory, and cognitive memory, it is ensured that the target will not be lost during the monitoring process. Experimental result s show that this strategy does not affect the speed (still real-time) and improves the robustness in the multimedia background.

show abstract

Bayesian Early Mode Decision Technique for View Synthesis Prediction-Enhanced Multiview Video Coding

Cited by 5 publications

References 21 publications

Low-complexity multiview video coding

Low-complexity multiview video coding

Fast Encoder Design for Multi-view Video

Human Memory Update Strategy: A Multi-Layer Template Update Mechanism for Remote Visual Monitoring

Contact Info

Product

Resources

About