Temporal and Inter-View Consistent Error Concealment Technique for Multiview Plus Depth Video

Abstract

Abstract-Multiview plus depth (MVD) is an emerging video format with many applications, including 3D television and free viewpoint television. During broadcast of compressed MVD video, transmission errors may cause the loss of whole frames, resulting in significant degradation of video quality. Error concealment techniques have been widely used to deal with transmission errors in video communication. However, the existing solutions do not address the requirement that the reconstructed frames be consistent with neighbouring frames, i.e., corresponding pixels have consistent color information. We propose a new consistency model for error concealment of MVD video that allows to maintain a high level of consistency between frames of the same view (temporal consistency) and those of neighbouring views (inter-view consistency). We then propose an algorithm that uses our model to implement concealment in a consistent way. Simulations with the reference software for the Multiview Video Coding project of the Joint Video Team (JVT) of the ISO/IEC MPEG and ITU-T VCEG show that our method outperforms benchmark techniques, including a baseline approach based on the Boundary Matching Algorithm, with respect to both reconstruction quality and view consistency.

Performance evaluation of enhanced error correction algorithms for efficient wireless 3D video communication systems

“…Unfortunately, they introduce more latency and raise the required transmission bit‐rate, because it is impossible to re‐transmit the whole lost or corrupted frames taking into consideration the restricted bandwidth and the delay limitations on real‐time video transmission. Thus, there is a need for post‐processing EC algorithms at the decoder . They exploit the advantage of inter‐view and intra‐view correlations inside the 3DV content to restore corrupted MBs or frames.…”

“…Thus, there is a need for post-processing EC algorithms at the decoder. [18][19][20][21][22][23][24] They exploit the advantage of inter-view and intra-view correlations inside the 3DV content to restore corrupted MBs or frames. They have the utility of decreasing the channel erasures without growing the latency or requesting any complicated encoder modifications.…”

Proposed dynamic error control techniques for QoS improvement of wireless 3D video transmission

“…The EC techniques suggested to preserve 1D or 2D videos against communication faults may be exploited to recover lost 3DV MBs. It is foreseeable that they will operate more effective in recovering the 3D video frames with losses because of the trait of the inter‐view matching . In this paper, we suggest improved joint adaptive ER‐EC techniques for 3DV transmission over wireless networks.…”

“…It is foreseeable that they will operate more effective in recovering the 3D video frames with losses because of the trait of the inter-view matching. [9][10][11][12][13][14] In this paper, we suggest improved joint adaptive ER-EC techniques for 3DV transmission over wireless networks. At the encoder side, the context adaptive variable length coding (CAVLC) entropy, slice structured coding (SSC) modes, and explicit flexible macroblock ordering (EFMO) mapping are used.…”

Disparity-based Error Concealment for Stereoscopic Images with Superpixel Segment

“…The error concealment scheme includes a temporal AR model for independent view, and a temporal-interview AR model for inter-view predicted view. Shadan et al [6] proposed a new consistency model for error concealment of multi-view plus depth (MVD) video that allows the model to maintain a high level of consistency between frames of the same view (temporal consistency) and those of neighboring views (inter-view consistency). Then they used their model to implement concealment in a consistent manner.…”