Error concealment techniques for multi-view video

Micallef, Brian W.; Debono, Carl James

doi:10.1109/wd.2010.5657701

Cited by 13 publications

(14 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The temporal OBBMA and spatial WPAI algorithms proposed for 2D videos concealment can be exploited to recover the MVs and DVs of 3DV sequences inter‐frame errors. Unfortunately, they fail in case of heavy erroneous channel conditions, and therefore this will result in reducing the EC performance . Thus, in this work, an efficient temporal EC scheme named DTMCA is suggested, and also an effective inter‐view EC algorithm named DIECA is proposed to reconstruct the MVs and DVs of the lost MBs within inter‐frames, respectively.…”

Section: The Proposed 3d Video Error Correction Schemesmentioning

confidence: 99%

“…Unfortunately, they introduce more latency and raise the required transmission bit‐rate, because it is impossible to re‐transmit the whole lost or corrupted frames taking into consideration the restricted bandwidth and the delay limitations on real‐time video transmission. Thus, there is a need for post‐processing EC algorithms at the decoder . They exploit the advantage of inter‐view and intra‐view correlations inside the 3DV content to restore corrupted MBs or frames.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Performance evaluation of enhanced error correction algorithms for efficient wireless 3D video communication systems

El‐Shafai

El‐Rabaie

El-Halawany

et al. 2017

Int J Communication

View full text Add to dashboard Cite

Summary In the Three‐Dimensional Multi‐View Video (3D MVV) coding prediction structure, the coded bit‐streams may be dropped down due to error transmissions. So, it is compulsory to recover the corrupted Macro‐Blocks (MBs) at the decoder utilizing efficient Error Concealment (EC) post‐processing techniques. The EC methods exploit the temporal, inter‐view, and spatial matching among 3D MVV views and frames without any alterations in the encoder software or hardware or in the transmission rate. They retrieve the Disparity Vectors (DVs) and Motion Vectors (MVs) of the erroneous MBs. To enhance the received 3D MVV quality, we suggest several optimized schemes to reconstruct the lost and erroneous MBs of inter‐encoded and intra‐encoded frames. A hybrid method combining the Circular Scan Order Interpolation Algorithm (CSOIA) and Partitioning Motion Compensation Algorithm (PMCA) is proposed for intra‐frame EC. For inter‐corrupted MBs, a hybrid method comprising Directional Textural Motion Coherence Algorithm (DTMCA) and Directional Interpolation Error Concealment Algorithm (DIECA) is suggested. Experimental outcomes on several 3D MVV frames demonstrate that the suggested EC algorithms have more robustness to both heavily random and slice losses. They objectively and subjectively work better than the state‐of‐the‐art EC techniques. The proposed work achieves high 3D MVV quality with an improved average Peak Signal‐to‐Noise Ratio (PSNR) gain up to 2.45 to 4.55 dB compared with traditional EC algorithms at Packet Loss Rates (PLRs) of 40%.

show abstract

Section: The Proposed 3d Video Error Correction Schemesmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Performance evaluation of enhanced error correction algorithms for efficient wireless 3D video communication systems

El‐Shafai

El‐Rabaie

El-Halawany

et al. 2017

Int J Communication

View full text Add to dashboard Cite

show abstract

“…However, the anchor frames do not have temporal references but an inter-view dependency. Therefore, in this case, the disparity vectors of the macroblocks in the neighborhood of an erroneous one can be used for concealment using a technique which is similar to the temporal replacement one [20]. This uses a disparity vector list in which the best match needs to be found.…”

Section: à3mentioning

confidence: 99%

“…The boundary matching distortion error provides us with the measurement of similarity and is used as a means to determine whether the threshold was exceeded. If this error is larger than a predefined threshold, spatial concealment is applied [20].…”

Section: à3mentioning

confidence: 99%

Error Concealment Techniques in Multi-view Video Applications

Debono

Micallef

2013

3D Future Internet Media

View full text Add to dashboard Cite

The demand for immersive multimedia experiences is driving researchers and industry to develop solutions that capture, deliver, and display 3D video in an efficient way. The key to the success of this technology is the removal of redundant data through effective video coding and its transmission. One solution that can meet this coding requirement is Multi-view Video Coding (MVC). Besides the removal of spatial and temporal redundancies already used in legacy singleview video transmission, this scheme also considers the redundancies present in between views. Such redundancies exist since the different spatially separated capturing devices are shooting the same view. Removal of the latter significantly enhances the coding efficiency compared to encoding separately each view. This huge reduction in data to be transmitted comes at a price. Practical channels are not error-free, and thus, because of the dependencies generated during encoding, errors in the channel will result in artifacts in the video streams that will propagate in space, time, and views until the dependencies are interrupted. This demands solutions that allow the reconstruction of missing data at the receiver to guarantee a good quality of experience (QoE) which is paramount to the success of 3D video applications. To reduce the occurrence of erroneous data, the information transmitted needs to be protected using error control strategies. These will typically introduce some redundancies that infer knowledge on missing information such that it can be recovered. However, not all the erroneous data can be recovered requesting algorithms that can limit and estimate the missing information. The latter techniques are known as error resilience coding and error concealment methods, respectively, in which the error propagation is restricted and the missing content is estimated from the available information. This chapter will examine the effects of errors experienced during transmission of multi-view video content.

show abstract

“…There have been a few ER and EC approaches in recent years proposed for multi-view sequences [3]- [14]. In [3]- [7], they adopted EC methods to deal with macroblock(MB) loss by making use of the disparity extracted from the adjacent views as well as the motion vectors obtained from the previously decoded frame. A novel ER algorithm presented in [8] incorporates the disparity vectors of multi-view video coding to generate a redundant data stream, in order to achieve effective error recovery at the receiving end, while the redundant data affects the effective bandwidth allocated for the primary stream.…”

Section: Introductionmentioning

confidence: 99%

Similarity evaluation algorithm for concealing frame loss error in multi-view video transmission

Yao

2011

Proceedings of 2011 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing

View full text Add to dashboard Cite

An efficient error concealment algorithm for reconstructing the loss frame in multi-view video sequences at the decoder is presented. The proposed method has a capacity of adopting the appropriate error concealment mode to recover the loss frame according to its reference frames similarity level. There are three modes in the method. For a high similarity level, the mode using temporal related frame copy (FC) to recover the lost frame is employed. When the similarity level is low, the spatially related frame is copied. Adapting to the medium similarity condition, both the similar MBs in temporal frames and the matching MBs in spatial frames are used to reconstruct the loss frame. And block matching principle is employed for filling empty blocks. Experimental results have shown that the proposed multi-view video error concealment method can effectively reconstruct the lost frames and has more attractive performance than previous algorithms.

show abstract

Error concealment techniques for multi-view video

Cited by 13 publications

References 9 publications

Performance evaluation of enhanced error correction algorithms for efficient wireless 3D video communication systems

Performance evaluation of enhanced error correction algorithms for efficient wireless 3D video communication systems

Error Concealment Techniques in Multi-view Video Applications

Similarity evaluation algorithm for concealing frame loss error in multi-view video transmission

Contact Info

Product

Resources

About