Performance evaluation of enhanced error correction algorithms for efficient wireless 3D video communication systems

Abstract

Summary In the Three‐Dimensional Multi‐View Video (3D MVV) coding prediction structure, the coded bit‐streams may be dropped down due to error transmissions. So, it is compulsory to recover the corrupted Macro‐Blocks (MBs) at the decoder utilizing efficient Error Concealment (EC) post‐processing techniques. The EC methods exploit the temporal, inter‐view, and spatial matching among 3D MVV views and frames without any alterations in the encoder software or hardware or in the transmission rate. They retrieve the Disparity Vectors (DVs) and Motion Vectors (MVs) of the erroneous MBs. To enhance the received 3D MVV quality, we suggest several optimized schemes to reconstruct the lost and erroneous MBs of inter‐encoded and intra‐encoded frames. A hybrid method combining the Circular Scan Order Interpolation Algorithm (CSOIA) and Partitioning Motion Compensation Algorithm (PMCA) is proposed for intra‐frame EC. For inter‐corrupted MBs, a hybrid method comprising Directional Textural Motion Coherence Algorithm (DTMCA) and Directional Interpolation Error Concealment Algorithm (DIECA) is suggested. Experimental outcomes on several 3D MVV frames demonstrate that the suggested EC algorithms have more robustness to both heavily random and slice losses. They objectively and subjectively work better than the state‐of‐the‐art EC techniques. The proposed work achieves high 3D MVV quality with an improved average Peak Signal‐to‐Noise Ratio (PSNR) gain up to 2.45 to 4.55 dB compared with traditional EC algorithms at Packet Loss Rates (PLRs) of 40%.

Proposed dynamic error control techniques for QoS improvement of wireless 3D video transmission

“…To emphasize the effectiveness of the proposed error control techniques in this paper, further simulation tests have been implemented to compare the outcomes of the suggested hybrid ER‐EC‐WOBMDC techniques with the other techniques (EC/WOBMDC/No‐ER, EC/ER/No‐WOBMDC, and EC/No‐ER/No‐WOBMDC) and our suggested EC techniques in El‐Shafai et al The comparisons have been performed with the ballroom, exit, and objects2 3D streams with the same simulation parameters used in all above tests at QP = 37 and different PLRs. Table shows the average PSNR values of the proposed hybrid ER‐EC‐WOBMDC techniques compared to the other error control techniques.…”

“…Table shows the average frame execution time values of the suggested ER‐EC‐WOBMDC techniques compared to other techniques (EC/WOBMDC/No‐ER, EC/ER/No‐WOBMDC, and EC/No‐ER/No‐WOBMDC) and our proposed EC work in El‐Shafai et al for the used 3D videos at PLR = 40% and QPs = 27, 32, and 37. All simulation comparison tests have been carried out using an Intel® Core™i7‐4500U CPU at 1.80 GHz and 2.40 GHz with 8 GB RAM and running with Windows 10 64‐bit operating system.…”

“…Both the proposed ER and WOBMDC techniques are used to assist the suggested EC techniques at the decoder side to accurately reconstruct the erroneous frames and MBs. Moreover, the proposed EC techniques in adopted only the faulty frame and view types, and they are not adapted to different size modes of the faulty MB. So, they were operated only on the case of 8 × 8 lost MBs.…”

“…The EC techniques suggested to preserve 1D or 2D videos against communication faults may be exploited to recover lost 3DV MBs. It is foreseeable that they will operate more effective in recovering the 3D video frames with losses because of the trait of the inter‐view matching . In this paper, we suggest improved joint adaptive ER‐EC techniques for 3DV transmission over wireless networks.…”

“…It is foreseeable that they will operate more effective in recovering the 3D video frames with losses because of the trait of the inter-view matching. [9][10][11][12][13][14] In this paper, we suggest improved joint adaptive ER-EC techniques for 3DV transmission over wireless networks. At the encoder side, the context adaptive variable length coding (CAVLC) entropy, slice structured coding (SSC) modes, and explicit flexible macroblock ordering (EFMO) mapping are used.…”