Performance analysis of VVC intra coding

Saldanha, Mário; Sanchez, Gustavo; Marcon, César; Agostini, Luciano

doi:10.1016/j.jvcir.2021.103202

Cited by 14 publications

(6 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The Multiple Reference Line (MRL) extends the number of lines and columns from neighbor blocks that can be used for the intra prediction process in comparison with HEVC [30]. Fig.…”

Section: Intra Prediction On Vvc Decodersmentioning

confidence: 99%

VVC decoder intra prediction using approximate storage: an error resilience evaluation

Isquierdo,

Soares,

Sampaio

et al. 2023

Analog Integr Circ Sig Process

View full text Add to dashboard Cite

This paper presents an error resilience evaluation of the intra prediction step in Versatile Video Coding (VVC) decoders when approximate storage is employed in the Reference Line Buffer (RLB). We present an error injection framework to simulate the use of approximate storage in the RLB buffer with commonly used Bit Error Rate (BER) values from literature for Static Random-Access Memory (SRAM) and Dynamic Random-Access Memory (DRAM) technologies. We perform an error resilience evaluation based on Peak signal-to-noise ratio (PSNR) and Structural Similarity (SSIM) for twelve video sequences, considering different decoding settings, with four Quantization Parameters (QPs), two encoding configurations, and seven BERs. We also present a few examples, showing how approximately decoded sequences can look and performing a subjective visual quality analysis. Our analysis characterizes how the impacts of approximation are dependent on VVC Decoder Intra Prediction Using Approximate Storage: an Error Resilience Evalu video content and configurations. The results show that approximate storage can be used in some of the evaluated scenarios with very low degradation on the final visual quality of the decoded video sequences.

show abstract

“…The Multiple Reference Line (MRL) extends the number of lines and columns from neighbor blocks that can be used for the intra prediction process in comparison with HEVC [30]. Fig.…”

Section: Intra Prediction On Vvc Decodersmentioning

confidence: 99%

VVC decoder intra prediction using approximate storage: an error resilience evaluation

Isquierdo,

Soares,

Sampaio

et al. 2023

Analog Integr Circ Sig Process

View full text Add to dashboard Cite

show abstract

“…In addition to the enhanced coding mode, VVC adopts multiple reference lines (MRL) [6] [7], Matrix weighted intra prediction (MIP) [8] [9], Intra Sub-Partitions (ISP) [10], and 4-tap interpolation filter to improve coding performance. FIGURE 2: Intra Prediction processing flow modified from [11] The IP coding control is shown in Fig. 2, modified from concurrent processing [11] to sequential.…”

Section: Figure 1: 2×(w+h)+1 Reference Pixels From Neighboring Blocksmentioning

confidence: 99%

“…FIGURE 2: Intra Prediction processing flow modified from [11] The IP coding control is shown in Fig. 2, modified from concurrent processing [11] to sequential. When reference pixels are ready for a CU, the coder will find 2∼3 best, depending on CU size, from the 35 prediction angles of HEVC, and then test the left and right to the best ones to refine the prediction.…”

Section: Figure 1: 2×(w+h)+1 Reference Pixels From Neighboring Blocksmentioning

confidence: 99%

“…However, as the coding performance evaluation specifies four QPs, it generally needs to train four models to achieve highly accurate prediction. Li et al [15] proposed to add a QP Mask layer in the model to distribute the QP to all FIGURE 3: The six CU split modes of QTMT [11] FIGURE 4: Examples of VVC encoding tree (left) and QTMT partition on a CU 128×128 (right), modified from [11] pixels. Experiments revealed that adopting one learned model to predict CU modes under different QPs is difficult, as the CU mode will change drastically under different QPs.…”

Section: Rate-distortion Optimized Modementioning

confidence: 99%

See 1 more Smart Citation

Speed Up VVC Intra-Coding by Learned Models and Feature Statistics

Chen,

Chou,

Jiang

2023

IEEE Access

View full text Add to dashboard Cite

The newest video coding standard, Versatile Video Coding (VVC), adopts a QTMT, quadtree plus multi-type tree (MTT), block partition structure and improves the compression performance by about 30%∼50%, compared with the previous High-Efficiency Video Coding (HEVC) one, at the cost of higher time complexity. To make practical video communication applications feasible, we have to reduce the high time complexity resulting from an exhaustive rate-distortion optimization (RDO) search procedure. We proposed to predict Coding Unit (CU) split modes by a learned model whose input comprises neighboring line pixels and quantization parameters (QP). In addition, we set thresholds based on statistical image features and coding behaviors to eliminate unnecessary coding operations in critical coding control modules. Experiments showed that, compared with the default VVC intra-coding, the proposed method saves 46.73% of encoding time, with Bjøntegaard Delta Bit Rate (BDBR) increment of 1.16%. After retraining the learned model with a specified QP, the time reduction rate can achieve 51.79%, and the BDBR slightly increases to 2.07%. The proposed speedup coding scheme effectively reduced the VVC time complexity to a large extent.

show abstract

“…However, our method is able to achieve closer performance for a more complex encoder when only predicting the set of IPMs to be tested during the FIPMD. For instance, the use of MIP and ISP enhanced the coding efficiency with about 2% [32] at the expense of 10% and 15% [33] of complexity overhead, respectively. The best performance of our method is presented for the video RaceHorsesC with about 30% of complexity reduction for only 1.03% of BD-BR increase.…”

Section: Complexity Reduction Under Vtmmentioning

confidence: 99%

Multitask Learning Based Intra-Mode Decision Framework for Versatile Video Coding

et al. 2022

View full text Add to dashboard Cite

In mid-2020, the new international video coding standard, namely versatile video coding (VVC), was officially released by the Joint Video Expert Team (JVET). As its name indicates, the VVC enables a higher level of versatility with better compression performance compared to its predecessor, high-efficiency video coding (HEVC). VVC introduces several new coding tools like multiple reference lines (MRL) and matrix-weighted intra-prediction (MIP), along with several improvements on the block-based hybrid video coding scheme such as quatree with nested multi-type tree (QTMT) and finer-granularity intra-prediction modes (IPMs). Because finding the best encoding decisions is usually preceded by optimizing the rate distortion (RD) cost, introducing new coding tools or enhancing existing ones requires additional computations. In fact, the VVC is 31 times more complex than the HEVC. Therefore, this paper aims to reduce the computational complexity of the VVC. It establishes a large database for intra-prediction and proposes a multitask learning (MTL)-based intra-mode decision framework. Experimental results show that our proposal enables up to 30% of complexity reduction while slightly increasing the Bjontegaard bit rate (BD-BR).

show abstract

Performance analysis of VVC intra coding

Cited by 14 publications

References 33 publications

VVC decoder intra prediction using approximate storage: an error resilience evaluation

VVC decoder intra prediction using approximate storage: an error resilience evaluation

Speed Up VVC Intra-Coding by Learned Models and Feature Statistics

Multitask Learning Based Intra-Mode Decision Framework for Versatile Video Coding

Contact Info

Product

Resources

About