Fast QTMT Partition Decision Algorithm in VVC Intra Coding based on Variance and Gradient

Chen, Junan; Sun, Heming; Katto, Jiro; Zeng, Xiaoyang; Fan, Yibo

doi:10.1109/vcip47243.2019.8965674

Cited by 58 publications

(54 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Table VI shows the coding property of the proposed overall algorithm compared with the latest fast methods. To assess the coding property of the proposed overall scheme, we compare the proposed overall scheme with the latest fast methods of H.266/VVC, including CTTD [26], FPIC [27], CPFD [28] and FCPD [34] method. These are fast and efficient method for H.266/VVC encoder.…”

Section: Resultsmentioning

confidence: 99%

“…A fast early skip intra coding method in H.266/VVC is introduced in [26], which can skip redundant MTT pruning. A fast intra partition method based on variance and gradient is developed in [27] to settle the rectangular partition issue in H.266/VVC. The basic idea of the method is mainly to use larger CUs and the sub-CUs to predict homogeneous region and complex texture region, respectively.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Fast CU Partition and Intra Mode Decision Method for H.266/VVC

et al. 2020

View full text Add to dashboard Cite

The Versatile Video Coding (H.266/VVC) standard has developed by Joint Video Exploration Team (JVET). Compared with the previous generation video coding standard, the H.266/VVC is more outstanding. Since the H.266/VVC introduces multi-type tree (MTT) structure including binary tree (BT) and ternary tree (TT), which brings the significant coding efficiency but increases coding complexity. Moreover, the intra prediction modes have increased from 35 to 67, which can provide more accurate prediction than H.265/High Efficiency Video Coding (HEVC). Therefore, these can improve the encoding quality, but increase computational complexity. To reduce the computational complexity, this paper designs a fast coding unit (CU) partition and intra mode decision algorithm, which includes fast CU partition based on random forest classifier (RFC) model and fast intra prediction modes optimization based on texture region features. Simulation results indicate that the proposed scheme can save 54.91% encoding time with only 0.93% increase in BDBR. INDEX TERMS H.266/VVC, fast CU partition, intra mode decision, random forest, texture feature

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Fast CU Partition and Intra Mode Decision Method for H.266/VVC

et al. 2020

View full text Add to dashboard Cite

show abstract

“…Therefore, both Algorithm I and Algorithm II methods can effectively save coding time, and the loss of RD performance is negligible. Table II shows the results of the proposed algorithm compared with two state-of-the-art fast methods including PV-CNN [23], FQPD-VG [24] and RFCTRF [25] method. It can be found that the proposed overall algorithm saves 48.58% coding running time on average, the maximum is 55.93% (ParkScene), and the minimum is 37.14% (BQSquare).…”

Section: Experiments and Resultsmentioning

confidence: 99%

“…Recently, many researchers have studied the characteristics of MTT structure to improve the coding complexity of VVC. A fast method based on variance and gradient is devised in [24] to speed up encoding of VVC. The algorithm first terminates the further division of the smooth area.…”

Section: Related Workmentioning

confidence: 99%

Fast CU Partition Decision Method Based on Texture Characteristics for H.266/VVC

et al. 2020

View full text Add to dashboard Cite

“…where α, β and γ are all adjustable parameters. The initial value of the parameters come from our previous work [25]. We first set β and γ as constants and run the training sequence with different values of αs.…”

Section: B Derivation Of Thresholdsmentioning

confidence: 99%

A Fast QTMT Partition Decision Strategy for VVC Intra Prediction

et al. 2020

Self Cite

View full text Add to dashboard Cite

Different from the traditional quaternary tree (QT) structure utilized in the previous generation video coding standard H.265/HEVC, a brand new partition structure named quadtree with nested multi-type tree (QTMT) is applied in the latest codec H.266/VVC. The introduction of QTMT brings in superior encoding performance at the cost of great time-consuming. Therefore, a fast intra partition algorithm based on variance and Sobel operator is proposed in this paper. The proposed method settles the novel asymmetrical partition issue in VVC by well balancing the reduction of computational complexity and the loss of encoding quality. To be more concrete, we first terminate further splitting of a coding unit (CU) when the texture of it is judged as smooth. Then, we use Sobel operator to extract gradient features to decide whether to split this CU by QT, thus terminating further MT partitions. Finally, a completely novel method to choose only one partition from five QTMT partitions is applied. Obviously, homogeneous area tends to use a larger CU as a whole to do prediction while CUs with complicated texture are prone to be divided into small sub-CUs and these sub-CUs usually have different textures from each other. We calculate the variance of variance of each sub-CU to decide which partition will distinguish the sub-textures best. Our method is embedded into the latest VVC official reference software VTM-7.0. Comparing to anchor VTM-7.0, our method saves the encoding time by 49.27% on average at the cost of only 1.63% BDBR increase. As a traditional scheme based on variance and gradient to decrease the computational complexity in VVC intra coding, our method outperforms other relative existing state-of-the-art methods, including traditional machine learning and convolution neural network methods. INDEX TERMS Asymmetric block size, fast partition decision, intra prediction, quadtree with multi-type tree, versatile video coding YIBO FAN received the B.E. degree in electronics and engineering from

show abstract

Fast QTMT Partition Decision Algorithm in VVC Intra Coding based on Variance and Gradient

Cited by 58 publications

References 10 publications

Fast CU Partition and Intra Mode Decision Method for H.266/VVC

Fast CU Partition and Intra Mode Decision Method for H.266/VVC

Fast CU Partition Decision Method Based on Texture Characteristics for H.266/VVC

A Fast QTMT Partition Decision Strategy for VVC Intra Prediction

Contact Info

Product

Resources

About