Low-Complexity CTU Partition Structure Decision and Fast Intra Mode Decision for Versatile Video Coding

Yang, Hao; Shen, Liquan; Dong, Xinchao; Qiu-lin, Ding; An, Ping; Jiang, Gangyi

doi:10.1109/tcsvt.2019.2904198

Cited by 221 publications

(173 citation statements)

References 35 publications

Supporting

Mentioning

141

Contrasting

Order By: Relevance

“…[ [21][22][23] are the state-of-the-art techniques dealing with the QTMT issue. [21] adopts the Bayesian decision rule to eliminate the redundant selection of QTMT.…”

Section: B Methods For Qtbt and Qtmtmentioning

confidence: 99%

“…Early skip for vertical split including BV and TV is first conducted, then is the early skip for TH. A novel fast QTMT decision framework using decision tree is developed in [22] to determine the partition based on texture features like gradient and local difference which is evaluated by texture variance. [23] creates a CNN model with changeable kernel sizes to deal with the flexible side lengths in QTMT.…”

Section: B Methods For Qtbt and Qtmtmentioning

confidence: 99%

“…In part II.A, approaches applied to the complexity reduction of HEVC QT structure are presented [4][5][6][7][8][9][10][11][12][13][14][15][16][17][18]. In part II.B, existing state-of-the-art QTBT and QTMT intra partition methods dealing with the novel asymmetric partition issue are concluded [19][20][21][22][23].…”

Section: Related Workmentioning

confidence: 99%

“…Since the first decisive JVET conference on VVC in 2018, few adaptive algorithms have been proposed to speed up the QTMT intra prediction. As aforementioned, there is a Bayesian method in [21], a decision tree method in [22] and a CNN method in [23] to our knowledge up to now. Although machine learning and neural network methods are becoming increasingly popular in recent years in solving problems in image processing and video coding field, we cannot deny that traditional methods such as variance-based or gradient-based are also preferred.…”

Section: Motivationmentioning

confidence: 99%

See 3 more Smart Citations

A Fast QTMT Partition Decision Strategy for VVC Intra Prediction

et al. 2020

View full text Add to dashboard Cite

Different from the traditional quaternary tree (QT) structure utilized in the previous generation video coding standard H.265/HEVC, a brand new partition structure named quadtree with nested multi-type tree (QTMT) is applied in the latest codec H.266/VVC. The introduction of QTMT brings in superior encoding performance at the cost of great time-consuming. Therefore, a fast intra partition algorithm based on variance and Sobel operator is proposed in this paper. The proposed method settles the novel asymmetrical partition issue in VVC by well balancing the reduction of computational complexity and the loss of encoding quality. To be more concrete, we first terminate further splitting of a coding unit (CU) when the texture of it is judged as smooth. Then, we use Sobel operator to extract gradient features to decide whether to split this CU by QT, thus terminating further MT partitions. Finally, a completely novel method to choose only one partition from five QTMT partitions is applied. Obviously, homogeneous area tends to use a larger CU as a whole to do prediction while CUs with complicated texture are prone to be divided into small sub-CUs and these sub-CUs usually have different textures from each other. We calculate the variance of variance of each sub-CU to decide which partition will distinguish the sub-textures best. Our method is embedded into the latest VVC official reference software VTM-7.0. Comparing to anchor VTM-7.0, our method saves the encoding time by 49.27% on average at the cost of only 1.63% BDBR increase. As a traditional scheme based on variance and gradient to decrease the computational complexity in VVC intra coding, our method outperforms other relative existing state-of-the-art methods, including traditional machine learning and convolution neural network methods. INDEX TERMS Asymmetric block size, fast partition decision, intra prediction, quadtree with multi-type tree, versatile video coding YIBO FAN received the B.E. degree in electronics and engineering from

show abstract

“…[ [21][22][23] are the state-of-the-art techniques dealing with the QTMT issue. [21] adopts the Bayesian decision rule to eliminate the redundant selection of QTMT.…”

Section: B Methods For Qtbt and Qtmtmentioning

confidence: 99%

Section: B Methods For Qtbt and Qtmtmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Section: Motivationmentioning

confidence: 99%

See 2 more Smart Citations

A Fast QTMT Partition Decision Strategy for VVC Intra Prediction

et al. 2020

View full text Add to dashboard Cite

show abstract

“…To the best of our knowledge, no solution have been proposed to reduce the complexity of the MTS process. Finally, a first method [18] implemented in VTM2.0 proposes early termination of QT plus MTT partitioning and intra mode prediction to skip unnecessary partition and intra modes. The proposed method obtains 63% complexity reduction at the expense of +1.93% BD-BR loss.…”

Section: B State-of-the-art Of Complexity Reduction Techniquesmentioning

confidence: 99%

Complexity Reduction Opportunities in the Future VVC Intra Encoder

Tissier

Mercat

Amestoy

et al. 2019

2019 IEEE 21st International Workshop on Multimedia Signal Processing (MMSP)

View full text Add to dashboard Cite

The Joint Video Expert Team (JVET) is developing the next-generation video coding standard called Versatile Video Coding (VVC) and their ultimate goal is to double the coding efficiency over the current state-of-the-art standard HEVC without letting complexity get out of hand. This work addresses the complexity of the VVC reference encoder called VVC Test Model (VTM) under All Intra coding configuration. The VTM3.0 is able to improve intra coding efficiency by 21% over the latest HEVC reference encoder HM16.19. This coding gain primarily stems from three new coding tools. First, the HEVC Quad-Tree (QT) structure extension with Multi-Type Tree (MTT) partitioning. Second, the duplication of intra prediction modes from 35 to 67. And third, the Multiple Transform Selection (MTS) scheme with two new discrete cosine/sine transforms (DCT-VIII and DST-VII). However, these new tools also play an integral part in making VTM intra encoding around 20 times as complex as that of HM. The purpose of this work is to analyze these tools individually and specify theoretical upper limits for their complexity reduction. According to our evaluations, the complexity reduction opportunity of block partitioning is up to 97%, i.e., the encoding complexity would drop down to 3% for the same coding efficiency if the optimal block partitioning could be directly predicted. The respective percentages for intra mode reduction and MTS optimization are 65% and 55%. We believe these results motivate VVC codec designers to develop techniques that are able to take most out of these opportunities.

show abstract