Versatile Video Coding and Super-Resolution for Efficient Delivery of 8k Video with 4k Backward-Compatibility

Bonnineau, Charles; Hamidouche, Wassim; Travers, Jean-Francois; Déforges, Olivier

doi:10.1109/icassp40776.2020.9054716

Cited by 5 publications

(4 citation statements)

References 17 publications

(18 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Recently, a study was conducted to evaluate different scenarios for 8K video delivery with 4K backward compatibility relaying on objective quality metrics [16]. It was shown that .…”

Section: Related Workmentioning

confidence: 99%

Perceptual Quality Assessment of HEVC and VVC Standards for 8K Video

Bonnineau

Hamidouche

Fournier

et al. 2022

IEEE Trans. on Broadcast.

Self Cite

View full text Add to dashboard Cite

With the growing data consumption of emerging video applications and users' requirement for higher resolutions, up to 8K, a huge effort has been made in video compression technologies. Recently, versatile video coding (VVC) has been standardized by the moving picture expert group (MPEG), providing a significant improvement in compression performance over its predecessor high efficiency video coding (HEVC). In this paper, we provide a comparative subjective quality evaluation between VVC and HEVC standards for 8K resolution videos. In addition, we evaluate the perceived quality improvement offered by 8K over UHD 4K resolution. The compression performance of both VVC and HEVC standards has been conducted in random access (RA) coding configuration, using their respective reference software, VVC test model (VTM-11) and HEVC test model (HM-16.20). Objective measurements, using PSNR, MS-SSIM and VMAF metrics have shown that the bitrate gains offered by VVC over HEVC for 8K video content are around 31%, 26% and 35%, respectively. Subjectively, VVC offers an average of around 41% of bitrate reduction over HEVC for the same visual quality. A compression gain of 50% has been reached for some tested video sequences regarding a Student's t-test analysis. In addition, for most tested scenes, a significant visual difference between uncompressed 4K and 8K has been noticed.

show abstract

“…Recently, a study was conducted to evaluate different scenarios for 8K video delivery with 4K backward compatibility relaying on objective quality metrics [16]. It was shown that .…”

Section: Related Workmentioning

confidence: 99%

Perceptual Quality Assessment of HEVC and VVC Standards for 8K Video

Bonnineau

Hamidouche

Fournier

et al. 2022

IEEE Trans. on Broadcast.

Self Cite

View full text Add to dashboard Cite

show abstract

“…Besides, Ho et al [19] proposed a degradation-aware technique which employs the original low-resolution (LR) as a transitional ground-truth to remove the degradation from compression and downsampling together. More recently, B. Charles et al [20][21] applied the same DBVC ideas based on the latest standard H.266/VVC, which shows a promising coding performance in low bitrate scenarios. Inspired by these successful DBVC methods for conventional 2D video coding, we design a new DBVC framework for LF data.…”

Section: Downsampling-based Video Coding (Dbvc)mentioning

confidence: 99%

Downsampling Based Light Field Video Coding with Restoration Network Using Joint Spatio-Angular and Epipolar Information

Duong

Huu

Yim

2022

2022 IEEE International Conference on Image Processing (ICIP)

View full text Add to dashboard Cite

This paper proposes a new downsampling-based light field video coding (D-LFVC) framework whose success relies on how to design an effective restoration method that can remove artifacts brought by both downsampling and compression. Since light field (LF) video is of high dimensionality data, the restoration methods designed for conventional 2D video are sub-optimal solutions for our D-LFVC. In this regard, we design a new restoration network, named "LF-QEN," for our D-LFVC framework. Specifically, the network contains three different feature extractor modules, allowing us to simultaneously exploit information from different kinds of 4D LF representation: spatial, angular, and epipolar image information. Our experimental results show that, compared to compression by HEVC-SCC standard, the proposed framework can obtain not only nearly 50% bitrate savings but also can significantly enhance the quality of decoded LF video.

show abstract

“…The input signal is first downscaled and encoded. Then, both post-processing tasks are performed on the decoded signal outside the coding loop, as presented in [4] for super-resolution. The bit-rate is assessed on the low-resolution signal.…”

Section: Coding Performancementioning

confidence: 99%

“…In parallel, video processing deep learning-based solutions have been developed in order to reach these requirements and accelerate the deployment of these new services. For instance, the authors in [4] have proposed a backward-compatible solution for 8K and 4K signals broadcast using VVC and super-resolution. In [5], a feed-forward network is used as an in-loop filter to enhance the quality of the VVC decoded frames.…”

Section: Introductionmentioning

confidence: 99%

Multitask Learning for VVC Quality Enhancement and Super-Resolution

Bonnineau¹,

Hamidouche²,

Travers³

et al. 2021

Preprint

Self Cite

View full text Add to dashboard Cite

The latest video coding standard, called versatile video coding (VVC), includes several novel and refined coding tools at different levels of the coding chain. These tools bring significant coding gains with respect to the previous standard, high efficiency video coding (HEVC). However, the encoder may still introduce visible coding artifacts, mainly caused by coding decisions applied to adjust the bitrate to the available bandwidth. Hence, pre and post-processing techniques are generally added to the coding pipeline to improve the quality of the decoded video. These methods have recently shown outstanding results compared to traditional approaches, thanks to the recent advances in deep learning. Generally, multiple neural networks are trained independently to perform different tasks, thus omitting to benefit from the redundancy that exists between the models. In this paper, we investigate a learning-based solution as a post-processing step to enhance the decoded VVC video quality. Our method relies on multitask learning to perform both quality enhancement and super-resolution using a single shared network optimized for multiple degradation levels. The proposed solution enables a good performance in both mitigating coding artifacts and super-resolution with fewer network parameters compared to traditional specialized architectures.

show abstract

Versatile Video Coding and Super-Resolution for Efficient Delivery of 8k Video with 4k Backward-Compatibility

Cited by 5 publications

References 17 publications

Perceptual Quality Assessment of HEVC and VVC Standards for 8K Video

Perceptual Quality Assessment of HEVC and VVC Standards for 8K Video

Downsampling Based Light Field Video Coding with Restoration Network Using Joint Spatio-Angular and Epipolar Information

Multitask Learning for VVC Quality Enhancement and Super-Resolution

Contact Info

Product

Resources

About