Neural Network-Based Error Concealment For VVC

Benjak, Martin; Samayoa, Yasser; Östermann, Jörn

doi:10.1109/icip42928.2021.9506399

Cited by 5 publications

(1 citation statement)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, these place a large bitrate burden on the client device, or can only slightly acommodate for low latencies. In case of a packet loss, i.e., corrupted Network Abstraction Layer Units (NALUs), client-based error concealment algorithms were developed for Advanced Video Coding (H.264/AVC) [6], [7], yet there is only a limited set of equivalent techniques for High Efficiency Video Coding (H.265/HEVC) [8] , let alone Versatile Video Coding (H.266/VVC) [9].…”

Section: Introductionmentioning

confidence: 99%

Mixed-Resolution HESP for More Efficient Fast Channel Switching and Packet-Loss Repair

Wallendael

Lambert

Speelmans³

et al. 2022

2022 Picture Coding Symposium (PCS)

View full text Add to dashboard Cite

Low-delay live streaming applications desire fast channel switching and packet-loss repair capabilities. However, existing methods that provide these capabilities have a negative impact on the stream of steady-state users. To minimize this impact, techniques such as the High Efficiency Streaming Protocol (HESP) utilize keyframe injection. Such techniques combine compression-efficient normal streams with corresponding companion streams that are used in case of random access or packet loss. Unfortunately, because a companion stream is needed for every normal stream, the distribution cost and encoding complexity are considerable costs. Additionally, injecting a companion keyframe into a normal stream causes a bitrate spike. Therefore, this paper evaluates the impact of utilizing mixedresolution keyframe injection in the H.266/VVC standard. By providing a single companion stream for all normal streams of a bitrate ladder, the three mentioned downsides can be mitigated. We found that injecting a lower-resolution keyframe effectively reduces the bitrate spike, at the cost of only a modest quality loss. For dynamic video content, the quality impact reduces over time, and is less perceptible than traditional packet-loss repair using frame copy. In conclusion, mixed-resolution HESP can reduce the bitrate spike and computational/distribution overhead of HESP when enabling fast channel switching or packet-loss repair.

show abstract