Saliency-Guided Complexity Control for HEVC Decoding

Abstract

The latest High Efficiency Video Coding (HEVC) standard significantly improves coding efficiency over its previous video coding standards. The expense of such improvement is enormous computational complexity, from both encoding and decoding sides. Since computational capability and power capacity are diverse across portable devices, it is necessary to reduce decoding complexity to a target with tolerable quality loss, so called complexity control. This paper proposes a Saliency-Guided Complexity Control (SGCC) approach for HEVC decoding, which reduces the decoding complexity to the target with minimal perceptual quality loss. First, we establish the SGCC formulation to minimize perceptual quality loss at the constraint on reduced decoding complexity, which is achieved via disabling Deblocking Filter (DF) and simplifying Motion Compensation (MC) of some non-salient Coding Tree Units (CTUs). One important component in this formulation is the modelled relationship between decoding complexity reduction and DF disabling/MC simplification, which determines the control accuracy of our approach. Another component is the modelled relationship between quality loss and DF disabling/MC simplification, responsible for optimizing perceptual quality. By solving the SGCC formulation for a given target complexity, we can obtain the DF and MC settings of each CTU, and then decoding complexity can be reduced to the target. Finally, the experimental results validate the effectiveness of our SGCC approach, from the aspects of control performance, complexity-distortion performance, fluctuation of quality loss and subjective quality.

Energy Efficient Video Decoding for VVC Using a Greedy Strategy-Based Design Space Exploration

“…Second, in-loop and motion compensation filters are skipped with a specific ratio. Another approach that addresses the motion compensation and deblocking filter operations is evaluated in [9]. The authors propose a method that is capable of reducing the decoder complexity at a specified rate.…”

Multi-frame Quality Enhancement for Compressed Video

“…When transmitting video over the bandwidth-limited Internet, video compression has to be applied to significantly save the coding bit-rate [31,39,33,26]. However, the compressed video inevitably suffers from compression artifacts [45,35,25,41,43], which may severely degrade the Quality of Experience (QoE). Therefore, it is necessary to study on quality enhancement for compressed video.…”

Power Modeling for Video Streaming Applications on Mobile Devices

“…In this respect, a large amount of research is performed to optimize the energy efficiency or the complexity of distinct components, such as the encoder on the sender side [3]- [5], the delivering network [6]- [9], or the video decoder [10]- [13] and the display on the receiver side [14].…”