Subjective and Objective Quality Assessment of Compressed 4K UHD Videos for Immersive Experience

Cheon, Manri; Lee, Jong-Seok

doi:10.1109/tcsvt.2017.2683504

Cited by 90 publications

(37 citation statements)

References 43 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Examples of NR models include DIIVINE, BRISQUE, BLIINDS and NIQE [87,88,89,90]. In the absence of source information, such models are usually less accurate than the corresponding FR and RR counterparts [91,92]. As a consequence, purely pixel-based NR models are not considered further in this paper, which targets higheraccuracy video quality models.…”

Section: B Pixel-based Modelsmentioning

confidence: 99%

See 1 more Smart Citation

Multi-Model Standard for Bitstream-, Pixel-Based and Hybrid Video Quality Assessment of UHD/4K: ITU-T P.1204

Raake

Borer²,

Satti³

et al. 2020

IEEE Access

View full text Add to dashboard Cite

The paper presents a series of three new video quality model standards for the assessment of sequences of up to UHD/4K resolution. They were developed in a competition within the International Telecommunication Union (ITU-T), Study Group 12, in collaboration with the Video Quality Experts Group (VQEG), over a period of more than two years. A large video quality test set with a total of 26 individual databases was created, with 13 used for training and 13 for validation and selection of the winning models. For each database, video quality laboratory tests were run with at least 24 subjects each. The 5-point Absolute Category Rating (ACR) scale was used for rating, calculating Mean Opinion Scores (MOS) as ground-truth. To represent today's commonly applied HTTP-based adaptive streaming context, the test sequences comprise a variety of encoding settings, bitrates, resolutions and framerates for the three codecs H.264/AVC, H.265/HEVC and VP9, applied to a wide range of source sequences of around 8 s duration. Processing was carried out with an FFmpeg-based processing chain developed specifically for the competition, and via upload and encoding through exemplary online streaming services. The resulting data represents the largest, lab-test-based dataset used for video quality model development to date, with a total of around 5,000 test sequences. The paper addresses the three models ultimately standardized in the P.1204 Recommendation series, resulting in different model types and for different applications: (i) Rec. P.1204.3, no-reference bitstream-based, with access to encoded bitstream information; (ii) P.1204.4, pixel-based, using information from the reference and the processed video, and (iii) P.1204.5, no-reference hybrid, using both bitstream-and pixel-information without knowledge of the reference. The paper outlines the development process and provides holistic details about the statistical evaluation, test databases, model algorithms and validation results, as well as a performance comparison with state-of-the-art models.INDEX TERMS bitstream, full reference, http adaptive streaming (HAS), hybrid, pixel-based, QoE, reduced reference, video quality.

show abstract

Section: B Pixel-based Modelsmentioning

confidence: 99%

“…A performance of the models on the aforementioned open databases is presented in the following. For this purpose, two different datasets, namely, AVT-VQDB-UHD-1 [91] and MCML [92] are considered. To evaluate the model on the 12.…”

Section: A Evaluation On Open Databasesmentioning

confidence: 99%

Multi-Model Standard for Bitstream-, Pixel-Based and Hybrid Video Quality Assessment of UHD/4K: ITU-T P.1204

Raake

Borer²,

Satti³

et al. 2020

IEEE Access

View full text Add to dashboard Cite

show abstract

“…However, [52], [53] and [3] were studies of comparative codec coding efficiency across a range of video qualities and did not account for packet loss. Because the close viewing distance may favor 4K UHD over HD video in an immersive environment [2], a cross-codec (H.264/AVC, HEVC, VP9) study of relative quality evaluation also appeared as [12].…”

Section: Transmission Of 4k Uhdmentioning

confidence: 99%

Impact of packet loss on 4K UHD video for portable devices

Adeyemi-Ejeye

Alreshoodi

Al-Jobouri

et al. 2019

Multimed Tools Appl

View full text Add to dashboard Cite

Ultra High Definition (UHD) video streaming to portable devices has become topical. Two standardized codecs are current, H.264/Advanced Video Coding (AVC) and the more recent High Efficiency Video Coding (HEVC). This paper compares the two codecs' robustness to packet loss, after making allowances for relative coding gain. A significant finding from the comparison is that the H.264/AVC codec is less impacted by packet loss than HEVC, despite their differing coding efficiencies and including at low levels of packet loss. The results will be especially relevant to those designing portable devices with 4K UHD video display capability, allowing them to estimate the level of error concealment necessary. The paper also includes the results of HEVC compressed UHD video streaming over an IEEE 802.11ad wireless link operating at 60 GHz as a pointer to future performance in an error-prone channel.

show abstract

“…Current subjective databases that feature HEVC test content include CSIQ [45], BVI Texture [46], SJTU 4K-HEVC [47], BVI-HomoTex [48] and Yonsei 4K UHD database [49]. However, the CSIQ and BVI-HomoTex databases only includes low resolution video sequences (480p and 256p respectively), while the content in the BVI Texture database is limited to homogeneous textures.…”

Section: Existing Video Quality Databasesmentioning

confidence: 99%

BVI-HD: A Video Quality Database for HEVC Compressed and Texture Synthesized Content

Zhang

Moss

Baddeley

et al. 2018

IEEE Trans. Multimedia

View full text Add to dashboard Cite

This paper introduces a new high definition video quality database, referred to as BVI-HD, which contains 32 reference and 384 distorted video sequences plus subjective scores. The reference material in this database was carefully selected to optimise the coverage range and distribution uniformity of five low level video features, while the included 12 distortions, using both original High Efficiency Video Coding (HEVC) and HEVC with synthesis mode (HEVC-SYNTH), represent state-ofthe-art approaches to compression. The range of quantisation parameters included in the database for HEVC compression was determined by a subjective study, the results of which indicate that a wider range of QP values should be used than the current recommendation. The subjective opinion scores for all 384 distorted videos were collected from a total of 86 subjects, using a double stimulus test methodology. Based on these results, we compare the subjective quality between HEVC and synthesised content, and evaluate the performance of nine state-of-the-art, full-reference objective quality metrics. This database has now been made available online, representing a valuable resource to those concerned with compression performance evaluation and objective video quality assessment.

show abstract

Subjective and Objective Quality Assessment of Compressed 4K UHD Videos for Immersive Experience

Cited by 90 publications

References 43 publications

Multi-Model Standard for Bitstream-, Pixel-Based and Hybrid Video Quality Assessment of UHD/4K: ITU-T P.1204

Multi-Model Standard for Bitstream-, Pixel-Based and Hybrid Video Quality Assessment of UHD/4K: ITU-T P.1204

Impact of packet loss on 4K UHD video for portable devices

BVI-HD: A Video Quality Database for HEVC Compressed and Texture Synthesized Content

Contact Info

Product

Resources

About