Subjective quality assessment database of HDR images compressed with JPEG XT

Korshunov, Pavel; Hanhart, Philippe; Richter, Thomas; Artusi, Alessandro; Mantiuk, Rafał; Ebrahimi, Touradj

doi:10.1109/qomex.2015.7148119

Cited by 48 publications

(50 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this paper, we use the publicly available dataset provided by Korshunov et al [29,30] to benchmark 35 objective metrics. This section describes in details the dataset, objective metrics, and performance analysis used in our benchmark.…”

Section: Methodsmentioning

confidence: 99%

“…2, MOS values reflect the subjects perception fairly with enough MOS samples for each meaningful value range. More details about the dataset and subjective evaluations can be found in [29].…”

Section: Dataset and Subjective Scoresmentioning

confidence: 99%

“…In total, 35 objective metrics were benchmarked using subjective scores as ground truth. The database used in our experiments [29,30] is composed of 20 different contents and a total of 240 compressed HDR images with corresponding subjective quality scores. The HDR images are adapted (resized, cropped, and tone-mapped using display-adaptive tone-mapping operator) to SIM2 HDR monitor.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Benchmarking of objective quality metrics for HDR image quality assessment

Hanhart

Bernardo

Pereira

et al. 2015

J Image Video Proc.

Self Cite

View full text Add to dashboard Cite

Recent advances in high dynamic range (HDR) capture and display technologies have attracted a lot of interest from scientific, professional, and artistic communities. As in any technology, the evaluation of HDR systems in terms of quality of experience is essential. Subjective evaluations are time consuming and expensive, and thus objective quality assessment tools are needed as well. In this paper, we report and analyze the results of an extensive benchmarking of objective quality metrics for HDR image quality assessment. In total, 35 objective metrics were benchmarked on a database of 20 HDR contents encoded with 3 compression algorithms at 4 bit rates, leading to a total of 240 compressed HDR images, using subjective quality scores as ground truth. Performance indexes were computed to assess the accuracy, monotonicity, and consistency of the metric estimation of subjective scores. Statistical analysis was performed on the performance indexes to discriminate small differences between metrics. Results demonstrated that metrics designed for HDR content, i.e., HDR-VDP-2 and HDR-VQM, are the most reliable predictors of perceived quality. Finally, our findings suggested that the performance of most full-reference metrics can be improved by considering non-linearities of the human visual system, while further efforts are necessary to improve performance of no-reference quality metrics for HDR content.

show abstract

Section: Methodsmentioning

confidence: 99%

Section: Dataset and Subjective Scoresmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Benchmarking of objective quality metrics for HDR image quality assessment

Hanhart

Bernardo

Pereira

et al. 2015

J Image Video Proc.

Self Cite

View full text Add to dashboard Cite

show abstract

“…Database #3- Korsunov et al (2015) In the study of Korsunov et al (2015), an HDR image quality database, publicly available at http://mmspg.epfl. ch/jpegxt-hdr, has been created using backward-compatible JPEG-XT standard (Richter 2013) with different profiles and quality levels.…”

Section: Considered Subjective Databasesmentioning

confidence: 99%

An extensive performance evaluation of full-reference HDR image quality metrics

2017

View full text Add to dashboard Cite

High dynamic range (HDR) image and video technology has recently attracted a great deal of attention in the multimedia community, as a mean to produce truly realistic video and further improve the quality of experience (QoE) of emerging multimedia services. In this context, measuring the quality of compressed HDR content plays a fundamental role. However, full-reference (FR) HDR visual quality assessment poses new challenges with respect to the conventional low dynamic range case. Quality metrics have to be redesigned or adapted to HDR, and understanding their reliability to predict users' judgments is even more critical due to the still limited availability of HDR displays to perform subjective evaluations. The goal of this paper is to provide a complete and thorough survey of the performance of the most popular HDR FR image quality metrics. To this end, we gather several existing HDR image databases with subjective quality annotations, in addition to a new one created by ourselves. After aligning the scores in these databases, we obtain an extensive set of 690 compressed HDR images, along with their subjective quality. Next, we analyze in depth many FR metrics, including those used in MPEG standardization, using both classical correlation analyses and classification accuracy. We believe that our results could serve as the most complete and comprehensive benchmark of image quality metrics in the field of HDR image compression.

show abstract

“…Lately (Korshunov et al 2015) have provided a publicly available dataset of 20 HDR images and corresponding versions compressed at four different bit rates with three profiles of the upcoming JPEG XT standard for HDR image compression. The images cover different scenes, dynamic ranges, and acquisition methods.…”

Section: Related Workmentioning

confidence: 99%

Overview and evaluation of the JPEG XT HDR image compression standard

Artusi

Mantiuk

Richter

et al. 2015

J Real-Time Image Proc

Self Cite

View full text Add to dashboard Cite

Standards play an important role in providing a common set of specifications and allowing interoperability between devices and systems. Until recently, no standard for High Dynamic Range (HDR) image coding had been adopted by the market, and HDR imaging relies on proprietary and vendor specific formats which are unsuitable for storage or exchange of such images. To resolve this situation, the JPEG Committee is developing a new coding standard called JPEG XT that is backwards compatible to the popular JPEG compression, allowing it to be implemented using standard 8-bit JPEG coding hardware or software. In this paper, we present design principles and technical details of JPEG XT. It is based on a two-layers design, a base layer containing a Low Dynamic Range (LDR) image accessible to legacy implementations, and an extension layer providing the full dynamic range. The paper introduces three of currently defined profiles in JPEG XT, each constraining the common decoder architecture to a subset of allowable configurations. We assess the coding efficiency of each profile extensively through subjective assessments, using 24 naïve subjects to evaluate 20 images, and objective evaluations, using 106 images with five different tone-mapping operators and at 100 different bit rates. The objective results (based on benchmarking with subjective scores) demonstrate that JPEG XT can encode HDR images at bit rates varying from 1.1 to 1.9 bit/pixel for estimated mean opinion score (MOS) 4.5 out of 5, which is considered as fully transparent in many applications. This corresponds to 23-times bitstream reduction compared to lossless OpenEXR PIZ compression.

show abstract

Subjective quality assessment database of HDR images compressed with JPEG XT

Cited by 48 publications

References 16 publications

Benchmarking of objective quality metrics for HDR image quality assessment

Benchmarking of objective quality metrics for HDR image quality assessment

An extensive performance evaluation of full-reference HDR image quality metrics

Overview and evaluation of the JPEG XT HDR image compression standard

Contact Info

Product

Resources

About