Comparison of Four Subjective Methods for Image Quality Assessment

Mantiuk, Rafał; Tomaszewska, Anna; Mantiuk, Radosław

doi:10.1111/j.1467-8659.2012.03188.x

Cited by 216 publications

(136 citation statements)

References 21 publications

Supporting

Mentioning

135

Contrasting

Order By: Relevance

“…are important, but do not capture the fine differences in personal opinion. However, paired comparison user-studies, have shown to be well suited for understanding fine opinion differences [8]. Thus, the subjective quality assessments in our work are also based on paired comparisons.…”

Section: B Evaluation Of Resultsmentioning

confidence: 99%

Saliency-driven image coding improves overall perceived JPEG quality

Hosu

Hahn

Wiedemann

et al. 2016

2016 Picture Coding Symposium (PCS)

View full text Add to dashboard Cite

Abstract-Saliency-driven image coding is well worth pursuing. Previous studies on JPEG and JPEG2000 have suggested that region-of-interest coding brings little overall benefit compared to the standard implementation. We show that our saliencydriven variable quantization JPEG coding method significantly improves perceived image quality. To validate our findings, we performed large crowdsourcing experiments involving several hundred contributors, on 44 representative images. To quantify the level of improvement, we devised an approach to equate Likert-type opinions to bitrate differences. Our saliency-driven coding showed 11% bpp average benefit over the standard JPEG. I. INTRODUCTION AND MOTIVATIONRegion-of-interest (ROI) based image compression techniques propose to compress the background more than the foreground in order to improve the perceived image quality. In his studies on two-level ROI based JPEG2000 image coding Bradley [1] has shown that his strategy did not improve on the standard JPEG2000 overall. It only did so at very low bitrates. Harding et al.[2] proposed a binary "visual interest"-guided JPEG2000 compression technique that increased image quality as measured objectively, but did not account for the fact that images of the same bitrate should be compared. Furthermore, in a recent study on perceptual quality in images Alers et al.[3] have shown that image foreground regions are much more important than the background. In view of these results we reconsider ROI based image compression. To better understand the importance of the ROI in perceived quality, we designed our own saliency-driven variable coding strategy.Due to its simplicity and popularity we decided to base our variable quantization technique on JPEG Part 3 rather than working with JPEG2000. One of the intended purposes of variable quantization is "the ability to use the masking properties of the human visual system more effectively, and thereby achieving greater compression rates for the same subjective quality", see [4]. Variable quantization has already been shown to produce better results than the standard JPEG for special applications. For instance, Konstantinides et al. [5] have adjusted the quantization scaling factors in composite documents. Memon et al. [6] used a measure of block activity and type. None of these works evaluate results in terms of perceptual improvement (user studies). Harding et al. [2] have performed limited subjective studies, however due the low numbers of participants their results are inconclusive. Yu et al. [7] perform subjective evaluation as well using a sequential paired comparison quality assessment methodology. Their results are overall not in favor of their encoding technique.

show abstract

Section: B Evaluation Of Resultsmentioning

confidence: 99%

Saliency-driven image coding improves overall perceived JPEG quality

Hosu

Hahn

Wiedemann

et al. 2016

2016 Picture Coding Symposium (PCS)

View full text Add to dashboard Cite

show abstract

“…rating, ranking or pair-wise comparisons can impact on precision and length of the experiment. Nevertheless, the results of the different strategies are expected to be correlated [47,139,174].…”

Section: Discussionmentioning

confidence: 99%

The high dynamic range imaging pipeline : Tone-mapping, distribution, and single-exposure reconstruction

Eilertsen¹

2018

Linköping Studies in Science and Technology. Dissertations

View full text Add to dashboard Cite

“…For each of three candidate rendering methods, eight rendering outputs from different viewpoints for four different scenes, "chess board" and "room" from simulator and "eucalyptus flowers" and " Lego knights" from Stanford real data were generated. These 96 test sequences as a pair of reference and rendering output were presented to each subject with the recommended time pattern and experiment conditions as proposed in [24,55]. The subjects were asked to rate the impairment of the second stimulus in relation to the reference into one of the five-level scales: 5-Imperceptible, 4-Perceptible but not annoying, 3-Slightly annoying, 2-Annoying, and 1-Very annoying.…”

Section: Subjective Assessmentmentioning

confidence: 99%

Estimation of Signal Distortion Using Effective Sampling Density for Light Field-Based Free Viewpoint Video

Shidanshidi

Safaei

2015

IEEE Trans. Multimedia

View full text Add to dashboard Cite

In a light field-based free viewpoint video (LF-based FVV) system, effective sampling density (ESD) is defined as the number of rays per unit area of the scene that has been acquired and is selected in the rendering process for reconstructing an unknown ray. This paper extends the concept of ESD and shows that ESD is a tractable metric that quantifies the joint impact of the imperfections of LF acquisition and rendering. By deriving and analyzing ESD for the commonly used LF acquisition and rendering methods, it is shown that ESD is an effective indicator determined by system parameters and can be used to directly estimate output video distortion without access to the ground truth. This claim is verified by extensive numerical simulations and comparison to PSNR. Furthermore, an empirical relationship between the output distortion (in PSNR) and the calculated ESD is established to allow direct assessment of the overall video distortion without an actual implementation of the system. A small scale subjective user study is also conducted which indicates a correlation of 0.91 between ESD and perceived quality. (ESD) is defined as the number of rays per unit area of the scene that has been acquired and is selected in the rendering process for reconstructing an unknown ray. This paper extends the concept of ESD and shows that ESD is a tractable metric that quantifies the joint impact of the imperfections of LF acquisition and rendering. By deriving and analyzing ESD for the commonly used LF acquisition and rendering methods, it is shown that ESD is an effective indicator determined by system parameters and can be used to directly estimate output video distortion without access to the ground truth. This claim is verified by extensive numerical simulations and comparison to PSNR. Furthermore, an empirical relationship between the output distortion (in PSNR) and the calculated ESD is established to allow direct assessment of the overall video distortion without an actual implementation of the system. A small scale subjective user study is also conducted which indicates a correlation of 0.91 between ESD and perceived quality.

show abstract

Comparison of Four Subjective Methods for Image Quality Assessment

Cited by 216 publications

References 21 publications

Saliency-driven image coding improves overall perceived JPEG quality

Saliency-driven image coding improves overall perceived JPEG quality

The high dynamic range imaging pipeline : Tone-mapping, distribution, and single-exposure reconstruction

Estimation of Signal Distortion Using Effective Sampling Density for Light Field-Based Free Viewpoint Video

Contact Info

Product

Resources

About