Visual Quality Assessment of Synthesized Views in the Context of 3D-TV

Bosc, Emilie; Callet, Patrick Le; Morin, Luce; Pressigout, Muriel

doi:10.1007/978-1-4419-9964-1_15

Cited by 27 publications

(21 citation statements)

References 42 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this paper, the quality assessment of still images from MVD video sequences in both 2D and 3D contexts as a first step of 3D quality assessment is concerned. The evaluation of still images is important scenario in the case when the user switches the video in pause mode [2].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

DIBR-synthesized image quality assessment based on morphological multi-scale approach

Sandic-Stankovic

Kukolj

Callet

2016

J Image Video Proc.

Self Cite

View full text Add to dashboard Cite

The depth-image-based rendering (DIBR) algorithms used for 3D video applications introduce new types of artifacts mostly located around the disoccluded regions. As the DIBR algorithms involve geometric transformations, most of them introduce non-uniform geometric distortions affecting the edge coherency in the synthesized images. Such distortions are not handled efficiently by the common image quality assessment metrics which are primarily designed for other types of distortions. In order to better deal with specific geometric distortions in the DIBR-synthesized images, we propose a full-reference metric based on multi-scale image decomposition applying morphological filters. Using non-linear morphological filters in multi-scale image decomposition, important geometric information such as edges is maintained across different resolution levels. Edge distortion between the multi-scale representation subbands of the reference image and the DIBR-synthesized image is measured precisely using mean squared error. In this way, areas around edges that are prone to synthesis artifacts are emphasized in the metric score. Two versions of morphological multiscale metric have been explored: (a) Morphological Pyramid Peak Signal-to-Noise Ratio metric (MP-PSNR) based on morphological pyramid decomposition, and (b) Morphological Wavelet Peak Signal-to-Noise Ratio metric (MW-PSNR) based on morphological wavelet decomposition. The performances of the proposed metrics have been tested using two databases which contain DIBR-synthesized images: the IRCCyN/IVC DIBR image database and MCL-3D stereoscopic image database. Proposed metrics achieve significantly higher correlation with human judgment compared to the state-of-the-art image quality metrics and compared to the tested metric dedicated to synthesisrelated artifacts. The proposed metrics are computationally efficient given that the morphological operators involve only integer numbers and simple computations like min, max, and sum as well as simple calculation of MSE. MP-PSNR has slightly better performances than MW-PSNR. It has very good agreement with human judgment, Pearson's 0.894, Spearman 0.77 when it is tested on the MCL-3D stereoscopic image database. We have demonstrated that PSNR has particularly good agreement with human judgment when it is calculated between images at higher scales of morphological multi-scale representations. Consequently, simplified and in essence reduced versions of multi-scale metrics are proposed, taking into account only detailed images at higher decomposition scales. The reduced version of MP-PSNR has very good agreement with human judgment, Pearson's 0.904, Spearman 0.863 using IRCCyN/IVC DIBR image database.

show abstract

Section: Introductionmentioning

confidence: 99%

“…DIBR algorithms introduce new types of artifacts mostly located around disoccluded regions [2]. They are not scattered in the entire image such as 2D video compression distortions.…”

Section: Introductionmentioning

confidence: 99%

DIBR-synthesized image quality assessment based on morphological multi-scale approach

Sandic-Stankovic

Kukolj

Callet

2016

J Image Video Proc.

Self Cite

View full text Add to dashboard Cite

show abstract

“…Depth image-based rendering techniques which generate new viewpoints can be used for different 3D video applications in a 2D context like free viewpoint video (FVV) or in a 3D context like reproduction of stereoscopic vision on 3D displays [1]. The main difference between the two applications is the stereopsis phenomenon (fusion of the left and the right view in human visual system) used by 3DTV.…”

Section: Introductionmentioning

confidence: 99%

“…In this paper, the quality assessment of still images from free viewpoint video in a 2D context is concerned. The evaluation of still images is important scenario in the case when the user switches the video in pause mode [1]. Virtual views synthesized either from original data or from decoded and distorted data should be assessed.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

DIBR synthesized image quality assessment based on morphological pyramids

Sandic-Stankovica

Kukolj

Calletc

2015

2015 3dtv-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3dtv-Con)

Self Cite

View full text Add to dashboard Cite

MostDepth Image Based Rendering (DIBR) techniques produce synthesized images which contain non-uniform geometric distortions affecting edges coherency. This type of distortions are challenging for common image quality metrics. Morphological filters maintain important geometric information such as edges across different resolution levels. There is inherent congruence between the morphological pyramid decomposition scheme and human visual perception. In this paper, multi-scale measure, morphological pyramid peak signal-to-noise ratio MP-PSNR, based on morphological pyramid decomposition is proposed for the evaluation of DIBR synthesized images. It is shown that MP-PSNR achieves much higher correlation with human judgment compared to the state-of-the-art image quality measures in this context.Index Terms -Multi-scale PSNR, morphological pyramids, DIBR synthesized image quality assessment

show abstract