Subjective and objective quality assessment of panoramic videos in virtual reality environments

Zhang, Bo; Zhao, Junzhe; Yang, Shu; Zhang, Yang; Wang, Jing; Fei, Zesong

doi:10.1109/icmew.2017.8026226

Cited by 50 publications

(23 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Additionally, some subjective experiments were conducted in [20,31,39], finding some key factors that have impact on the visual quality of omnidirectional video under different scenes [20,39] and devices [31]. Additionally, several subjective VQA methods [30,47,51] were proposed. For example, subjective assessment of multimedia panoramic video quality (SAMPVIQ) [51] and modified absolute category rating (M-ACR) [30] were developed along with new subjective experiment procedures.…”

Section: Related Workmentioning

confidence: 99%

“…Additionally, several subjective VQA methods [30,47,51] were proposed. For example, subjective assessment of multimedia panoramic video quality (SAMPVIQ) [51] and modified absolute category rating (M-ACR) [30] were developed along with new subjective experiment procedures. Moreover, a pair of overall DMOS (O-DMOS) and vectorized DMOS (V-DMOS) was proposed as a new subjective score processing method [47], in which the consistency of viewing direction across subjects is taken into account.…”

Section: Related Workmentioning

confidence: 99%

“…Therefore, it is necessary to study on visual quality assessment (VQA) for omnidirectional video. Most recently, several subjective VQA approaches [20,28,30,31,39,40,47,51] and objective VQA approaches [35,38,41,45,49,50] have been proposed for either omnidirectional image or video. Among these approaches, the impact of some factors on the quality of omnidirectional video were studied, such as display types, coding schemes and sample uniformity under different map projections.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Bridge the Gap Between VQA and Human Behavior on Omnidirectional Video

et al. 2018

Proceedings of the 26th ACM International Conference on Multimedia

105

View full text Add to dashboard Cite

Omnidirectional video enables spherical stimuli with the 360 × 180 • viewing range. Meanwhile, only the viewport region of omnidirectional video can be seen by the observer through head movement (HM), and an even smaller region within the viewport can be clearly perceived through eye movement (EM). Thus, the subjective quality of omnidirectional video may be correlated with HM and EM of human behavior. To fill in the gap between subjective quality and human behavior, this paper proposes a large-scale visual quality assessment (VQA) dataset of omnidirectional video, called VQA-OV, which collects 60 reference sequences and 540 impaired sequences. Our VQA-OV dataset provides not only the subjective quality scores of sequences but also the HM and EM data of subjects. By mining our dataset, we find that the subjective quality of omnidirectional video is indeed related to HM and EM. Hence, we develop a deep learning model, which embeds HM and EM, for objective VQA on omnidirectional video. Experimental results show that our model significantly improves the state-of-the-art performance of VQA on omnidirectional video. CCS CONCEPTS• Human-centered computing → Virtual reality; KEYWORDSOmnidirectional video, visual quality assessment, human behavior ACM Reference Format:

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Bridge the Gap Between VQA and Human Behavior on Omnidirectional Video

et al. 2018

Proceedings of the 26th ACM International Conference on Multimedia

105

View full text Add to dashboard Cite

show abstract

“…A summary of related work on QoE of 360 video is presented in Table 1. It can be seen that most existing studies focus on the perceptual quality [16,17,[23][24][25][26]. There are only a few studies investigating other QoE aspects such as the presence [14] and cybersickness [16,17].…”

Section: Related Workmentioning

confidence: 99%

A Subjective Study on User Perception Aspects in Virtual Reality

et al. 2019

View full text Add to dashboard Cite

Three hundred and sixty degree video is becoming more and more popular on the Internet. By using a Head-Mounted Display, 360-degree video can render a Virtual Reality (VR) environment. However, it is still a big challenge to understand Quality of Experience (QoE) of 360-degree video since user experience during watching 360-degree video is a very complex phenomenon. In this paper, we aim to investigate four QoE aspects of 360-degree video, namely, perceptual quality, presence, cybersickness, and acceptability. In addition, four key QoE-affecting factors of encoding parameters, content motion, rendering device, and rendering mode are considered in our study. To the best of our knowledge, this is the first work that covers a large number of factors and QoE aspects of 360-degree video. In this study, a subjective experiment is conducted using 60 video versions generated from three original 360-degree videos. Based on statistical analysis of the obtained results, various findings on the impacts of the factors on the QoE aspects are provided. In particular, regarding the impacts of encoding parameters, it is found that the difference of QoE is negligible between video versions encoded at 4 K and 2.5 K resolutions. Also, it is suggested that 360-degree video should not be encoded at HD resolution or lower when watching in VR mode using Head Mounted Display. In addition, the bitrate for good QoE varies widely across different video contents. With respect to the content motion factor, its impact is statistically significant on the perceptual quality, presence, and cybersickness. In a comparison of two rendering device sets used in this study, there is no statistically significant difference found for the acceptability and cybersickness. However, the differences of the perceptual quality and presence are indicated to be statistically significant. Regarding the rendering mode, a comparison between VR and non-VR modes is also conducted. Although the non-VR mode always achieves higher perceptual quality scores and higher acceptability rates, more than a half of the viewers prefer the VR mode to the non-VR mode when watching versions encoded at the resolutions of fHD or higher. By contrast, the non-VR mode is preferred at the HD resolution.

show abstract

“…Image quality assessment is mainly divided into two categories: subjective IQA and objective IQA [8] and it is the same for stereoscopic omnidirectional image quality assessment (SOIQA) [9]. Though subjective SOIQA can generate the mean opinion scores (MOSs) of all the subjects as the most * Equal contribution.…”

Section: Introductionmentioning

confidence: 99%

Quality Assessment of Stereoscopic 360-degree Images from Multi-viewports

Luo

Zhou

et al. 2019

2019 Picture Coding Symposium (PCS)

View full text Add to dashboard Cite

Objective quality assessment of stereoscopic panoramic images becomes a challenging problem owing to the rapid growth of 360-degree contents. Different from traditional 2D image quality assessment (IQA), more complex aspects are involved in 3D omnidirectional IQA, especially unlimited field of view (FoV) and extra depth perception, which brings difficulty to evaluate the quality of experience (QoE) of 3D omnidirectional images. In this paper, we propose a multiviewport based full-reference stereo 360 IQA model. Due to the freely changeable viewports when browsing in the head-mounted display, our proposed approach processes the image inside FoV rather than the projected one such as equirectangular projection (ERP). In addition, since overall QoE depends on both image quality and depth perception, we utilize the features estimated by the difference map between left and right views which can reflect disparity. The depth perception features along with binocular image qualities are employed to further predict the overall QoE of 3D 360 images. The experimental results on our public Stereoscopic OmnidirectionaL Image quality assessment Database (SOLID) show that the proposed method achieves a significant improvement over some well-known IQA metrics and can accurately reflect the overall QoE of perceived images.Index Terms-stereoscopic omnidirectional image, multiviewport, image quality assessment, quality of experience

show abstract

Subjective and objective quality assessment of panoramic videos in virtual reality environments

Cited by 50 publications

References 7 publications

Bridge the Gap Between VQA and Human Behavior on Omnidirectional Video

Bridge the Gap Between VQA and Human Behavior on Omnidirectional Video

A Subjective Study on User Perception Aspects in Virtual Reality

Quality Assessment of Stereoscopic 360-degree Images from Multi-viewports

Contact Info

Product

Resources

About