Validation of a novel approach to subjective quality evaluation of conventional and 3D broadcasted video services

Gutiérrez, Jesús; Pérez, Pablo; Jaureguizar, Fernando; Cabrera, Julián; García, Narciso

doi:10.1109/qomex.2012.6263870

Cited by 8 publications

(8 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These results show that subjects are able to effectively assess the video quality of individual QPs, and the content does not distract them from the task. This is in line with the results already reported in the literature for conventional 2D video and similar evaluation methodologies [42], [50], [51]. Furthermore, having the subjects engaged in the content increases the ecological validity of the quality evaluation compared to traditional methods [29], [52].…”

Section: Video Quality Assessmentsupporting

confidence: 89%

“…The deadline to apply for an internship or exchange program for the whole year Quality. A Single-Stimulus Discrete Quality Evaluation (SSDQE) method [42] was applied to measure the quality in observers assigned to condition A. SSDQE uses long-duration contents to evaluate quality guaranteeing the continuity of the narrative. For this, the content is divided into segments, trying to mimic realistic situations of video consumption.…”

Section: International Officementioning

confidence: 99%

See 1 more Smart Citation

Methodology to Assess Quality, Presence, Empathy, Attitude, and Attention in 360-degree Videos for Immersive Communications

Orduna,

Pérez,

Gutiérrez

et al. 2021

Preprint

View full text Add to dashboard Cite

This paper analyzes the joint assessment of video quality, spatial and social presence, empathy, attitude, and attention in three conditions: (A) visualizing and rating the perceptual quality of contents in a Head-Mounted Display (HMD), (B) visualizing the contents in an HMD, and (C) visualizing the contents in an HMD where participants can see their hands and take notes. The experiment simulates an immersive communication environment where participants attend three conversations of different genres and from different acquisition perspectives, designed and acquired in the context of international experiences. In this paper, video quality is evaluated with Single-Stimulus Discrete Quality Evaluation (SSDQE) methodology. Spatial and social presence are evaluated with questionnaires adapted from the literature. Initial empathy is assessed with Interpersonal Reactivity Index (IRI) and a questionnaire is designed to evaluate the attitude changes. Attention is evaluated with three questions about the conversations of the contents that had pass/fail answers. Fifty-four participants were evenly distributed among A, B, and C conditions taking into account their international experience backgrounds (working or studying in a foreign country), obtaining a balanced and diverse sample of participants. The results from the subjective test validate the proposed methodology in VR communications, showing that video quality experiments can be adapted to conditions imposed by experiments focused on the evaluation of socioemotional features in terms of contents of long-duration, actor and observer acquisition perspectives, and genre. In addition, the positive results related to the sense of social and spatial presence imply that technology can be relevant in the analyzed use case. Other main results are: the acquisition perspective greatly influences social presence and all the contents have a positive impact on all participants on their attitude towards international experiences (interest, respect, tolerance, and social sensitivity).Finally, the annotated dataset, Student Experiences Around the World dataset (SEAW-dataset), obtained from the experiment is made publicly available for the research community.

show abstract

Section: Video Quality Assessmentsupporting

confidence: 89%

Section: International Officementioning

confidence: 99%

Methodology to Assess Quality, Presence, Empathy, Attitude, and Attention in 360-degree Videos for Immersive Communications

Orduna,

Pérez,

Gutiérrez

et al. 2021

Preprint

View full text Add to dashboard Cite

show abstract

“…As an alternative to SSCQE, MIRO360 also implements the methodology proposed in [8], which has been labeled as Single Stimulus Discrete Quality Evaluation (SSDQE) in the context of this tool 2 . In this methodology, instead of continuously recording the quality level, it is periodically requested to the user while the video keeps playing on the background (Fig.…”

Section: A In-sequence Assessmentmentioning

confidence: 99%

MIRO360: A Tool for Subjective Assessment of 360 Degree Video for ITU-T P.360-VR

Pérez

Escobar

2019

2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX)

Self Cite

View full text Add to dashboard Cite

This paper describes MIRO360, a tool which implements the diverse set of methodologies that are being evaluated by ITU-T Study Group 12 and the Video Quality Experts Group in the development of the future ITU-T Recommendation P.360-VR for the subjective assessment of 360 video with Head Mounted Displays (HMDs). MIRO360 is an application for Android-based HMDs, with a flexible configuration that allows the simple creation of tests for short sequences (either single or double reference), as well as for long ones, including in-sequence continuous or discrete evaluation, as well as simulator sickness and spatial presence.

show abstract

“…In [61], the authors argue that the subjective test specified by the ITU may not simulate the home environment where the actual viewing is happening. In the standard ITU subjective test, short video sequences are often used, whose contents may not be interested to the viewers.…”

Section: E Subjective Test For 3d Videosmentioning

confidence: 99%

“…In the standard ITU subjective test, short video sequences are often used, whose contents may not be interested to the viewers. Therefore, in [61], the authors propose to use long video sequences, with the test methods shown in Fig. 11.…”

Section: E Subjective Test For 3d Videosmentioning

confidence: 99%

From QoS to QoE: A Tutorial on Video Quality Assessment

Chen

Zhang

2015

IEEE Commun. Surv. Tutorials

279

123

View full text Add to dashboard Cite

Quality of Experience (QoE) is the perceptual Quality of Service (QoS) from the users' perspective. For video service, the relationship between QoE and QoS (such as coding parameters and network statistics) is complicated because users' perceptual video quality is subjective and diversified in different environments. Traditionally, QoE is obtained from subjective test, where human viewers evaluate the quality of tested videos under a laboratory environment. To avoid high cost and offline nature of such tests, objective quality models are developed to predict QoE based on objective QoS parameters, but it is still an indirect way to estimate QoE. With the rising popularity of video streaming over the Internet, data-driven QoE analysis models have newly emerged thanks to availability of large-scale data. In this article, we give a comprehensive survey of the evolution of video quality assessment methods, analyzing their characteristics, advantages and drawbacks. We also introduce QoE-based video applications, and finally identify the future research directions of QoE.Index Terms-Quality of Experience, Subjective Test, Objective Quality Model, Data-driven Analysis 1553-877X (c)

show abstract

Validation of a novel approach to subjective quality evaluation of conventional and 3D broadcasted video services

Cited by 8 publications

References 8 publications

Methodology to Assess Quality, Presence, Empathy, Attitude, and Attention in 360-degree Videos for Immersive Communications

Methodology to Assess Quality, Presence, Empathy, Attitude, and Attention in 360-degree Videos for Immersive Communications

MIRO360: A Tool for Subjective Assessment of 360 Degree Video for ITU-T P.360-VR

From QoS to QoE: A Tutorial on Video Quality Assessment

Contact Info

Product

Resources

About