Full Reference Video Quality Measures Improvement Using Neural Networks

Tiotsop, Lohic Fotio; Servetti, Antonio; Masala, Enrico

doi:10.1109/icassp40776.2020.9053739

Cited by 4 publications

(1 citation statement)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The analysis is conducted on five subjectively annotated datasets, i.e., the ITS4S dataset [7,22], the Netflix public dataset [15] and three datasets released by the Video Quality Expert Group (VQEG): the VQEG-HD1 [27], VQEG-HD3 [27], and VQEG-HD5 [27]. Sample images taken from SRCs in those datasets are shown in Fig.…”

Section: The Inaccuracy Of Subjective Experiments With a Limited Numbmentioning

confidence: 99%

Modeling and estimating the subjects’ diversity of opinions in video quality assessment: a neural network based approach

Tiotsop

Mizdos

Uhrina

et al. 2020

Multimed Tools Appl

Self Cite

View full text Add to dashboard Cite

Subjective experiments are considered the most reliable way to assess the perceived visual quality. However, observers’ opinions are characterized by large diversity: in fact, even the same observer is often not able to exactly repeat his first opinion when rating again a given stimulus. This makes the Mean Opinion Score (MOS) alone, in many cases, not sufficient to get accurate information about the perceived visual quality. To this aim, it is important to have a measure characterizing to what extent the observed or predicted MOS value is reliable and stable. For instance, the Standard deviation of the Opinions of the Subjects (SOS) could be considered as a measure of reliability when evaluating the quality subjectively. However, we are not aware of the existence of models or algorithms that allow to objectively predict how much diversity would be observed in subjects’ opinions in terms of SOS. In this work we observe, on the basis of a statistical analysis made on several subjective experiments, that the disagreement between the quality as measured by means of different objective video quality metrics (VQMs) can provide information on the diversity of the observers’ ratings on a given processed video sequence (PVS). In light of this observation we: i) propose and validate a model for the SOS observed in a subjective experiment; ii) design and train Neural Networks (NNs) that predict the average diversity that would be observed among the subjects’ ratings for a PVS starting from a set of VQMs values computed on such a PVS; iii) give insights into how the same NN based approach can be used to identify potential anomalies in the data collected in subjective experiments.

show abstract

Section: The Inaccuracy Of Subjective Experiments With a Limited Numbmentioning

confidence: 99%