Predicting Single Observer&amp;#x2019;s Votes from Objective Measures using Neural Networks

Tiotsop, Lohic Fotio; Mizdos, Tomas; Uhrina, Miroslav; Počta, Peter; Barkowsky, Marcus; Masala, Enrico

doi:10.2352/issn.2470-1173.2020.11.hvei-130

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2023

2024

Publication Types

Select...

Other1

Article1

Relationship

Self Cite0

Independent2

Authors

Journals

Cited by 2 publications

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Training the DNN of a Single Observer by Conducting Individualized Subjective Experiments

Majerl,

Tiotsop,

Barkowsky

2023

2023 15th International Conference on Quality of Multimedia Experience (QoMEX)

View full text Add to dashboard Cite

Training the DNN of a Single Observer by Conducting Individualized Subjective Experiments

Majerl,

Tiotsop,

Barkowsky

2023

2023 15th International Conference on Quality of Multimedia Experience (QoMEX)

View full text Add to dashboard Cite

Multiple Image Distortion DNN Modeling Individual Subject Quality Assessment

Fotio Tiotsop,

Servetti,

Pocta

et al. 2024

ACM Trans. Multimedia Comput. Commun. Appl.

View full text Add to dashboard Cite

A recent research direction is focused on training Deep Neural Networks (DNNs) to replicate individual subject assessments of media quality. These DNNs are referred to as Artificial Intelligence-based Observers (AIOs). An AIO is designed to simulate, in real-time, the quality ratings of a specific individual, enabling an automatic quality assessment that accounts for subjects characteristics and preferences. Training AIOs is a promising but challenging research area due to the greater noise in individual raw opinion scores compared to the Mean Opinion Score (MOS). Effective learning from noisy labels necessitates the training of complex models on large-scale datasets. Unfortunately, this is challenging for AIOs as the media quality assessment community lacks extensive datasets that include individual opinion scores. To address the complexity of the task, we first created a dataset comprising two million samples, with synthetic labels derived from human annotation. We then trained a customized network for image quality assessment, named Multi-Distortion ResNet50 (MDResNet50), on this dataset. The weights of the MDResNet50 were subsequently utilized to initialize the learning process of each AIO, thereby avoiding the need to train a complex model from scratch on a small-scale dataset with raw individual opinion scores. Computational experiments show that our approach significantly advances the state-of-the-art in the AIO research. In particular: i) we demonstrate through a simulation the ability of AIOs to mimic two well-known behavioral characteristics of a subject, i.e.,bias and inconsistency, when scoring the media quality; ii) we train and release DNN-based AIOs that, compared to the state-of-the-art, exhibit a higher performance with a statistical significance in assessing multiple image distortions; iii) we train AIOs that more accurately mimic the sensitivity of real subjects to noise and color saturation, and also better predict the opinion score distribution compared to the state-of-the-art AIOs.

show abstract

Predicting Single Observer’s Votes from Objective Measures using Neural Networks

Abstract: Fast track article for IS&T International Symposium on Electronic Imaging 2020: Human Vision and Electronic Imaging proceedings.

Cited by 2 publications

References 0 publications

Training the DNN of a Single Observer by Conducting Individualized Subjective Experiments

Training the DNN of a Single Observer by Conducting Individualized Subjective Experiments

Multiple Image Distortion DNN Modeling Individual Subject Quality Assessment

Contact Info

Product

Resources

About