Towards reduced reference parametric models for estimating audiovisual quality in multimedia services

Abstract

Abstract-We have developed reduced reference parametric models for estimating perceived quality in audiovisual multimedia services. We have created 144 unique configurations for audiovisual content including various application and network parameters such as bitrates and distortions in terms of bandwidth, packet loss rate and jitter. To generate the data needed for model training and validation we have tasked 24 subjects, in a controlled environment, to rate the overall audiovisual quality on the absolute category rating (ACR) 5-level quality scale. We have developed models using Random Forest and Neural Network based machine learning methods in order to estimate Mean Opinion Scores (MOS) values. We have used information retrieved from the packet headers and side information provided as network parameters for model training. Random Forest based models have performed better in terms of Root Mean Square Error (RMSE) and Pearson correlation coefficient. The side information proved to be very effective in developing the model. We have found that, while the model performance might be improved by replacing the side information with more accurate bit stream level measurements, they are performing well in estimating perceived quality in audiovisual multimedia services.

Framework for Modelling Mobile Network Quality of Experience Through Big Data Analytics Approach

“…The data exploration observed by Diaz-Aviles et al (2015) showed a promising correlation between the data feeds gathered from the network traffic and the registered calls to the care center, which enabled the prediction of user experience in real-time. Evidently, the restricted random forest showed 59% precision by Diaz-Aviles et al (2015), representing a fair MOS score (Demirbilek & Gregoire, 2016). The low precision observed by Diaz-Aviles et al (2015), indicated the unbalances observed in the data, because only a limited number of users would call customer care to report issues observed in the usage of the mobile Internet.…”

“…Observation of the data instances in this case represents the independent variable (that is, the extracted features from the big datasets and expectations) while the categories predicted are the possible values of dependent variables (perceived QoE) which are the classes or outcomes. The categorical outcome is usually represented as Excellent =5, Good =4, Fair =3, Poor =2, and Bad =1 (Demirbilek & Gregoire, 2016). The modelling of perceived QoE using the machine-learning algorithms would map the combination of input parameters to a class value to build an efficient model that classifies extracted features with maximum precision through the perceived QoE function described as QoE l examined the positive and negative impacts of fect as in the case of the IQX hypothesis.…”

Perceptual Quality of Audio-Visual Content with Common Video and Audio Degradations

“…In addition, these results are compared with external perceptual responses gathered from the literature. To this end, perceptual data from VQEG-MM [19], UnB-2013 [25], INRS [44], and LIVE-NFLX-II [24] were considered for comparison. The Cronbach's alpha coefficients for these datasets are reported in Table 14.…”

UnB-AV: An Audio-Visual Database for Multimedia Quality Research

“…The sixth database is the INRS [28], which contains a single 720p SRC of 45 seconds. The database con- tains 160 HRCs, consisting of video (H.264) compression bitrates and network settings (frame rate, packet loss rate, quantization, and noise reduction parameters).…”