Recent developments in visual quality monitoring by key performance indicators

Abstract

In addition to traditional Quality of Service (QoS), Quality of Experience (QoE) poses a real challenge for Internet service providers, audio-visual services, broadcasters and new Over-The-Top (OTT) services. Therefore, objective audio-visual metrics are frequently being dedicated in order to monitor, troubleshoot, investigate and set benchmarks of content applications working in real-time or off-line. The concept proposed here, Monitoring of Audio Visual Quality by Key Performance Indicators (MOAVI), is able to isolate and focus investigation, set-up algorithms, increase the monitoring period and guarantee better prediction of perceptual quality. MOAVI artefacts Key Performance Indicators (KPI) are classified into four categories, based on their origin: capturing, processing, transmission, and display. In the paper, we present experiments carried out over several steps with four experimental set-ups for concept verification. The methodology takes into the account annoyance visibility threshold. The experimental methodology is adapted from International Telecommunication Union -Telecommunication Standardization Sector (ITU-T)The research leading to these results has received funding from the European Regional Development Fund

Real-Time QoE Monitoring System for Video Streaming Services with Adaptive Media Playout

“…Since the QoE evaluation for streaming services becomes more and more important, several QoE evaluation or monitoring tools were developed [15][16][17][18][19]. A QoE monitoring tool for multimedia quality assessment in NS-3 network simulator was presented in [15].…”

“…Although the monitoring service can improve the user experience, the presented QoE factors are still not good enough. In [18], the proposed concept, Monitoring of Audio Visual Quality by Key Performance Indicators (MOAVI), is able to isolate and focus investigation, set up algorithms, increase the monitoring period, and guarantee better prediction of perceptual quality. In [19], Ickin et al added functionality to the VideoLAN Client (VLC) media player [20] to record a set of metrics from the user interface, application-level, network-level, and the available sensors of the device.…”

“…Since the playout rate of the AMP system can be dynamically adjusted during video playback, the effects of AMP on QoE must be considered as well. However, almost all the developed QoE monitoring tools in the literature [15][16][17][18][19] did not take the effects of AMP on QoE into account. Thus, in [23] we proposed the QoE monitoring system that takes the effects of AMP on QoE into consideration.…”

Software package for measurement of quality indicators working in no-reference model

“…This software package is the realisation of a previously developed concept of monitoring the quality of vision, by Key Performance Indicators (KPI) [19]. The idea proposed here goes by the name: Monitoring Of Audio Visual quality by Key Performance Indicators (MOAVI).…”

Monitoring of audio visual quality by key indicators

“…As such, the concept used in MOAVI is completely in phase with user experience. There are many reasons for video disturbance, and they can arise at any point along the video chain transmission (filming stage to end-user stage) [13].…”