A Survey of Standardized Approaches towards the Quality of Experience Evaluation for Video Services: An ITU Perspective

Abstract

Over the past few years there has been an exponential increase in the amount of multimedia data being streamed over the Internet. At the same time, we are also witnessing a change in the way quality of any particular service is interpreted, with more emphasis being given to the end-users. Thus, silently there has been a paradigm shift from the traditional Quality of Service approach (QoS) towards a Quality of Experience (QoE) model while evaluating the service quality. A lot of work that tries to evaluate the quality of audio, video, and multimedia services over the Internet has been done. At the same time, research is also going on trying to map the two different domains of quality metrics, i.e., the QoS and QoE domain. Apart from the work done by individual researchers, the International Telecommunications Union (ITU) has been quite active in this area of quality assessment. This is obvious from the large number of ITU standards that are available for different application types. The sheer variety of techniques being employed by ITU as well as other researchers sometimes tends to be too complex and diversified. Although there are survey papers that try to present the current state of the art methodologies for video quality evaluation, none has focused on the ITU perspective. In this work, we try to fill up this void by presenting up-to-date information on the different measurement methods that are currently being employed by ITU for a video streaming scenario. We highlight the outline of each method with sufficient detail and try to analyze the challenges being faced along with the direction of future research.

A User Prioritisation Algorithm for Horizontal Handover in Dense WLANs

“…In this paper we considered the objective reasoning. Specifically, the MOS values in Table 3 have been obtained considering the surveys conducted in [34][35][36] based on subjective quality evaluation tests. Customers were required to rate the QoE based on their expectation in terms of objective quality of delay, jitter, bandwidth and SINR.…”

Quality of Experience for Streaming Services: Measurements, Challenges and Insights

“…There are a large number of standards, that offer indications on good and accustomed practices, for certain test applications, standards do not provide the best or most advanced method available, but it gives solid, common basis which is accessible to all, like ITU -International Telecommunication Union [75] (Table II). Furthermore, a survey [76] summarized various ITU-measurement methods to evaluate video streaming quality.…”

Minkowski Distance as a Quality of Service Assessment Tool

“…The mathematical procedure followed to compute the distance between the required and the measured QoS parameters is explained as follows. After transforming (i.e., normalizing) the input data (the required and the measured), the Minkowski distance are carried out as illustrated in (3) and (4). X values represent the actual measurements (measured delay, measured jitter, and measured loss) and the Y values represent required (desired) values (delay, jitter, and packet loss).…”