Towards subjective quality of experience assessment for omnidirectional video streaming

Schatz, Raimund; Sackl, Andreas; Timmerer, Christian; Gardlo, Bruno

doi:10.1109/qomex.2017.7965657

Cited by 73 publications

(39 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A discussion of QoE issues in the implementation of AR services in big cities with a high density of users is given in [291]. The impact of stalling events in a fully immersive setting involving users watching omnidirectional videos using an HMD is discussed by Schatz et al in [323].…”

Section: A Qoe In Immersive Ar/vr and Mulsemedia Applicationsmentioning

confidence: 99%

QoE Management of Multimedia Streaming Services in Future Networks: A Tutorial and Survey

Barakabitze

Barman

Ahmad

et al. 2020

IEEE Commun. Surv. Tutorials

147

View full text Add to dashboard Cite

The highly demanding Over-The-Top (OTT) multimedia applications pose increased challenges to Internet Service Providers (ISPs) for assuring a reasonable Quality of Experience (QoE) to their customers due to lack of flexibility, agility and scalability in traditional networks. The future networks are shifting towards the cloudification of the network resources via Software Defined Networks (SDN) and Network Function Virtualization (NFV). This will equip ISPs with cutting-edge technologies to provide service customization during service delivery and offer QoE which meets customers' needs via intelligent QoE control and management approaches. Towards this end, we provide in this paper a tutorial and a comprehensive survey of QoE management solutions in current and future networks. We start with a highlevel description of QoE management for multimedia services, which integrates QoE modelling, monitoring, and optimization. This followed by a discussion of HTTP Adaptive Streaming (HAS) solutions as the dominant technique for streaming videos over the best-effort Internet. We then summarize the key elements in SDN/NFV along with an overview of ongoing research projects, standardization activities and use cases related to SDN, NFV, and other emerging applications. We provide a survey of the state-of-the-art of QoE management techniques categorized into three different groups: a) QoE-aware/driven strategies using SDN and/or NFV; b) QoE-aware/driven approaches for adaptive streaming over emerging architectures such as multi-access edge computing, cloud/fog computing, and information-centric networking; and c) extended QoE management approaches in new domains such as immersive augmented and virtual reality, mulsemedia and video gaming applications. Based on the review, we present a list of identified future QoE management challenges regarding emerging multimedia applications, network management and orchestration, network slicing and collaborative service management in softwarized networks. Finally, we provide a discussion on future research directions with a focus on emerging research areas in QoE management, such as QoEoriented business models, QoE-based big data strategies, and scalability issues in QoE optimization.

show abstract

Section: A Qoe In Immersive Ar/vr and Mulsemedia Applicationsmentioning

confidence: 99%

QoE Management of Multimedia Streaming Services in Future Networks: A Tutorial and Survey

Barakabitze

Barman

Ahmad

et al. 2020

IEEE Commun. Surv. Tutorials

147

View full text Add to dashboard Cite

show abstract

“…In recent years, extensive works have emerged for VQA on omnidirectional video. For subjective VQA, a handful of testbeds were proposed to subjectively rate the content [40] and streaming [28] of omnidirectional video. Additionally, some subjective experiments were conducted in [20,31,39], finding some key factors that have impact on the visual quality of omnidirectional video under different scenes [20,39] and devices [31].…”

Section: Related Workmentioning

confidence: 99%

“…Therefore, it is necessary to study on visual quality assessment (VQA) for omnidirectional video. Most recently, several subjective VQA approaches [20,28,30,31,39,40,47,51] and objective VQA approaches [35,38,41,45,49,50] have been proposed for either omnidirectional image or video. Among these approaches, the impact of some factors on the quality of omnidirectional video were studied, such as display types, coding schemes and sample uniformity under different map projections.…”

Section: Introductionmentioning

confidence: 99%

Bridge the Gap Between VQA and Human Behavior on Omnidirectional Video

et al. 2018

Proceedings of the 26th ACM International Conference on Multimedia

View full text Add to dashboard Cite

Omnidirectional video enables spherical stimuli with the 360 × 180 • viewing range. Meanwhile, only the viewport region of omnidirectional video can be seen by the observer through head movement (HM), and an even smaller region within the viewport can be clearly perceived through eye movement (EM). Thus, the subjective quality of omnidirectional video may be correlated with HM and EM of human behavior. To fill in the gap between subjective quality and human behavior, this paper proposes a large-scale visual quality assessment (VQA) dataset of omnidirectional video, called VQA-OV, which collects 60 reference sequences and 540 impaired sequences. Our VQA-OV dataset provides not only the subjective quality scores of sequences but also the HM and EM data of subjects. By mining our dataset, we find that the subjective quality of omnidirectional video is indeed related to HM and EM. Hence, we develop a deep learning model, which embeds HM and EM, for objective VQA on omnidirectional video. Experimental results show that our model significantly improves the state-of-the-art performance of VQA on omnidirectional video. CCS CONCEPTS• Human-centered computing → Virtual reality; KEYWORDSOmnidirectional video, visual quality assessment, human behavior ACM Reference Format:

show abstract

“…Others have shown significant storage and bandwidth savings by converting the equirectangular representation typically used to store 360°videos to a cube map layout [22], performed QoE-based measurement studies [26], and studied the impact that projection techniques, quantization parameters, and tile patterns may have on the playback experience and resource requirements [11]. The usage of tiles allows for independent encoding of different regions of a frame.…”

Section: Related Workmentioning

confidence: 99%

Proceedings of the 9th ACM Multimedia Systems Conference

2018

View full text Add to dashboard Cite

With 360°video, only a limited fraction of the full view is displayed at each point in time. This has prompted the design of streaming delivery techniques that allow alternative playback qualities to be delivered for each candidate viewing direction. However, while prefetching based on the user's expected viewing direction is best done close to playback deadlines, large buffers are needed to protect against shortfalls in future available bandwidth. This results in conflicting goals and an important prefetch aggressiveness tradeoff problem regarding how far ahead in time from the current playpoint prefetching should be done. This paper presents the first characterization of this tradeoff. The main contributions include an empirical characterization of head movement behavior based on data from viewing sessions of four different categories of 360°v ideo, an optimization-based comparison of the prefetch aggressiveness tradeoffs seen for these video categories, and a data-driven discussion of further optimizations, which include a novel system design that allows both tradeoff objectives to be targeted simultaneously. By qualitatively and quantitatively analyzing the above tradeoffs, we provide insights into how to best design tomorrow's delivery systems for 360°videos, allowing content providers to reduce bandwidth costs and improve users' playback experiences. CCS CONCEPTS• Information systems → Multimedia streaming; • Networks → Application layer protocols; KEYWORDS 360°streaming, optimized prefetching, view prediction

show abstract

Towards subjective quality of experience assessment for omnidirectional video streaming

Cited by 73 publications

References 12 publications

QoE Management of Multimedia Streaming Services in Future Networks: A Tutorial and Survey

QoE Management of Multimedia Streaming Services in Future Networks: A Tutorial and Survey

Bridge the Gap Between VQA and Human Behavior on Omnidirectional Video

Proceedings of the 9th ACM Multimedia Systems Conference

Contact Info

Product

Resources

About