A Survey on Adaptive 360° Video Streaming: Solutions, Challenges and Opportunities

Abstract

Omnidirectional or 360 • video is increasingly being used, mostly due to the latest advancements in immersive Virtual Reality (VR) technology. However, its wide adoption is hindered by the higher bandwidth and lower latency requirements than associated with traditional video content delivery. Diverse researchers propose and design solutions that help support an immersive visual experience of 360 • video, primarily when delivered over a dynamic network environment. This paper presents the state-of-the-art on adaptive 360 • video delivery solutions considering end-to-end video streaming in general and then specifically of 360 • video delivery. Current and emerging solutions for adaptive 360 • video streaming, including viewport-independent, viewport-dependent, and tile-based schemes are presented. Next, solutions for network-assisted unicast and multicast streaming of 360 • video content are discussed. Different research challenges for both on-demand and live 360 • video streaming are also analyzed. Several proposed standards and technologies and top international research projects are then presented. We demonstrate the ongoing standardization efforts for 360 • media services that ensure interoperability and immersive media deployment on a massive scale. Finally, the paper concludes with a discussion about future research opportunities enabled by 360 • video.

A Machine Learning Resource Allocation Solution to Improve Video Quality in Remote Education

“…Adaptive delivery solutions are among the most promising approaches proposed. Various multimedia adaptive delivery solutions have been described in the literature including serverlocated adaptive decision making solutions [15], client-located DASH-based approaches [16], solutions which focus on video adaptation only [17] or schemes which target rich media such as multiple sensorial content delivery [18] or omnidirectional video [19] and finally generic adaptive solutions [20], device adaptation mechanisms [21] or network characteristics-aware adaptive schemes [22]. There are also commercial adaptive streaming solutions like Apple's HTTP Live Streaming (HLS), Microsoft's Silverlight and the more recent security-enhanced adaptive solution proposed by Akamai.…”

“…Separately, the learning rates for slave and master value functions are decreased at each iteration. Parameter from (19) and ( 23) decreases exponentially from 1 to 0, such that, more exploration steps would be involved at the beginning of the training stage, while more exploitation steps would be used at the end of this process.…”

SmoothMV

“…High-quality multimedia streaming typically poses stringent requirements in terms of low latency and high bandwidth requirements [7]. Video compression thus plays a crucial role for the deployment of such systems.…”

Special issue on Open Media Compression: Overview, Design Criteria, and Outlook on Emerging Standards

“…2) Systems and Tools: It covers a broad range of topics with the aim to enable efficient delivery of all kinds of media to future consumption devices stimulating human senses, mostly related to sight and hearing but also others such as touch and potentially also smell and taste [46]. The OMAF standard is already covered in this special issue, which is also extensively covered in the scientific literature [47]- [49] addressing dynamic, and adaptive 360 • video streaming use cases [50]- [52]. At the time of writing this article, the second edition of the OMAF standard has been ratified in December 2020, which provides support for more than one viewport and the dynamic bitstream generation according to the viewport among others.…”