16K Cinematic VR Streaming

Alface, Patrice Rondão; Aerts, Maarten; Tytgat, Donny; Lievens, Sammy; Stevens, Christoph; Verzijp, Nico; Macq, Jean-François

doi:10.1145/3123266.3123307

Cited by 19 publications

(2 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…First, there are several approaches that evaluate strategies for tile download for partial panoramas [12,13,22,21,15,20]. There are also many recent approaches that work exclusively on 360 • systems [1,2,7,14,28,40,41]. For example, Graf et.…”

Section: Related Workmentioning

confidence: 99%

Efficient Live and On-Demand Tiled HEVC 360 VR Video Streaming

Griwodz

Jeppsson

Espeland

et al. 2019

Int. J. Semantic Computing

View full text Add to dashboard Cite

360∘ panorama video displayed through Virtual Reality (VR) glasses or large screens offers immersive user experiences, but as such technology becomes commonplace, the need for efficient streaming methods of such high-bitrate videos arises. In this respect, the attention that 360∘ panorama video has received lately is huge. Many methods have already been proposed, and in this paper, we shed more light on the different trade-offs in order to save bandwidth while preserving the video quality in the user’s field-of-view (FoV). Using 360∘ VR content delivered to a Gear VR head-mounted display with a Samsung Galaxy S7 and to a Huawei Q22 set-top-box, we have tested various tiling schemes analyzing the tile layout, the tiling and encoding overheads, mechanisms for faster quality switching beyond the DASH segment boundaries and quality selection configurations. In this paper, we present an efficient end-to-end design and real-world implementation of such a 360∘ streaming system. Furthermore, in addition to researching an on-demand system, we also go beyond the existing on-demand solutions and present a live streaming system which strikes a trade-off between bandwidth usage and the video quality in the user’s FoV. We have created an architecture that combines RTP and DASH, and our system multiplexes a single HEVC hardware decoder to provide faster quality switching than at the traditional GOP boundaries. We demonstrate the performance and illustrate the trade-offs through real-world experiments where we can report comparable bandwidth savings to existing on-demand approaches, but with faster quality switches when the FoV changes.

show abstract

Section: Related Workmentioning

confidence: 99%

Efficient Live and On-Demand Tiled HEVC 360 VR Video Streaming

Griwodz

Jeppsson

Espeland

et al. 2019

Int. J. Semantic Computing

View full text Add to dashboard Cite

show abstract

“…This system might suffer from the frame misses due to adjustment error of the rendering time on the server according to the VSync information feedback from the client. In order to reduce the high network transmission size, a few other existing approaches [17]- [19] employ transmitting only the pixel information inside the player's Field-of-View (FoV) through different tiling schemes. Different Tiling schemes based on HEVC is proven to be not the best fit in the latency perspective due to increased encoding and decoding time [20].…”

Section: Related Workmentioning

confidence: 99%

Predictive Scheduling for Virtual Reality

Hou

Naghsh

Paul

et al. 2019

Preprint

View full text Add to dashboard Cite

A significant challenge for future virtual reality (VR) applications is to deliver high quality-of-experience, both in terms of video quality and responsiveness, over wireless networks with limited bandwidth. This paper proposes to address this challenge by leveraging the predictability of user movements in the virtual world. We consider a wireless system where an access point (AP) serves multiple VR users. We show that the VR application process consists of two distinctive phases, whereby during the first (proactive scheduling) phase the controller has uncertain predictions of the demand that will arrive at the second (deadline scheduling) phase. We then develop a predictive scheduling policy for the AP that jointly optimizes the scheduling decisions in both phases.In addition to our theoretical study, we demonstrate the usefulness of our policy by building a prototype system. We show that our policy can be implemented under Furion, a Unity-based VR gaming software, with minor modifications. Experimental results clearly show visible difference between our policy and the default one. We also conduct extensive simulation studies, which show that our policy not only outperforms others, but also maintains excellent performance even when the prediction of future user movements is not accurate.

show abstract

DRL-based transmission control for QoE guaranteed transmission efficiency optimization in tile-based panoramic video streaming

Hai-tao

2023

Multimedia Systems

View full text Add to dashboard Cite

16K Cinematic VR Streaming

Cited by 19 publications

References 6 publications

Efficient Live and On-Demand Tiled HEVC 360 VR Video Streaming

Efficient Live and On-Demand Tiled HEVC 360 VR Video Streaming

Predictive Scheduling for Virtual Reality

DRL-based transmission control for QoE guaranteed transmission efficiency optimization in tile-based panoramic video streaming

Contact Info

Product

Resources

About