Adaptive 360-Degree Video Streaming using Scalable Video Coding

Nasrabadi, Afshin Taghavi; Mahzari, Anahita; Beshay, Joseph D.; Prakash, Ravi

doi:10.1145/3123266.3123414

Cited by 95 publications

(30 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The streaming schemes of viewport-adaptive 360-degree videos have been widely studied for traffic reduction. The main approach of viewport-adaptive 360-degree video streaming includes tile-based schemes [2]- [7], [21]- [34]. The tile-based schemes divide each 360-degree video frame into sub-frames called tiles.…”

Section: B Viewport-adaptive 360-degree Video Streamingmentioning

confidence: 99%

“…To deliver the optimal quality of 360-degree video over wired/wireless links, each tile is encoded into different quality levels. [2], [3] encoded the tiles into two layers, i.e., the base layer and the enhancement layer. The base layer provided the entire 360-degree video frame, while the enhancement layer improved the quality of the tiles corresponding to the predicted field of view (FoV).…”

Section: B Viewport-adaptive 360-degree Video Streamingmentioning

confidence: 99%

“…In conventional viewport-adaptive 360-degree video delivery schemes over wireless links, digital video compression and digital wireless transmission are performed in sequence [2]- [7] for the 360-degree video frames. For example, the video compression part uses the H.265/High-Efficiency Video Coding [8] standard and generates a compressed bitstream by implementing nonlinear quantization and entropy coding operations defined in MPEG-I (MPEG Immersive media) standard.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos

Fujihashi

Saruwatari

et al. 2021

IEEE Access

View full text Add to dashboard Cite

The existing viewport-adaptive 360-degree video streaming schemes encode tiled 360degree videos with digital-based compression. However, these schemes cause a cliff effect wherein the headset video quality drops when the channel signal-to-noise ratio (SNR) falls below a certain threshold. To realize high-quality wireless 360-degree video streaming, we propose a novel viewport-adaptive soft delivery scheme for 360-degree videos, called 360Cast+. 360Cast+ skips the non-linear operations in digital-based streaming and adopts power allocation and analog modulation to achieve graceful video quality improvement in unstable wireless links. In particular, 360Cast+ integrates the human vision system (HVS) and projection distortion as a perceptual weight in power allocation operations. A near-optimal low-complexity subcarrier matching algorithm was also adopted to extend 360Cast+ to fading channel environments. To reduce the effect of the prediction error, 360Cast+ uses dynamic linear regression (DLR) to predict the future orientation and future prediction error to extract the extension area around a viewport. The evaluation results demonstrated that the proposed 360Cast+ provides sophisticated video quality irrespective of the prediction error and channel conditions in orthogonal frequency-division multiplexing (OFDM)-based systems. INDEX TERMS 360-degree video delivery, soft delivery, viewport adaptive

show abstract

Section: B Viewport-adaptive 360-degree Video Streamingmentioning

confidence: 99%

Section: B Viewport-adaptive 360-degree Video Streamingmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos

Fujihashi

Saruwatari

et al. 2021

IEEE Access

View full text Add to dashboard Cite

show abstract

“…Transmission aspects of 360 • HTTP streaming have been explored in [16,17]. Applications of scalable video coding to 360 • streaming have been studied in [18,19]. Head movement prediction and the impact of navigation uncertainty have been investigated in [3,14].…”

Section: Related Workmentioning

confidence: 99%

Viewport-Driven Rate-Distortion Optimized 360º Video Streaming

Chakareski

Aksu

Corbillon³

et al. 2018

2018 IEEE International Conference on Communications (ICC)

View full text Add to dashboard Cite

The growing popularity of virtual and augmented reality communications and 360 • video streaming is moving video communication systems into much more dynamic and resource-limited operating settings. The enormous data volume of 360 • videos requires an efficient use of network bandwidth to maintain the desired quality of experience for the end user. To this end, we propose a framework for viewport-driven rate-distortion optimized 360 • video streaming that integrates the user view navigation pattern and the spatiotemporal rate-distortion characteristics of the 360 • video content to maximize the delivered user quality of experience for the given network/system resources. The framework comprises a methodology for constructing dynamic heat maps that capture the likelihood of navigating different spatial segments of a 360 • video over time by the user, an analysis and characterization of its spatiotemporal rate-distortion characteristics that leverage preprocessed spatial tilling of the 360 • view sphere, and an optimization problem formulation that characterizes the delivered user quality of experience given the user navigation patterns, 360 • video encoding decisions, and the available system/network resources. Our experimental results demonstrate the advantages of our framework over the conventional approach of streaming a monolithic uniformlyencoded 360 • video and a state-of-the-art reference method. Considerable video quality gains of 4 -5 dB are demonstrated in the case of two popular 4K 360 • videos.

show abstract

“…However, visual attention modelling [Borji and Itti 2013;Carrasco 2011;Itti and Borji 2014] and saliency prediction [Monroy et al 2018;of Nantes and Technicolor 2017;Rai et al 2017] are crucial in order to predict where users will eventually look. With this information in place, video streaming quality can be enhanced [Nasrabadi et al 2017;Ozcinar et al 2017b,a] or labor-intensive quality control can be automated in post-production [Croci et al 2017]. Finally, understanding visual attention also supports the storytelling process for 360 • video [Bender 2018;Pavel et al 2017;Sheikh et al 2016], e.g.…”

Section: Introductionmentioning

confidence: 99%

Director's cut

Knorr

Özçinar

Fearghail

et al. 2018

Proceedings of the 15th ACM SIGGRAPH European Conference on Visual Media Production

View full text Add to dashboard Cite

Methods of storytelling in cinema have well established conventions that have been built over the course of its history and the development of the format. In 360 • film many of the techniques that have formed part of this cinematic language or visual narrative are not easily applied or are not applicable due to the nature of the format i.e. not contained the border of the screen. In this paper, we analyze how end-users view 360 • video in the presence of directional cues and evaluate if they are able to follow the actual story of narrative 360 • films. We first let filmmakers create an intended scan-path, the so called director's cut, by setting position markers in the equirectangular representation of the omnidirectional content for eight short 360 • films.

show abstract

Adaptive 360-Degree Video Streaming using Scalable Video Coding

Cited by 95 publications

References 12 publications

360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos

360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos

Viewport-Driven Rate-Distortion Optimized 360º Video Streaming

Director's cut

Contact Info

Product

Resources

About