Multi-stream switching for interactive virtual reality video streaming

Cheung, Gene; Liu, Zhi; Ma, Zhiyou; Tan, Jack Z. G.

doi:10.1109/icip.2017.8296668

Cited by 19 publications

(8 citation statements)

References 16 publications

(24 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The delivery of 360 o video has been studied in [26], where the objective is to design multiple VR streams of different view ranges and find the optimal head angle-tostream mapping under the bandwidth and storage constraints. This is done to avoid drifting as coded VR streams tend to overlap in view ranges.…”

Section: Related Workmentioning

confidence: 99%

Tile-Based Joint Caching and Delivery of 360° Videos in Heterogeneous Networks

Maniotis

Bourtsoulatze

Thomos

2020

IEEE Trans. Multimedia

View full text Add to dashboard Cite

The recent surge of applications involving the use of 360 o video challenges mobile networks infrastructure, as 360 o video files are of significant size, and current delivery and edge caching architectures are unable to guarantee their timely delivery. In this paper, we investigate the problem of joint collaborative content-aware caching and delivery of 360 o videos in a video on demand setting. The proposed scheme takes advantage of 360 o video encoding in multiple tiles and layers to make fine-grained decisions regarding which tiles to cache in each Small Base Station (SBS), and where to deliver them from to the end users, as users may reside in the coverage area of multiple SBSs. This permits to cache the most popular tiles in the SBSs, while the remaining tiles may be obtained through the backhaul. In addition, we explicitly consider the time delivery constraints to ensure continuous video playback. To reduce the computational complexity of the optimization problem, we simplify it by introducing a fairness constraint. This allows us to split the original problem into subproblems corresponding to Groups of Pictures (GOP). Each of the subproblems is then solved with the method of Lagrange partial relaxation. Finally, we evaluate the performance of the proposed method for various system parameters and compare it with schemes that do not consider 360 o video encoding into multiple tiles and quality layers, as well as with two variants of the proposed method: one that considers layered encoding and SBSs collaboration and another that uses tiles encoding but with no SBSs collaboration. The results showcase the benefits coming from caching and delivery decisions on per tile basis and the importance of exploiting SBSs collaboration.Index Terms-Collaborative caching, 360 o video, tile encoding, layered video, distortion optimization.

show abstract

Section: Related Workmentioning

confidence: 99%

Tile-Based Joint Caching and Delivery of 360° Videos in Heterogeneous Networks

Maniotis

Bourtsoulatze

Thomos

2020

IEEE Trans. Multimedia

View full text Add to dashboard Cite

show abstract

“…Divide variables (t, e) into blocks (t h , e h ), h ∈ H K , one for each h ∈ H K . Note that the objective and the constraints in ( 8), ( 9), ( 14) of Problem 2 are block separable, and the constraints in (15) are the only coupling constraints that involve variables from different blocks. In addition, note that Problem 2 is convex and strictly feasible, implying that Slaters condition holds, and hence the duality gap is zero.…”

Section: A Case Without User Transcoding and With Absolute Smoothness...mentioning

confidence: 99%

“…In [14], [15], the authors consider streaming of singlequality 360 VR videos in single-user wireless networks. The proposed solutions in [14], [15] may not yield efficient transmission for single-quality 360 VR videos in multi-user wireless networks, as optimal resource sharing among users with heterogeneous channel conditions is not considered. Furthermore, when multiple users are watching one 360 VR video simultaneously, transmission efficiency can be improved by exploiting potential multicast opportunities.…”

Section: Introductionmentioning

confidence: 99%

Optimal Wireless Streaming of Multi-Quality 360 VR Video by Exploiting Natural, Relative Smoothness-enabled and Transcoding-enabled Multicast Opportunities

Long

Cui

et al. 2020

Preprint

Self Cite

View full text Add to dashboard Cite

In this paper, we would like to investigate optimal wireless streaming ofamulti-quality tiled 360 virtual reality (VR) video from a server to multiple users. To this end, we propose to maximally exploit potential multicast opportunities by effectivelyutilizing characteristics ofmulti-quality tiled 360 VR videos and computation resources at the users side. Inparticular, we consider two requirements for quality variation in one fieldof-view (FoV), i.e., the absolute smoothnessrequirement and the relative smoothness requirement, and two video playback modes, i.e., the direct-playback mode (without user transcoding) and transcode-playback mode (with user transcoding).Besides natural multicast opportunities, we introducetwo new types of multicast opportunities, namely, relative smoothness-enabled multicast opportunities, which allow flexibletradeoff between viewing quality and communications resource consumption,and transcodingenabled multicast opportunities,which allow flexibletradeoffbetween computation and communications resource consumptions. Then, we establish a novel mathematical model that reflects the impacts ofnatural, relativesmoothness-enabled andtranscodingenabledmulticastopportunitieson the average transmission energy and transcoding energy. Based on this model, we optimize the transmission resource allocation, playback quality level selection and transmission quality level selection to minimize the energy consumption in the four cases with differentrequirements for quality variation and video playback modes. By comparing the optimal values in the four cases, we prove that the energy consumption reduces when more multicast opportunities can be utilized. Finally, numerical results show substantial gains of the proposed solutions over existing schemes, and demonstrate the importance of effective exploitation of the three types of multicast opportunities.

show abstract

“…In this context, transmission of a current region-of-interest [2]- [4] or viewport-dependent streaming solutions [5]- [10] can be utilized to enhance the perceived VR video quality. However, in video transmission scenarios with delay-prone communication pipelines [11] and rapid head orientation activities [12], such solutions are merely inefficient in terms of complying with the motion-to-photon latency requirement; thus penalizing the quality of experience (QoE).…”

Section: Introductionmentioning

confidence: 99%

Visual Attention-Aware Omnidirectional Video Streaming Using Optimal Tiles for Virtual Reality

Özçinar

Cabrera

Smolić

2019

IEEE J. Emerg. Sel. Topics Circuits Syst.

View full text Add to dashboard Cite

Owing to its interactive look around nature and very large resolution requirement, providing immersive omnidirectional video (ODV) streaming experiences in virtual reality applications demands cost-effective solutions to meet both the content delivery network and device constraints. In this paper, we introduce an adaptive ODV streaming pipeline that optimizes dynamic adaptive streaming over HTTP representations of ODV content considering their visual attention (VA) maps. The main contribution of this paper is the use of VA maps: 1) to compute a novel objective quality metric that captures the fact that not all of the ODV is actually watched by users: the VA spherical weightedbased objective quality measurement; 2) to define optimal tile representations of the ODV frames, namely, tiling schemes, which are composed of variable-sized and non-overlapping tiles; and 3) to efficiently distribute a given bitrate budget among the set of tiles within a tiling scheme for an ODV. We evaluate the proposed system performance with varying bandwidth conditions and the tracked head orientations from user experiments. Results show that the proposed system significantly outperforms the existing non-tiled and tile-based streaming solutions.

show abstract

Multi-stream switching for interactive virtual reality video streaming

Cited by 19 publications

References 16 publications

Tile-Based Joint Caching and Delivery of 360° Videos in Heterogeneous Networks

Tile-Based Joint Caching and Delivery of 360° Videos in Heterogeneous Networks

Optimal Wireless Streaming of Multi-Quality 360 VR Video by Exploiting Natural, Relative Smoothness-enabled and Transcoding-enabled Multicast Opportunities

Visual Attention-Aware Omnidirectional Video Streaming Using Optimal Tiles for Virtual Reality

Contact Info

Product

Resources

About