Optimal layered representation for adaptive interactive multiview video streaming

Abreu, António; Toni, Laura; Thomos, Nikolaos; Maugey, Thomas; Pereira, Fernando; Frossard, Pascal

doi:10.1016/j.jvcir.2015.09.010

Cited by 13 publications

(19 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…With the observation of their evaluations, the multiresolution projections of Equirectangle and Cubemap outperform other projection schemes, significantly. (De Abreu et al, 2015) proposed a novel adaptive transmission solution that jointly selects the optimal subsets of views streams and rate allocation per view for a hierarchical transmission in IMVS applications. They consider a system where the network is characterized by clients with heterogeneous bandwidth capabilities, and they aim to minimize their expected navigation distortion.…”

Section: Encoding Overhead Optimizationmentioning

confidence: 99%

Network Support for AR/VR and Immersive Video Application: A Survey

Westphal

Garcia-Luna-Aceves

2018

Proceedings of the 15th International Joint Conference on E-Business and Telecommunications

View full text Add to dashboard Cite

Abstract:Augmented Reality and Virtual Reality are rapidly gaining attention and are increasingly being deployed over the network. These technologies have large industrial potential to become next big platform with a wide range of applications. This experience will only be satisfying when the network infrastructure is able to support these applications. Current networks however, are still having a hard time streaming high quality videos. The advent of 5G Networks will improve the network performance, but it is unclear it will be sufficient to provide new applications delivering augmented reality and virtual reality services. There are few surveys on the topic of augmented reality systems, and their focus mostly stays on the actual displays and potential applications. We survey the literature on AR/VR networking, and we focus here on the potential underlying network issues.

show abstract

Section: Encoding Overhead Optimizationmentioning

confidence: 99%

Network Support for AR/VR and Immersive Video Application: A Survey

Westphal

Garcia-Luna-Aceves

2018

Proceedings of the 15th International Joint Conference on E-Business and Telecommunications

View full text Add to dashboard Cite

show abstract

“…In summary, our results show that our system provides a good step in the right direction for providing seamless stream bundling services. [2], coding schemes that facilitate quick viewpoint switching [23], [24], [25], and that combine multiple texture/color and depth map streams to achieve free viewpoint streaming, including of virtual viewpoints [26], [5], [27], [28], [29]. In the context of 3D-TV, both multi-layered solutions [30] and prefetching information of alternative viewpoints [31] have been shown useful.…”

Section: H Bandwidth Variationsmentioning

confidence: 99%

Optimized Adaptive Streaming of Multi-video Stream Bundles

Carlsson

Eager

Krishnamoorthi

et al. 2017

IEEE Trans. Multimedia

View full text Add to dashboard Cite

Abstract-In contrast to traditional video, multi-view video streaming allows viewers to interactively switch among multiple perspectives provided by different cameras. One approach to achieving such a service is to encode the video from all of the cameras into a single stream, but this has the disadvantage that only a portion of the received video data will be used, namely that required for the selected view at each point in time. In this paper we introduce the concept of a "multi-video stream bundle" that consists of multiple parallel video streams that are synchronized in time, each providing the video from a different camera capturing the same event or movie. For delivery we leverage the adaptive features and time-based chunking of HTTPbased Adaptive Streaming (HAS), but now employing adaptation in both content and rate. Users are able to change their viewpoint on-demand and the client player adapts the rate at which data is retrieved from each stream based on the user's current view, the probabilities of switching to other views, and the user's current bandwidth conditions. A crucial component of such a system is the prefetching policy. For this we present an optimization model as well as a simpler heuristic that can balance the playback quality and the probability of playback interruptions. After analytically and numerically characterizing the optimal solution, we present a prototype implementation and sample results. Our prefetching and buffer management solution is shown to provide close to seamless playback switching when there is sufficient bandwidth to prefetch the parallel streams.

show abstract

“…In particular, we study an IMVS application provided to users over a cellular network. IMVS enables users to freely explore the 3D scene of interest from different viewpoints in real time [5]. The challenge of offering such interactivity to users is the need to deliver multiple video streams corresponding to different views, as views selected by users are not known a priori.…”

Section: Introductionmentioning

confidence: 99%

“…Though joint caching and routing has been previously considered in the literature [4], [6], [7], [8], the time constraints and the quality of the delivered video have not been taken into account in the proposed solutions. The optimal selection of the delivered views that maximizes the video quality has been studied in [5], [9]. In these works the delivered sets of views are optimized assuming the bandwidth resources of the users are fixed and known a priori.…”

Section: Introductionmentioning

confidence: 99%

Cache-Aided Interactive Multiview Video Streaming in Small Cell Wireless Networks

Bourtsoulatze

Gündüz

2018

2018 IEEE 29th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC)

View full text Add to dashboard Cite

The emergence of novel interactive multimedia applications with high rate and low latency requirements has led to a drastic increase in the video data traffic over wireless cellular networks. Endowing the small base stations of a macrocell with caches that can store some of the content is a promising technology to cope with the increasing pressure on the backhaul connections, and to reduce the delay for demanding video applications. In this work, delivery of an interactive multiview video to a set of wireless users is studied in an heterogeneous cellular network. Differently from existing works that focus on the optimization of the delivery delay and ignore the video characteristics, the caching and scheduling policies are jointly optimized, taking into account the quality of the delivered video and the video delivery time constraints. We formulate our joint caching and scheduling problem as the average expected video distortion minimization, and show that this problem is NPhard. We then provide an equivalent formulation based on submodular set function maximization and propose a greedy solution with 1 2 (1−e −1 ) approximation guarantee. The evaluation of the proposed joint caching and scheduling policy shows that it significantly outperforms benchmark algorithms based on popularity caching and independent scheduling. Another important contribution of this paper is a new constant approximation ratio for the greedy submodular set function maximization subject to a d-dimensional knapsack constraint.

show abstract

Optimal layered representation for adaptive interactive multiview video streaming

Cited by 13 publications

References 24 publications

Network Support for AR/VR and Immersive Video Application: A Survey

Network Support for AR/VR and Immersive Video Application: A Survey

Optimized Adaptive Streaming of Multi-video Stream Bundles

Cache-Aided Interactive Multiview Video Streaming in Small Cell Wireless Networks

Contact Info

Product

Resources

About