Anchor View Allocation for Collaborative Free Viewpoint Video Streaming

Ren, Dongni; Chan, S.-H. Gary; Cheung, Gene; Zhao, Hong; Frossard, Pascal

doi:10.1109/tmm.2015.2389714

Cited by 11 publications

(11 citation statements)

References 50 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Similar to scalable video streaming, lower layers are assigned higher important levels. In [35], Ren et al investigate the problem of sharing the peers' reference views for the virtual view synthesis in live free viewpoint video streaming scenarios. They propose an algorithm to help peers choose their reference views and neighbouring peers based on minimizing the total streaming costs (e.g.…”

Section: Multiview Video Streamingmentioning

confidence: 99%

MVP2P: Layer-dependency-aware live MVC video streaming over peer-to-peer networks

Liu

Murray

Lee

et al. 2018

Signal Processing: Image Communication

View full text Add to dashboard Cite

Multiview video supports observing a scene from different viewpoints. The Joint Video Team (JVT) developed H.264/MVC to enhance the compression efficiency for multiview video, however, MVC encoded multiview video (MVC video) still requires high bitrates for transmission. This paper investigates live MVC video streaming over Peer-to-Peer (P2P) networks. The goal is to minimize the server bandwidth costs whist ensuring high streaming quality to peers. MVC employs intra-view and inter-view prediction structures, which leads to a complicated layer dependency relationship. As the peers' outbound bandwidth is shared while supplying all the MVC video layers, the bandwidth allocation to one MVC layer affects the available outbound bandwidth of the other layers. To optimise the utilisation of the peers' outbound bandwidth for providing video layers, a maximum flow based model is proposed which considers the MVC video layer dependency and the layer supplying relationship between peers. Based on the model, a layer dependency aware live MVC video streaming method over a BitTorrent-like P2P network is proposed, named MVP2P. The key components of MVP2P include a chunk scheduling strategy and a peer selection strategy for receiving peers, and a bandwidth scheduling algorithm for supplying peers. To evaluate the efficiency of the proposed solution, MVP2P is compared with existing methods considering the constraints of peer bandwidth, peer numbers, view switching rates, and peer churns. The test results show that MVP2P significantly outperforms the existing methods.

show abstract

Section: Multiview Video Streamingmentioning

confidence: 99%

MVP2P: Layer-dependency-aware live MVC video streaming over peer-to-peer networks

Liu

Murray

Lee

et al. 2018

Signal Processing: Image Communication

View full text Add to dashboard Cite

show abstract

“…Using an array of cameras to capture a 3D scene synchronously from slightly shifted viewpoints, IMVS systems [4][5][6][7][8] study how the captured multi-view videos can be pre-encoded into multiple streams. A receiving user can periodically request switches to neighboring camera views, and the server in response switches video streams with minimum discruption to the user's viewing experience.…”

Section: Related Workmentioning

confidence: 99%

“…To facilitate stream-switching, new frames like DSC frame [9] and merge frame (M-frame) [10] were proposed. Unlike IMVS [4][5][6][7][8], we optimize the division of 360 VR video into multiple streams covering different view ranges given a constant RTT. To the best of our knowledge, we are the first to study this problem for interactive VR video streaming formally.…”

Section: Related Workmentioning

confidence: 99%

Multi-stream switching for interactive virtual reality video streaming

Cheung

Liu

Ma³

et al. 2017

2017 IEEE International Conference on Image Processing (ICIP)

Self Cite

View full text Add to dashboard Cite

Virtual reality (VR) video provides an immersive 360 viewing experience to a user wearing a headmounted display: as the user rotates his head, correspondingly different fields-of-view (FoV) of the 360 video are rendered for observation. Transmitting the entire 360 video in high quality over bandwidth-constrained networks from server to client for real-time playback is challenging. In this paper we propose a multi-stream switching framework for VR video streaming: the server pre-encodes a set of VR video streams covering different view ranges that account for server-client round trip time (RTT) delay, and during streaming the server transmits and switches streams according to a user's detected head rotation angle. For a given RTT, we formulate an optimization to seek multiple VR streams of different view ranges and the head-angle-to-stream mapping function simultaneously, in order to minimize the expected distortion subject to bandwidth and storage constraints. We propose an alternating algorithm that, at each iteration, computes the optimal streams while keeping the mapping function fixed and vice versa. Experiments show that for the same bandwidth, our multi-stream switching scheme outperforms a non-switching single-stream approach by up to 2.9dB in PSNR.

show abstract

“…In particular, we assume that the distortion Du() has the property of monotonicity in reference view distance, as done in [12]:…”

Section: Synthesized View Distortionmentioning

confidence: 99%

In-network view re-sampling for interactive free viewpoint video streaming

Toni

Cheung

Frossard

2015

2015 IEEE International Conference on Image Processing (ICIP)

Self Cite

View full text Add to dashboard Cite

Interactive free viewpoint video offers the possibility for each user to independently choose the views of a 3D scene to be displayed at the decoder. The visual content is commonly represented by N texture and depth map pairs that capture different viewpoints. A server selects an appropriate subset of M ≤ N views for transmission, so that the user can freely navigate in the corresponding window of viewpoints without being affected by network delay. During navigation, a user can synthesize any intermediate virtual view image in the navigation window via depth-image-based rendering (DIBR) using two nearby camera views as references. When the available bandwidth is too small to transmit all camera views typically used to synthesize views in the navigation window, we propose to synthesize intermediate virtual views as new references for transmission-a resampling of viewpoints for the 3D scene-so that the synthesized view distortion within the navigation window is minimized. We formulate a combinatorial optimization problem to find the best set of M virtual views to synthesize as new references, and show that the problem is NP-hard. We approximate the original problem with a new reference view equivalence model and derive in this case an optimal dynamic programming algorithm to determine the best set of M views to be transmitted to each user. Experimental results show that synthesizing virtual views as new references for client-side view synthesis can outperform simple selection from camera views by up to 0.73dB in synthesized view quality.

show abstract

Anchor View Allocation for Collaborative Free Viewpoint Video Streaming

Cited by 11 publications

References 50 publications

MVP2P: Layer-dependency-aware live MVC video streaming over peer-to-peer networks

MVP2P: Layer-dependency-aware live MVC video streaming over peer-to-peer networks

Multi-stream switching for interactive virtual reality video streaming

In-network view re-sampling for interactive free viewpoint video streaming

Contact Info

Product

Resources

About