Virtual view adaptation for 3D multiview video streaming

Abstract

Virtual views in 3D-TV and multi-view video systems are reconstructed images of the scene generated synthetically from the original views. In this paper, we analyze the performance of streaming virtual views over IP-networks with a limited and time-varying available bandwidth. We show that the average video quality perceived by the user can be improved with an adaptive streaming strategy aiming at maximizing the average video quality. Our adaptive 3D multi-view streaming can provide a quality improvement of 2 dB on the average -over non-adaptive streaming. We demonstrate that an optimized virtual view adaptation algorithm needs to be view-dependent and achieve an improvement of up to 0.7 dB. We analyze our adaptation strategies under dynamic available bandwidth in the network.

Multicasting of multiview 3D videos over wireless networks

“…The works most related to ours are [11] and [12]. In [11], Petrovic et al perform virtual view adaptation for selective streaming of 3D multiview video.…”

“…In [11], Petrovic et al perform virtual view adaptation for selective streaming of 3D multiview video. However, the proposed adaptation scheme requires empirically constructing the rate-distortion function for the 3D multiview video.…”

A DASH-based 3D multi-view video rate control system

“…However, this method is similar to free viewpoint video that needs a feedback of the head tracking information in order to render the requested views. Another adaptation for 3D multi-view video streaming can be found in [11].…”