OmniViewer: Multi-modal Monoscopic 3D DASH

Gao, Zhenhuan; Chen, Shannon; Nahrstedt, Klara

doi:10.1109/ism.2015.80

Cited by 4 publications

(5 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…With the idea of transmitting depth information to aid the generation of virtual views, few related works in the literature have focused on HAS systems for MV streaming [8], [26]- [30]. In [26], the authors introduced a DASH-based multimodal 3D video streaming system referred to as OmniViewer, which allows the client to view the 3D video from arbitrary sides. However, they focus on the system architecture overview and do not propose any optimization for rate adaptation.…”

Section: Related Workmentioning

confidence: 99%

Adaptive Streaming in Interactive Multiview Video Systems

Zhang

Toni

Frossard

et al. 2019

IEEE Trans. Circuits Syst. Video Technol.

View full text Add to dashboard Cite

Multiview applications endow final users with the possibility to freely navigate within 3D scenes with minimumdelay. A real feeling of scene navigation is enabled by transmitting multiple high-quality camera views, which can be used to synthesize additional virtual views to offer a smooth navigation. However, when network resources are limited, not all camera views can be sent at high quality. It is therefore important, yet challenging, to find the right tradeoff between coding artifacts (reducing the quality of camera views) and virtual synthesis artifacts (reducing the number of camera views sent to users). To this aim, we propose an optimal transmission strategy for interactive multiview HTTP adaptive streaming (HAS). We propose a problem formulation to select the optimal set of camera views that the client requests for downloading, such that the navigation quality experienced by the user is optimized while the bandwidth constraints are satisfied. We show that our optimization problem is NP-hard, and we therefore develop an optimal solution based on the dynamic programming algorithm with polynomial time complexity. To further simplify the deployment, we present a suboptimal greedy algorithm with effective performance and lower complexity. The proposed controller is evaluated in theoretical and realistic settings characterized by realistic network statistics estimation, buffer management and server-side representation optimization. Simulation results show significant improvement in terms of navigation quality compared with alternative baseline multiview adaptation logic solutions.

show abstract

Section: Related Workmentioning

confidence: 99%

Adaptive Streaming in Interactive Multiview Video Systems

Zhang

Toni

Frossard

et al. 2019

IEEE Trans. Circuits Syst. Video Technol.

View full text Add to dashboard Cite

show abstract

“…Optimal streaming strategies or reousrce allocation have been proposed in the case of resource-constrained networks [24]- [26], but not from a HAS systems perspecitve. A DASH-based stereo 3D video systems is introduced in [6], while a DASH-based multi-modal 3D video streaming system is proposed in [7]. Within the framework of free viewpoint systems, the works in [9], [10] design an architecture of DASH-based 3D multi-view video streaming services using the HEVC 3D extension encoder to prepare the representations at the DASH server.…”

Section: Related Workmentioning

confidence: 99%

“…Without loss of generality, we assume the mean focus of attention to be the centre of the camera views for all videos, i.e., µ c = (v V − v 1 )/2, while we assign different variance values to different video sequences. 7 Namely, σ 2 c = {80, 250, 3000} for "Undo Dancer", "Shark", and "Hall", respectively. For the "Undo Dancer" sequence, which represents a sport movie, most of the users will follow the main subject of interest (the dancer) and most of the navigation windows will overlap.…”

Section: A Simulation Settings 1) Satisfaction Functionmentioning

confidence: 99%

“…Fig. 4 depicts the achieved quality in view synthesis for both the experimental results and the theoretical model in (7).…”

Section: Appendix a Video Content Characteristicsmentioning

confidence: 99%

“…12, we provide the quality as a function of the encoding bitrate for the considered video sequences, for both the experimental VQM and the quality derived from (8) for a representative camera view. By curve fitting, we then evaluate the parameters γ and D I in (7). We set the inpainting distortion to D I = 0.35, and we get ξ = {0.35, 0.52, 1.32} for "Undo Dancer", "Shark", and "Hall", respectively.…”

Section: Appendix a Video Content Characteristicsmentioning

confidence: 99%

See 2 more Smart Citations

Optimal Representations for Adaptive Streaming in Interactive Multiview Video Systems

Toni

Frossard

2017

IEEE Trans. Multimedia

View full text Add to dashboard Cite

Interactive multi-view video streaming (IMVS) services permit to remotely immerse within a 3D scene. This is possible by transmitting a set of reference camera views (anchor views), which are used by the clients to freely navigate in the scene and possibly synthesize additional viewpoints of interest. From a networking perspective, the big challenge in IMVS systems is to deliver to each client the best set of anchor views that maximizes the navigation quality, minimizes the view-switching delay and yet satisfies the network constraints. Integrating adaptive streaming solutions in free-viewpoint systems offers a promising solution to deploy IMVS in large and heterogeneous scenarios, as long as the multi-view video representations on the server are properly selected. We therefore propose to optimize the multi-view data at the server by minimizing the overall resource requirements, yet offering a good navigation quality to the different users. We propose a video representation set optimization for multiview adaptive streaming systems and we show that it is NP-hard. We therefore introduce the concept of multi-view navigation segment that permits to cast the video representation set selection as an integer linear programming problem with a bounded computational complexity. We then show that the proposed solution reduces the computational complexity while preserving optimality in most of the 3D scenes. We then provide simulation results for different classes of users and show the gain offered by an optimal multi-view video representation selection compared to recommended representation sets (e.g., Netflix and Apple ones) or to a baseline representation selection algorithm where the encoding parameters are decided a priori for all the views.L. Toni and P. Frossard are with Ecole Polytechnique Fédérale de Lausanne (EPFL), Signal Processing Laboratory -LTS4,

show abstract