RD-optimized interactive streaming of multiview video with multiple encodings

Liu, Yanwei; Huang, Qingming; Ma, Siwei; Zhao, Debin; Gao, Wen

doi:10.1016/j.jvcir.2010.02.004

Cited by 18 publications

(32 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Recalling that , from (8) we have (10), shown at the bottom of the page, where and represent the value function of state under the best policy , characterized by the scheduling of only key frames and WZ/P frames, respectively. The decomposition allows to distinguish the best action taken at state as a key or a WZ or P frame .…”

Section: B Proof Of Optimalitymentioning

confidence: 99%

Optimized Packet Scheduling in Multiview Video Navigation Systems

Toni

Maugey

Frossard

2015

IEEE Trans. Multimedia

View full text Add to dashboard Cite

International audienceWe study coding and transmission strategies in multi-camera systems, where correlated sources send data through a bottleneck channel to a central server, which eventually transmits views to different interactive users. We propose a dynamic navigation-path aware packet scheduling optimization under delay, bandwidth, and interactivity constraints aimed at optimizing the quality-of-experience of interactive users. In particular, the scene distortion is minimized jointly with the distortion variations along most likely navigation paths. The optimization relies both on a novel rate-distortion model, which captures the importance of each view in the scene reconstruction, and on an objective function that optimizes resources based on a client navigation model. The latter takes into account the distortion experienced by interactive clients as well as the distortion variations that might be observed by clients during multiview navigation. We solve the scheduling problem with a novel trellis-based solution, which permits to formally decompose the multivariate optimization problem thereby significantly reducing the computation complexity. Simulation results show the PSNR quality gain offered by the proposed algorithm compared to baseline scheduling policies. Finally, we show that the best scheduling policy consistently adapts to the most likely user navigation path and that it minimizes distortion variations that can be very disturbing for users in traditional navigation systems

show abstract

Section: B Proof Of Optimalitymentioning

confidence: 99%

Optimized Packet Scheduling in Multiview Video Navigation Systems

Toni

Maugey

Frossard

2015

IEEE Trans. Multimedia

View full text Add to dashboard Cite

show abstract

“…The work in [2] is mainly focused on coding views with a minimum level of redundancy in order to simplify the view switching, and the works in [17], [20] optimize the selection of views to be encoded and transmitted based on the user interest. The authors in [18], [21] investigate the transmission of multiview video coded streams on P2P networks and IP multicast, respectively.…”

Section: Related Workmentioning

confidence: 99%

Correlation-Aware Packet Scheduling in Multi-Camera Networks

Toni

Maugey

Frossard

2014

IEEE Trans. Multimedia

View full text Add to dashboard Cite

In multiview applications, multiple cameras acquire the same scene from different viewpoints and generally produce correlated video streams. This results in large amounts of highly redundant data. In order to save resources, it is critical to handle properly this correlation during encoding and transmission of the multiview data. In this work, we propose a correlation-aware packet scheduling algorithm for multi-camera networks, where information from all cameras are transmitted over a bottleneck channel to clients that reconstruct the multiview images. The scheduling algorithm relies on a new rate-distortion model that captures the importance of each view in the scene reconstruction. We propose a problem formulation for the optimization of the packet scheduling policies, which adapt to variations in the scene content. Then, we design a low complexity scheduling algorithm based on a trellis search that selects the subset of candidate packets to be transmitted towards effective multiview reconstruction at clients. Extensive simulation results confirm the gain of our scheduling algorithm when inter-source correlation information is used in the scheduler, compared to scheduling policies with no information about the correlation or non-adaptive scheduling policies. We finally show that increasing the optimization horizon in the packet scheduling algorithm improves the transmission performance, especially in scenarios where the level of correlation rapidly varies with time.

show abstract

“…Here, we address real-time applications such as live broadcasting, videoconferencing or interactive streaming [8] where constraints on the end-to-end delay are imposed. The one-way delay between both ends of the conversation is known as communication latency, i.e., the delay between the instant when a frame is captured and the instant when it is displayed at the receiver.…”

Section: Introductionmentioning

confidence: 99%

Systematic analysis of the decoding delay in multiview video

Carballeira

Cabrera

Jaureguizar

et al. 2014

Journal of Visual Communication and Image Representation

View full text Add to dashboard Cite

We present a framework for the analysis of the decoding delay in multiview video coding (MVC). We show that in real-time applications, an accurate estimation of the decoding delay is essential to achieve a minimum communication latency. As opposed to single-view codecs, the complexity of the multiview prediction structure and the parallel decoding of several views requires a systematic analysis of this decoding delay, which we solve using graph theory and a model of the decoder hardware architecture. Our framework assumes a decoder implementation in general purpose multi-core processors with multi-threading capabilities. For this hardware model, we show that frame processing times depend on the computational load of the decoder and we provide an iterative algorithm to compute jointly frame processing times and decoding delay. Finally, we show that decoding delay analysis can be applied to design decoders with the objective of minimizing the communication latency of the MVC system.

show abstract

RD-optimized interactive streaming of multiview video with multiple encodings

Cited by 18 publications

References 26 publications

Optimized Packet Scheduling in Multiview Video Navigation Systems

Optimized Packet Scheduling in Multiview Video Navigation Systems

Correlation-Aware Packet Scheduling in Multi-Camera Networks

Systematic analysis of the decoding delay in multiview video

Contact Info

Product

Resources

About