Jointly optimal selection and scheduling for lossy transmission of dependent frames with delay constraint

Abstract

Abstract-We present a jointly optimal selection and scheduling scheme for the lossy transmission of frames governed by a dependency relation and a delay constraint over a link with limited capacity. A main application for this is scalable video streaming. Our objective is to select a subset of frames and decide their transmission schedule such that the overall video quality at the receiver is maximized. The problem is solved for two of the most common classes of dependency structures for video encoding, which include as a special case the popular hierarchical dyadic structure. We formally characterize the structural properties of an optimal transmission schedule in terms of frame dependency. It is shown that regardless of the subset of frames selected for transmission, any optimal schedule has an equivalent canonical form that is a subsequence of a unique universal sequence containing all frames. The canonical form can be computed efficiently through the construction of a dependency tree. This leads to separable but jointly optimal frame selection and scheduling algorithms that have quadratic computational complexity in the number of frames. Simulation with video traces demonstrates that the optimal scheme can substantially outperform existing suboptimal alternatives.

Efficient lightweight video packet filtering for large-scale video data delivery

“…Mehdian and Liang [12] studied a scheduler to send a subset of frames to respect bandwidth constraint while maximizing the overall video quality. They characterize the properties of their optimal transmission scheduler in terms of frame dependency and they demonstrate that their exists a canonical form for the solution.…”

“…The video packet filtering solutions proposed so far consider either to pre-compute information on the video or to decode the video to extract deep coding information [1,9,12,15]. It is challenging to implement such techniques for the popular content providers, which manage a catalog of several millions videos and thousands of new video requests per second.…”

Enabling Adaptive High-Frame-Rate Video Streaming in Mobile Cloud Gaming Applications

“…However, the network transmission delay and bandwidth fluctuations are not addressed in this approach. The video frame selection and scheduling algorithms are proposed in [43] [44] but the time-varying channel status is not addressed in these solutions. In addition to the above studies, rate control has also been extensively investigated in [34][35][36] for delayconstrained video communication.…”

Scalable Security Solution Against Wiretapping for Network Coding Based Priority Encoding Transmission

“…The schemes with the layered encryption carried out at the network abstraction layer were seen as promising but not suitable for network coded PET [12,13] . Furthermore, the task of prioritized transmission with shared channel is still an open and nontrivial problem in wireless scenarios [14] . Therefore, the above schemes cannot well satisfy the security requirements for scalable video services in heterogeneous network coded PET system.…”