Enabling Adaptive High-Frame-Rate Video Streaming in Mobile Cloud Gaming Applications

Abstract

High frame rate (HFR) video is emerging in popular gaming applications to enhance the smooth experience perceived by end-users. However, it is challenging to guarantee the delivery quality of HFR video in mobile cloud gaming scenarios because of the high transmission rate and limited wireless resources. To address this critical problem, we develop a novel transmission scheduling framework dubbed AdaPtive HFR vIdeo Streaming (APHIS). The term "adaptive" indicates this scheme's capability in dynamically adjusting the video traffic load and FEC (Forward Error Correction) coding. First, we propose an online video frame selection algorithm to minimize the total distortion based on the network status, input video data and delay constraint. Second, we introduce an unequal FEC coding scheme to provide differentiated protection for Intra (I) and Predicted (P) frames with low-latency cost. The proposed APHIS framework is able to appropriately filter video frames and adjust data protection levels to optimize the quality of HFR video streaming. We conduct extensive emulations in Exata involving HFR video encoded with H.264 codec. Experimental results show that APHIS outperforms the reference transmission schemes in terms of video PSNR (Peak Signal-to-Noise Ratio), end-to-end delay, and goodput. Therefore, we recommend APHIS for delivering HFR video streaming in mobile cloud gaming systems.Index Terms-High frame rate video, mobile cloud gaming, video frame selection, unequal error protection, forward error correction.

Region-Based Prediction for Image Compression in the Cloud

“…Though we focused in this paper on image sets compression in the cloud, other applications with highly correlated image content such as photo albums compression [38], cloud gaming streaming [39], [40], and traditional video coding [41] could also benefits from the proposed prediction methods.…”

TCP-Oriented Raptor Coding for High-Frame-Rate Video Transmission Over Wireless Networks

“…High frame rate (HFR) video is emerging in popular multimedia applications (e.g., Youtube and cloud gaming [2]) to achieve smooth viewing experience [2][3][4][5]. The enhancement in perceptual quality resulting from the increased frame rate is acknowledged in both industrial and academic communities [2][3][4][5][6][7].…”

“…The enhancement in perceptual quality resulting from the increased frame rate is acknowledged in both industrial and academic communities [2][3][4][5][6][7]. With the growing powerfulness of media servers and hand-held devices, HFR video is expected to gain tremendous popularity in mobile multimedia applications to provide highquality video services [e.g., the OnLive cloud gaming system [5] provides streaming video up to 60 frames per second (fps)].…”

“…Despite the perceived advantages of TCP, it still remains problematic to use this transport protocol for delivering real-time HFR video streaming over wireless networks. The main reasons are four-fold [2] [8][9][10] [15][56]: 1) QoS (Quality of Service) requirements. Real-time HFR video (e.g., the cloud gaming video) is delay-sensitive and bandwidth-intensive [2] [56].…”

“…The main reasons are four-fold [2] [8][9][10] [15][56]: 1) QoS (Quality of Service) requirements. Real-time HFR video (e.g., the cloud gaming video) is delay-sensitive and bandwidth-intensive [2] [56]. In the resource-limited and time-varying wireless networks, it is highly possible the transmitted video frames experience deadline violations and induce quality degradations.…”