Temporal Video Quality Model Accounting for Variable Frame Delay Distortions

Abstract

We announce a new video quality model (VQM) that accounts for the perceptual impact of variable frame delays (VFD) in videos with demonstrated top performance on the laboratory for image and video engineering (LIVE) mobile video quality assessment (VQA) database. This model, called VQM_VFD, uses perceptual features extracted from spatialtemporal blocks spanning fixed angular extents and a long edge detection filter. VQM_VFD predicts video quality by measuring multiple frame delays using perception based parameters to track subjective quality over time. In the performance analysis of VQM_VFD, we evaluated its efficacy at predicting human opinions of visual quality. A detailed correlation analysis and statistical hypothesis testing show that VQM_VFD accurately predicts human subjective judgments and substantially outperforms top-performing image quality assessment and VQA models previously tested on the LIVE mobile VQA database. VQM_VFD achieved the best performance on the mobile and tablet studies of the LIVE mobile VQA database for simulated compression, wireless packet-loss, and rate adaptation, but not for temporal dynamics. These results validate the new model and warrant a hard release of the VQM_VFD algorithm. It is freely available for any purpose, commercial, or noncommercial at http://www.its.bldrdoc.gov/vqm/.

Applicability of Existing Objective Metrics of Perceptual Quality for Adaptive Video Streaming

“…For videos with extreme distortion the VQM output can be higher than 1. The improved version of VQM also accounts for Variable Frame Delays (VQM-VFD) [15], but unlike VQM it does not include color parameters and it belongs to the FR category of quality assessment. The VQM-VFD model is otherwise partly based on parameters similar to those of VQM, including si loss, hv loss, hv gain, and si gain, and partly based on new parameters.…”

“…The authors in [11] propose a full-reference video quality assessment for multi-bit rate video encoding in adaptive streaming applications. In this paper we investigate the following existing objective quality models for their out-of-scope applicability to adaptive video streaming: PSNR, SSIM [12], MS-SSIM [13], VQM [14], VQM-VFD [15], PEVQ [16], and V-BLIINDS [17]. Most of these methods are of the FR category.…”

Subjective Analysis and Objective Characterization of Adaptive Bitrate Videos

“…The Video Quality Model with Variable Frame Delays (VQM-VFD) presented in [20] is an improved version of the Video Quality Model (VQM) [21], but unlike VQM it does not include color parameters and it belongs to the FR category of quality assessment. The VQM-VFD model is otherwise partly based on parameters similar to those of VQM and partly based on new parameters.…”

Transmission Algorithm with QoS Considerations for a Sustainable MPEG Streaming Service

“…In this, depending on the streaming bandwidth, either TCP or UDP sessions are chosen for transmission through the heterogeneous network [47][48][49][50][51][52][53][54][55][56]. To prevent the loss of packets during the transfer, important data segments are selected using the Forward Error Correction (FEC) methodology [57][58][59][60][61][62][63][64][65] and these are retransmitted.…”