Abstract:Recently, many researches on frame skipping are conducted to reduce temporal redundancy in video frames. As a simple method, fixed frame skipping (FFS) adjusts frame rate by skipping frame at regular intervals. To overcome the poor performance of FFS, variable frame skipping (VFS) has been introduced to exploit the temporal dependency between frames. In this paper, scene-adaptive key frame selection method with low complexity is proposed. The proposed method performed about 20 percent better in complexity with… Show more
“…1, it is apparent that frame skipping by itself can introduce a substantial compression depending on the number of skipped frames. The impact by frame skipping on video compression was reported in our previous research [7].…”
Section: Unified Framework Of Frame Skipping and Interpolationmentioning
In this paper, we propose the unified framework of frame skipping and interpolation (UF-FSI) for efficient video compression. Frame skipping and interpolation is one of the efficient approaches to reduce the redundancy of video frames. A joint design of frame skipping and interpolation is made for maximization of compression efficiency, which was not considered from previous research. A good advantage of UF-FSI is that it can be applied to any conventional video codec. Frame skipping in the proposed method is done by selecting key frames through analysis of neighboring frames. In frame interpolation, in-between frames are reconstructed by key frames using motion compensated interpolation. Using with MPEG-4 simple profile, UF-FSI offered additional coding efficiency up to 25 percent with good visual quality.
“…1, it is apparent that frame skipping by itself can introduce a substantial compression depending on the number of skipped frames. The impact by frame skipping on video compression was reported in our previous research [7].…”
Section: Unified Framework Of Frame Skipping and Interpolationmentioning
In this paper, we propose the unified framework of frame skipping and interpolation (UF-FSI) for efficient video compression. Frame skipping and interpolation is one of the efficient approaches to reduce the redundancy of video frames. A joint design of frame skipping and interpolation is made for maximization of compression efficiency, which was not considered from previous research. A good advantage of UF-FSI is that it can be applied to any conventional video codec. Frame skipping in the proposed method is done by selecting key frames through analysis of neighboring frames. In frame interpolation, in-between frames are reconstructed by key frames using motion compensated interpolation. Using with MPEG-4 simple profile, UF-FSI offered additional coding efficiency up to 25 percent with good visual quality.
“…Processing all video frames is not practical, so, a common approach is to select a key-frame, which is going to represent the whole shot from there and on. The literature contains a number of key-frame selection techniques [32,15,13,6], but the problem remains open. Traditionally, the first or the middle frame of the shot is selected as the key-frame.…”
Nowadays, there a increasing interest in video scene segmentation due huge amount of videos available through services like YouTube. Although there are some techniques which obtain relatively good precision and recall values when segmenting the video in scenes, they are somewhat limited because the high computational cost.A well know technique to accomplish video scene segmentation is the shot coherence model, which presents lower precision and recall than state of art methods, like machine learning and multimodality, but stands out for being simple. The improvement of the techniques based on shot coherence models could be beneficial to these state of the art segmentation methods.That way, this paper presents a new technique for scene segmentation using shot coherence and optical flow features. The technique is presented and evaluated through a series of precision, recall and F1 values, obtaining results close or even better of those obtained by related works.
“…In [21,22], the decision for the frame skip is based on buffer fullness and the spatial and temporal quality of the video. In [23], the similarity between successive frames measured by the PSNR is used to skip frames adaptively. To optimize coding performance, frames to be skipped are determined based on an R-D model [24,25], but these works cannot be used in real-time applications.…”
Section: Previous Study On Spatial and Temporal Resolution Controlsmentioning
Conventional bitrate control algorithms that change only the quantization parameter (QP) often suffer from quality degradation when the target bitrate is very low. Therefore, rate control algorithms that adjust spatial resolution in addition to QP control have recently been proposed, but their computations are too complex to be processed in real time. This research proposes a very simple, but effective, rate control algorithm that employs spatial resolution control as well as the existing QP-based bitrate control. The spatial resolution ratio for the best peak signal-to-noise ratio (PSNR) is calculated using a simple estimation model which defines the relationship between the PSNR and the spatial resolution at very low bitrate compression. In the proposed bitrate control algorithm, two scalability tools for adjusting the QP and the spatial resolution ratio are used sequentially to reach the target PSNR and the control decision is made for a group of pictures. Experimental results show that the proposed bitrate control algorithm approximates an optimal solution and yields a better subjective quality as well as objective quality at various bitrates compared to the conventional QP-based bitrate control algorithm. The decision of the control parameters requires very small computational complexity and is made in a completely automatic manner so that the proposed algorithm is well suited for real-time applications.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.