Frame rate up-conversion using the wavelet transform

Choi, Byung-Tae; Lee, Sung‐Hee; Park, Yung-Jun; Ko, Seung Hyeon

doi:10.1109/icce.2000.854566

Cited by 4 publications

(2 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The performance of the proposed algorithm has been evaluated by comparing it with those of WaME algorithm [16], EBME algorithm [7], Dual ME algorithm [8], and DS-ME algorithm [9] † , and various CIF@30Hz test sequences are used, including Foreman, Carphone, News, Pairs, Football, Stefan, Tennis, Mobile, Bus, City, and Flower. To evaluate the quality of the interpolated frames from subjective and objective views, the first 50 even frames of each test sequence are removed, and then they are reconstructed from the first 51 odd frames using MC-FRUC algorithms.…”

Section: Resultsmentioning

confidence: 99%

“…However, the conventional multiresolution search uses mean pyramid [14] or Gaussian pyramid [15], which raises a problem: the implementation of mean or Gaussian low-pass filtering before sub-sampling suppresses aliased distortion while causing the lack of highfrequency details in the sub-sampled image, which is more likely to result in the emergence of mismatch. Inspired by the wavelet transform based ME (WaME) algorithm [16], the wavelet coefficients in the high-frequency sub-band can help to enhance the accuracy of ME since they reveal the horizontal, vertical and diagonal edge details, and besides the fast wavelet transform can also produce the image pyramid while retaining high-frequency components of each level [17]. Therefore, combining the above advantages of wavelet transform, the proposed algorithm performs the fast wavelet transform to construct the wavelet pyramid and then uses the high-frequency components of each level to modify block matching criterion.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Wavelet Pyramid Based Multi-Resolution Bilateral Motion Estimation for Frame Rate Up-Conversion

Liu

Chen

et al. 2016

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

SUMMARYThe conventional bilateral motion estimation (BME) for motion-compensated frame rate up-conversion (MC-FRUC) can avoid the problem of overlapped areas and holes but usually results in lots of inaccurate motion vectors (MVs) since 1) the MV of an object between the previous and following frames is more likely to have no temporal symmetry with respect to the target block of the interpolated frame and 2) the repetitive patterns existing in video frame lead to the problem of mismatch due to the lack of the interpolated block. In this paper, a new BME algorithm with a low computational complexity is proposed to resolve the above problems. The proposed algorithm incorporates multi-resolution search into BME, since it can easily utilize the MV consistency between two adjacent pyramid levels and spatial neighboring MVs to correct the inaccurate MVs resulting from no temporal symmetry while guaranteeing low computational cost. Besides, the multi-resolution search uses the fast wavelet transform to construct the wavelet pyramid, which not only can guarantee low computational complexity but also can reserve the high-frequency components of image at each level while sub-sampling. The high-frequency components are used to regularize the traditional block matching criterion for reducing the probability of mismatch in BME. Experiments show that the proposed algorithm can significantly improve both the objective and subjective quality of the interpolated frame with low computational complexity, and provide the better performance than the existing BME algorithms.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Wavelet Pyramid Based Multi-Resolution Bilateral Motion Estimation for Frame Rate Up-Conversion

Liu

Chen

et al. 2016

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

show abstract

Bidirectional Mesh-Based Frame Rate Up-Conversion

Min

Sim

et al. 2015

IEEE MultiMedia

View full text Add to dashboard Cite

In this paper, we propose a new frame rate upconversion (FRUC) method for temporal video quality enhancement. The proposed algorithm generates an interpolated frame in between two given frames based on a bi-directional mesh interpolation (BMI), in order to cope with not only translation, but also with scale and rotation changes. BMI performance is highly influenced by the accuracy of the correspondences between the control points in the two frames. To achieve an accurate dense motion vector map (MVM) through bi-directional and unidirectional motion estimation, an initial MVM is formed by the transmitted motion vectors from coded bitstream with low computational complexity. Then, the interpolated frame is generated by frame-based BMI with the dense MVM. In our experiments, we found out that the proposed algorithm is about 2dB better than several conventional FRUC methods. Furthermore, block artifacts and blur artifacts are significantly diminished by the proposed algorithm. Index Terms-Frame rate up-conversion, mesh interpolation, uni-directional motion estimation, bi-directional motion estimation I. INTRODUCTIONrame rate up-conversion (FRUC) refers to the postprocessing methods whose goal is to improve video quality by increasing the frame rate. A number of FRUC algorithms have been developed [1]- [15], and they can be classified into two main categories. One category contains methods that generate interpolated frames without explicitly considering motion. These algorithms analyze mathematical relations regarding pixel intensity changes among neighboring frames. The second category includes motion-based techniques. Most of these methods generate interpolated frames with the help of block-based motion estimation and compensation [2]- [15]. These approaches are able to improve video quality with natural continuity of motion. However, the block-based translational motion model can lead to blocking artifacts.Mesh-based techniques [17], [18] are another alternative in an attempt to represent more realistic motion. Like most other interpolation methods, the mesh-based interpolation is sensitive to occlusions. In order to deal with these occlusions, the proposed method interpolates the target frame through bi-

show abstract