Blocking Artifacts Detection in Frequency Domain for Frame Rate Up-conversion

In this paper, a blocking-artifact detection method is proposed for motion-compensated frame-rate up-conversion (MC-FRUC) algorithms. In the MC-FRUC process, most of the notable blocking artifacts occur in unreliable motion-compensated regions. To find the unreliable motion-compensated regions, an occlusion detection (OD) method for which the neighboring motion vectors are used is applied. If an occlusion occurs, then the use of median filtering reduces any inappropriate motion-compensated errors; otherwise, the normal motion compensated interpolation (MCI) is applied. In addition, to reduce the occurrence of the blocking artifacts in the MC-FRUC algorithms, a blocking-artifact-reduction method for which the blocking-artifact strength in the frequency domain is applied to the occluded regions is utilized. The experiment results show that the proposed method shows more-favorable peak signal-to-noise ratio (PSNR) values compared with those of the conventional FRUC algorithms regarding full-HD (1920 × 1080) and WQXGA (2560 × 1600) sequences.

[1]  Jin Wang,et al.  A novel spatial and temporal correlation integrated based motion-compensated interpolation for frame rate up-conversion , 2008, IEEE Transactions on Consumer Electronics.

[2]  Aggelos K. Katsaggelos,et al.  Efficient motion compensated frame rate upconversion using multiple interpolations and median filtering , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[3]  Kyoung-Rok Cho,et al.  Motion Compensated Frame Rate Up-Conversion Using Extended Bilateral Motion Estimation , 2007, IEEE Transactions on Consumer Electronics.

[4]  Truong Q. Nguyen,et al.  A Multistage Motion Vector Processing Method for Motion-Compensated Frame Interpolation , 2008, IEEE Transactions on Image Processing.

[5]  Yongmin Kim,et al.  Using motion-compensated frame-rate conversion for the correction of 3: 2 pulldown artifacts in video sequences , 2000, IEEE Trans. Circuits Syst. Video Technol..

[6]  Wen Gao,et al.  Multiple Hypotheses Bayesian Frame Rate Up-Conversion by Adaptive Fusion of Motion-Compensated Interpolations , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Victor H. S. Ha,et al.  Portable receivers for digital multimedia broadcasting , 2004, IEEE Transactions on Consumer Electronics.

[8]  Demin Wang,et al.  Motion-Compensated Frame Rate Up-Conversion—Part II: New Algorithms for Frame Interpolation , 2010, IEEE Transactions on Broadcasting.

[9]  G. Haan,et al.  Robust motion-compensated video upconversion , 1997 .

[10]  Chang-Su Kim,et al.  Motion-Compensated Frame Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion Compensation , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Jaeseok Kim,et al.  Motion compensated frame interpolation by new block-based motion estimation algorithm , 2004, IEEE Trans. Consumer Electron..

[12]  Sung-Jea Ko,et al.  New frame rate up-conversion using bi-directional motion estimation , 2000, IEEE Trans. Consumer Electron..

[13]  Yung-Lyul Lee,et al.  Frame Rate Up-Conversion Using Median Filter and Motion Estimation with Occlusion Detection , 2015, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[14]  Chul Lee,et al.  Motion-Compensated Frame Interpolation Based on Multihypothesis Motion Estimation and Texture Optimization , 2013, IEEE Transactions on Image Processing.

[15]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[16]  Burak Özkalayci,et al.  Occlusion handling frame rate up-conversion , 2011, 2011 7th International Symposium on Image and Signal Processing and Analysis (ISPA).

[17]  N. Ahmed,et al.  Discrete Cosine Transform , 1996 .

[18]  Stefano Tubaro,et al.  Motion compensated image interpolation , 1990, IEEE Trans. Commun..

[19]  Ke Huang,et al.  Wavelet Feature Selection for Image Classification , 2008, IEEE Transactions on Image Processing.