Fusion-based edge-sensitive interpolation method for deinterlacing

This paper proposes a fusion-based edge-sensitive interpolation method (FEID) for intra-field deinterlacing. The proposed FEID is composed of three steps: (1) region classification by a gradient-based region selection approach, (2) pre-interpolation by a 6-tap fixed coefficient Wiener filter, (3) data fusion by the linear minimum mean square-error estimation (LMMSE) technique. Specifically, three directional neighboring pixel sets are defined in three directions (45°, 90°, and 135°) for every missing pixel. And each set produces an estimate of the pixel to be interpolated with a Wiener filter. With the information that gathered from the three directional neighboring pixel sets, a more robust estimate is obtained by fusing these directional estimates with the LMMSE technique. For fast implementation, we propose a gradient-based region selection approach that classifies a local region into two different classes, Region 1 and Region 2. The LMMSE-based data fusion method is used in Region 1; a fast deinterlacing algorithm is used in Region 2 to reduce the computational complexity. Compared with existing deinterlacing methods, the proposed method FEID improves the visual quality of the interpolated edges while maintaining a higher peak signal-to-noise–ratio (PSNR) level.

[1]  H. Vincent Poor,et al.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.

[2]  Gwanggil Jeon,et al.  Computation-aware algorithm selection approach for interlaced-to-progressive conversion , 2010 .

[3]  H. Vincent Poor,et al.  An introduction to signal detection and estimation (2nd ed.) , 1994 .

[4]  François Michaud,et al.  Fuzzy detection of edge-direction for video line doubling , 1997, IEEE Trans. Circuits Syst. Video Technol..

[5]  Gwanggil Jeon,et al.  Deinterlacing Using Taylor Series Expansion and Polynomial Regression , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Demin Wang,et al.  Hybrid de-interlacing algorithm based on motion vector reliability , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Gwanggil Jeon,et al.  Filter switching interpolation method for deinterlacing , 2012 .

[8]  Hong Ren Wu,et al.  Efficient deinterlacing algorithm using edge-based line average interpolation , 2000 .

[9]  Moon Gi Kang,et al.  New edge dependent deinterlacing algorithm based on horizontal edge pattern , 2003, IEEE Trans. Consumer Electron..

[10]  Erwin B. Bellers,et al.  Deinterlacing-an overview , 1998, Proc. IEEE.

[11]  Chulhee Lee,et al.  Motion Adaptive Deinterlacing With Modular Neural Networks , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Gwanggil Jeon,et al.  Efficient adaptive deinterlacing algorithm with awareness of closeness and similarity , 2012 .

[13]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.

[14]  Maria Trocan,et al.  An adaptive motion-compensated approach for video deinterlacing , 2011, Multimedia Tools and Applications.

[15]  E. Kamen,et al.  Introduction to Optimal Estimation , 1999 .

[16]  Erwin B. Bellers,et al.  De-Interlacing: A Key Technology for Scan Rate Conversion , 2000 .

[17]  Jechang Jeong,et al.  Deinterlacing algorithm using direction-oriented inverse-free Wiener filtering , 2011 .

[18]  S.E. El-Khamy,et al.  Optimization of image interpolation as an inverse problem using the LMMSE algorithm , 2004, Proceedings of the 12th IEEE Mediterranean Electrotechnical Conference (IEEE Cat. No.04CH37521).

[19]  Hen-Wai Tsao,et al.  Motion Compensated Deinterlacing With Efficient Artifact Detection for Digital Television Displays , 2008, Journal of Display Technology.

[20]  Said Esmail El-Khamy,et al.  Efficient implementation of image interpolation as an inverse problem , 2005, Digit. Signal Process..

[21]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[22]  Hoon Yoo,et al.  Direction-oriented interpolation and its application to de-interlacing , 2002, IEEE Trans. Consumer Electron..

[23]  Michael T. Orchard,et al.  Wavelet domain image interpolation via statistical estimation , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[24]  J. Habermas.  The Past As Future , 1994 .

[25]  Jechang Jeong,et al.  Local surface model–based deinterlacing algorithm , 2011 .

[26]  Gerard de Haan.  Television Display Processing: Past & Future , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[27]  Pei-Yin Chen,et al.  A Low-Complexity Interpolation Method for Deinterlacing , 2007, IEICE Trans. Inf. Syst..

[28]  Jechang Jeong,et al.  Novel Intra Deinterlacing Algorithm Using Content Adaptive Interpolation , 2007, IEEE Transactions on Consumer Electronics.