Fast Image Interpolation via Random Forests

This paper proposes a two-stage framework for fast image interpolation via random forests (FIRF). The proposed FIRF method gives high accuracy, as well as requires low computation. The underlying idea of this proposed work is to apply random forests to classify the natural image patch space into numerous subspaces and learn a linear regression model for each subspace to map the low-resolution image patch to high-resolution image patch. The FIRF framework consists of two stages. Stage 1 of the framework removes most of the ringing and aliasing artifacts in the initial bicubic interpolated image, while Stage 2 further refines the Stage 1 interpolated image. By varying the number of decision trees in the random forests and the number of stages applied, the proposed FIRF method can realize computationally scalable image interpolation. Extensive experimental results show that the proposed FIRF(3, 2) method achieves more than 0.3 dB improvement in peak signal-to-noise ratio over the state-of-the-art nonlocal autoregressive modeling (NARM) method. Moreover, the proposed FIRF(1, 1) obtains similar or better results as NARM while only takes its 0.3% computational time.

[1]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[2]  William T. Freeman,et al.  Learning low-level vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.

[4]  Nong Sang,et al.  Fast image super resolution via local regression , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[5]  Lei Zhang,et al.  Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling , 2013, IEEE Transactions on Image Processing.

[6]  Xiaoguang Li,et al.  An efficient example-based approach for image super-resolution , 2008, 2008 International Conference on Neural Networks and Signal Processing.

[7]  Chih-Yuan Yang,et al.  Fast Direct Super-Resolution by Simple Functions , 2013, 2013 IEEE International Conference on Computer Vision.

[8]  M. Tech,et al.  Real Time Artifact-Free Image Upscaling , 2012 .

[9]  C. Lawrence Zitnick,et al.  Structured Forests for Fast Edge Detection , 2013, 2013 IEEE International Conference on Computer Vision.

[10]  Rabab Kreidieh Ward,et al.  A New Orientation-Adaptive Interpolation Method , 2007, IEEE Transactions on Image Processing.

[11]  Wan-Chi Siu,et al.  Further improved Edge-Directed Interpolation and fast EDI for SDTV to HDTV conversion , 2010, 2010 18th European Signal Processing Conference.

[12]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[13]  Thierry Blu,et al.  Linear interpolation revitalized , 2004, IEEE Transactions on Image Processing.

[14]  Xiangjun Zhang,et al.  Image Interpolation by Adaptive 2-D Autoregressive Modeling and Soft-Decision Estimation , 2008, IEEE Transactions on Image Processing.

[15]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[16]  Dimitris Anastassiou,et al.  Subpixel edge localization and the interpolation of still images , 1995, IEEE Trans. Image Process..

[17]  Michael Unser,et al.  Adaptive Image Resizing Based on Continuous-Domain Stochastic Modeling , 2014, IEEE Transactions on Image Processing.

[18]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[19]  Antonio Criminisi,et al.  Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning , 2012, Found. Trends Comput. Graph. Vis..

[20]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .

[21]  Hongjian Shi,et al.  Canny edge based image expansion , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[22]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[23]  Wen Gao,et al.  Image interpolation via regularized local linear regression , 2011, 28th Picture Coding Symposium.

[24]  Luc Van Gool,et al.  Real-time facial feature detection using conditional regression forests , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Roberto Cipolla,et al.  Semantic texton forests for image categorization and segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Hsieh Hou,et al.  Cubic splines for image interpolation and digital filtering , 1978 .

[27]  Raanan Fattal,et al.  Image and video upscaling from local self-examples , 2011, TOGS.

[28]  W. Siu,et al.  Fast image interpolation using the bilateral filter , 2012 .

[29]  Truong Q. Nguyen,et al.  Image Superresolution Using Support Vector Regression , 2007, IEEE Transactions on Image Processing.

[30]  D. Darian Muresan,et al.  Fast edge directed polynomial interpolation , 2005, IEEE International Conference on Image Processing 2005.

[31]  Andrew Zisserman,et al.  Image Classification using Random Forests and Ferns , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[32]  Wan-Chi Siu,et al.  Robust Soft-Decision Interpolation Using Weighted Least Squares , 2012, IEEE Transactions on Image Processing.

[33]  Wan-Chi Siu,et al.  A Modified Edge Directed Interpolation for images , 2009, 2009 17th European Signal Processing Conference.

[34]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[35]  Truong Q. Nguyen,et al.  An Adaptable $k$ -Nearest Neighbors Algorithm for MMSE Image Interpolation , 2009, IEEE Transactions on Image Processing.

[36]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[37]  Wan-Chi Siu,et al.  Adaptive Directional Window Selection for Edge-Directed Interpolation , 2010, 2010 Proceedings of 19th International Conference on Computer Communications and Networks.

[38]  Luc Van Gool,et al.  Hough Forests for Object Detection, Tracking, and Action Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Kwang In Kim,et al.  Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[41]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[42]  T. Lehmann,et al.  Addendum: B-spline interpolation in medical image processing , 2001, IEEE Transactions on Medical Imaging.

[43]  Vincent Lepetit,et al.  Keypoint recognition using randomized trees , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Michael Elad,et al.  Single Image Interpolation Via Adaptive Nonlocal Sparsity-Based Modeling , 2014, IEEE Transactions on Image Processing.