Infrared Image Super-Resolution with Parallel Random Forest

Infrared imaging has the advantage of all-weather working ability. Due to the limitation of the hardware and the high cost, the resolution of infrared image (IR) is very low. To improve the resolution of IR images, this paper exploits super-resolution (SR) method for IR images. A new SR framework by using random forests is proposed in this paper. Existing methods adopts single regression model for SR. However, which single regression model tends to overfit training data, and would lead to a poor performance. Furthermore, the existing methods are not suitable for real-time system due to the heavy time consuming. To resolve this problem, an ensemble regression model, i.e. random forests rather than single regression model is adopted in this paper. In addition, to achieve better results multi-regression models rather than a single regression model are trained on the clustered training data. Moreover, the features used in many SR methods cannot extract features on diagonal orientation. To resolve this problem, we adopt a second order derivative filter, which can extract features on diagonal orientation. The experimental results demonstrate the availability of the proposed method.

[1]  Dirk Van den Poel,et al.  Predicting customer retention and profitability by using random forests and regression forests techniques , 2005, Expert Syst. Appl..

[2]  Salvatore Cuomo,et al.  IoT-based collaborative reputation system for associating visitors and artworks in a cultural scenario , 2017, Expert Syst. Appl..

[3]  Truong Q. Nguyen,et al.  Image Superresolution Using Support Vector Regression , 2007, IEEE Transactions on Image Processing.

[4]  Enhua Wu,et al.  Robust dense reconstruction by range merging based on confidence estimation , 2016, Science China Information Sciences.

[5]  Zheng Liu,et al.  Classification of defects with ensemble methods in the automated visual inspection of sewer pipes , 2015, Pattern Analysis and Applications.

[6]  Jian Shen,et al.  $$\varvec{\textit{KDVEM}}$$KDVEM: a $$k$$k-degree anonymity with vertex and edge modification algorithm , 2015, Computing.

[7]  J. D. van Ouwerkerk,et al.  Image super-resolution survey , 2006, Image Vis. Comput..

[8]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[10]  Shutao Li,et al.  Infrared surveillance image super resolution via group sparse representation , 2013 .

[11]  U. Grömping.  Dependence of Variable Importance in Random Forests on the Shape of the Regressor Space , 2009 .

[12]  Salvatore Cuomo,et al.  A Smart GPU Implementation of an Elliptic Kernel for an Ocean Global Circulation Model , 2013 .

[13]  Qing Tian,et al.  Cross-heterogeneous-database age estimation through correlation representation learning , 2017, Neurocomputing.

[14]  Di Guo,et al.  Magnetic resonance image reconstruction from undersampled measurements using a patch-based nonlocal operator , 2014, Medical Image Anal..

[15]  Gwanggil Jeon,et al.  Least-Squares Luma–Chroma Demultiplexing Algorithm for Bayer Demosaicking , 2011, IEEE Transactions on Image Processing.

[16]  Mark R. Segal,et al.  Machine Learning Benchmarks and Random Forest Regression , 2004 .

[17]  Yueting Zhuang,et al.  Steerable pyramid-based face hallucination , 2005, Pattern Recognit..

[18]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[19]  Fu-sheng Chen,et al.  Single infrared image super-resolution combining non-local means with kernel regression , 2013 .

[20]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[21]  Xiangjun Zhang,et al.  Image Interpolation by Adaptive 2-D Autoregressive Modeling and Soft-Decision Estimation , 2008, IEEE Transactions on Image Processing.

[22]  Shiguo Lian,et al.  Hybrid multiplicative multi-watermarking in DWT domain , 2017, Multidimens. Syst. Signal Process..

[23]  Gwanggil Jeon,et al.  Deinterlacing Using Taylor Series Expansion and Polynomial Regression , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Salvatore Cuomo,et al.  A Regularized MRI Image Reconstruction based on Hessian Penalty Term on CPU/GPU Systems , 2013, ICCS.

[25]  Xingming Sun,et al.  Segmentation-Based Image Copy-Move Forgery Detection Scheme , 2015, IEEE Transactions on Information Forensics and Security.

[26]  Di Guo,et al.  Fast Multiclass Dictionaries Learning With Geometrical Directions in MRI Reconstruction , 2015, IEEE Transactions on Biomedical Engineering.

[27]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[28]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[29]  A. Chianese,et al.  A "smart" multimedia guide for indoor contextual navigation in cultural heritage applications , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[30]  Chenglin Zheng,et al.  Single image super-resolution using self-similarity and generalized nonlocal mean , 2013, 2013 IEEE International Conference of IEEE Region 10 (TENCON 2013).

[31]  Di Guo,et al.  Projected Iterative Soft-Thresholding Algorithm for Tight Frames in Compressed Sensing Magnetic Resonance Imaging , 2015, IEEE Transactions on Medical Imaging.

[32]  Zheng Liu,et al.  Learning-based super resolution using kernel partial least squares , 2011, Image Vis. Comput..

[33]  Bin Gu,et al.  A Robust Regularization Path Algorithm for $\nu $ -Support Vector Classification , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[34]  Zheng Liu,et al.  Single-image super-resolution based on Markov random field and contourlet transform , 2011, J. Electronic Imaging.

[35]  Xingming Sun,et al.  Effective and Efficient Global Context Verification for Image Copy Detection , 2017, IEEE Transactions on Information Forensics and Security.

[36]  Wei Liang,et al.  Nonnegative correlation coding for image classification , 2015, Science China Information Sciences.

[37]  Raanan Fattal,et al.  Image and video upscaling from local self-examples , 2011, TOGS.

[38]  Angelo Chianese,et al.  SmaCH: A Framework for Smart Cultural Heritage Spaces , 2014, 2014 Tenth International Conference on Signal-Image Technology and Internet-Based Systems.

[39]  Yu-Chiang Frank Wang,et al.  A Self-Learning Approach to Single Image Super-Resolution , 2013, IEEE Transactions on Multimedia.