KPLS-based image super-resolution using clustering and weighted boosting

Kernel partial least squares (KPLS) algorithm for super-resolution (SR) has carried out a regression model to estimate a high-resolution (HR) feature patch from its corresponding low-resolution (LR) feature patch using a training database. However, KPLS may be time-consuming in the neighbor search and use of principal components. In this paper we propose a clustering and weighted boosting (CWB) framework to improve the efficiency in KPLS regression model construction without reducing SR reconstruction quality. First, the training LR-HR feature patch pairs are divided into a certain number of clusters. For each test LR feature patch, the neighbor search in the selected cluster saves more computational costs than that in the whole training database. Second, a weighted boosting scheme is used to adaptively construct the KPLS regression model with the best number of principal components (BNPC). Experimental results on natural scene images suggest that the proposed CWB method can effectively improve the efficiency of KPLS-based SR method while preserving reconstruction quality, and achieve better performance than the conventional KPLS method.

[1]  Xuelong Li,et al.  Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression , 2012, IEEE Transactions on Image Processing.

[2]  Michal Irani,et al.  Nonparametric Blind Super-resolution , 2013, 2013 IEEE International Conference on Computer Vision.

[3]  Moon Gi Kang,et al.  Super-resolution image reconstruction , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[4]  Xuelong Li,et al.  Hessian Regularized Support Vector Machines for Mobile Image Annotation on the Cloud , 2013, IEEE Transactions on Multimedia.

[5]  Chun Chen,et al.  Video-based non-uniform object motion blur estimation and deblurring , 2012, Neurocomputing.

[6]  Xiao Liu,et al.  LF-EME: Local features with elastic manifold embedding for human action recognition , 2013, Neurocomputing.

[7]  Roman Rosipal,et al.  Overview and Recent Advances in Partial Least Squares , 2005, SLSFS.

[8]  Narasimhan Sundararajan,et al.  Risk-sensitive loss functions for sparse multi-category classification problems , 2008, Inf. Sci..

[9]  Xuelong Li,et al.  Universal Blind Image Quality Assessment Metrics Via Natural Scene Statistics and Multiple Kernel Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Zheng Liu,et al.  Learning-based super resolution using kernel partial least squares , 2011, Image Vis. Comput..

[11]  Roman Rosipal,et al.  Kernel Partial Least Squares Regression in Reproducing Kernel Hilbert Space , 2002, J. Mach. Learn. Res..

[12]  Xuelong Li,et al.  Image Quality Assessment Based on Multiscale Geometric Analysis , 2009, IEEE Transactions on Image Processing.

[13]  Xuelong Li,et al.  A multi-frame image super-resolution method , 2010, Signal Process..

[14]  Xuelong Li,et al.  Partially Supervised Neighbor Embedding for Example-Based Image Super-Resolution , 2011, IEEE Journal of Selected Topics in Signal Processing.

[15]  Stephen Lin,et al.  Super resolution using edge prior and single image detail synthesis , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Shuyuan Yang,et al.  Multitask dictionary learning and sparse representation based single-image super-resolution reconstruction , 2011, Neurocomputing.

[17]  Changsheng Xu,et al.  Boosting part-sense multi-feature learners toward effective object detection , 2011, Comput. Vis. Image Underst..

[18]  Xuelong Li,et al.  Single Image Super-Resolution With Multiscale Similarity Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Xuelong Li,et al.  Image Super-Resolution With Sparse Neighbor Embedding , 2012, IEEE Transactions on Image Processing.

[20]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[21]  Xinbo Gao,et al.  Video super-resolution with 3D adaptive normalized convolution , 2012, Neurocomputing.

[22]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[23]  Chih-Yuan Yang,et al.  Fast Direct Super-Resolution by Simple Functions , 2013, 2013 IEEE International Conference on Computer Vision.

[24]  Xuelong Li,et al.  Rank Preserving Discriminant Analysis for Human Behavior Recognition on Wireless Sensor Networks , 2014, IEEE Transactions on Industrial Informatics.

[25]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[26]  Xuelong Li,et al.  Rank Preserving Sparse Learning for Kinect Based Scene Classification , 2013, IEEE Transactions on Cybernetics.

[27]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[28]  Xuelong Li,et al.  Reduced-Reference IQA in Contourlet Domain , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Shutao Li,et al.  Multi-morphology image super-resolution via sparse representation , 2013, Neurocomputing.

[30]  Xuelong Li,et al.  Sparse representation for blind image quality assessment , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Xuelong Li,et al.  Multi-scale dictionary for single image super-resolution , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Xuelong Li,et al.  Joint Learning for Single-Image Super-Resolution via a Coupled Constraint , 2012, IEEE Transactions on Image Processing.

[33]  Xuelong Li,et al.  Person Re-Identification by Regularized Smoothing KISS Metric Learning , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Shenghuo Zhu,et al.  Resolution-invariant coding for continuous image super-resolution , 2012, Neurocomputing.

[35]  Truong Q. Nguyen,et al.  Image Superresolution Using Support Vector Regression , 2007, IEEE Transactions on Image Processing.

[36]  Chun Chen,et al.  Image-based facial sketch-to-photo synthesis via online coupled dictionary learning , 2012, Inf. Sci..

[37]  Xiaogang Wang,et al.  Hallucinating face by eigentransformation , 2005, IEEE Trans. Syst. Man Cybern. Part C.

[38]  Xiangjun Zhang,et al.  Image Interpolation by Adaptive 2-D Autoregressive Modeling and Soft-Decision Estimation , 2008, IEEE Transactions on Image Processing.