Investigation of multi-frame image super-resolution based on adaptive self-learning methods

ABSTRACT The goal of this paper is to introduce and demonstrate a new high-performance super-resolution (SR) method for multi-frame images. By combining learning-based and reconstruction-based SR methods, this paper proposes a multi-frame image super-resolution method based on adaptive self-learning. Using the adaptive self-learning method and recovery of high-frequency edge information, an initial high-resolution (HR) image containing effective texture information is obtained. The edge smoothness prior is then used to satisfy the global reconstruction constraint and enhance the quality of the HR image. Our results indicate that this method achieves better performance than several other methods for both simulated data and real-scene images.

[1]  Yunhong Wang,et al.  Locally linear embedding based example learning for pan-sharpening , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[2]  朱明 Zhu Ming,et al.  Super-resolution reconstruction of sub-pixel imaging achieved by three linear array detectors , 2014 .

[3]  Shao-Shuo Mu,et al.  Multiframe Superresolution Reconstruction Based on Self-Learning Method , 2015 .

[4]  Harry Shum,et al.  Gradient Profile Prior and Its Applications in Image Super-Resolution and Enhancement , 2011, IEEE Transactions on Image Processing.

[5]  Yang W.-B.,et al.  Super-resolution reconstruction of sub-pixel imaging achieved by three linear array detectors , 2014 .

[6]  Geng Wen-bao.  CCD geometric superresolution method based on subpixel , 2008 .

[7]  Truong Q. Nguyen,et al.  Novel Example-Based Method for Super-Resolution and Denoising of Medical Images , 2014, IEEE Transactions on Image Processing.

[8]  Russell Zaretzki,et al.  Beta Process Joint Dictionary Learning for Coupled Feature Spaces with Application to Single Image Super-Resolution , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Hong Chang,et al.  Super-resolution through neighbor embedding , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[10]  Xuelong Li,et al.  Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression , 2012, IEEE Transactions on Image Processing.

[11]  Jia Liu,et al.  High-resolution reconstruction for terahertz imaging. , 2014, Applied optics.

[12]  Xuelong Li,et al.  Partially Supervised Neighbor Embedding for Example-Based Image Super-Resolution , 2011, IEEE Journal of Selected Topics in Signal Processing.

[13]  George Loizou,et al.  Computer vision and pattern recognition , 2007, Int. J. Comput. Math..

[14]  Liangpei Zhang,et al.  Multiframe Super-Resolution Employing a Spatially Weighted Total Variation Model , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Liangpei Zhang,et al.  Regional Spatially Adaptive Total Variation Super-Resolution With Spatial Information Filtering and Clustering , 2013, IEEE Transactions on Image Processing.

[17]  Gaofeng Meng,et al.  Edge-Directed Single-Image Super-Resolution Via Adaptive Gradient Magnitude Self-Interpolation , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[19]  Swarup S. Medasani,et al.  Image Super Resolution with Direct Mapping and De-Noising , 2014, 2014 Fourth International Conference of Emerging Applications of Information Technology.

[20]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  Karel Fliegel,et al.  Three-dimensional super-resolution structured illumination microscopy with maximum a posteriori probability image estimation. , 2014, Optics express.

[22]  Byung Cheol Song,et al.  Super-resolution algorithm using noise level adaptive dictionary , 2010, IEEE International Symposium on Consumer Electronics (ISCE 2010).

[23]  Liangpei Zhang,et al.  Multiframe image super-resolution adapted with local spatial information. , 2011, Journal of the Optical Society of America. A, Optics, image science, and vision.

[24]  Michael Elad,et al.  Generalizing the Nonlocal-Means to Super-Resolution Reconstruction , 2009, IEEE Transactions on Image Processing.

[25]  Wei Qiao,et al.  Novel subpixel imaging system with linear CCD sensors , 2001, Optics East.

[26]  Xuelong Li,et al.  Single Image Super-Resolution With Multiscale Similarity Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Michael Elad,et al.  Super-Resolution Without Explicit Subpixel Motion Estimation , 2009, IEEE Transactions on Image Processing.