Multi-frame image super-resolution reconstruction via low-rank fusion combined with sparse coding

The sparse coding method has been successfully applied to multi-frame super-resolution in recent years. In this paper, we propose a new multi-frame super-resolution framework which combines low-rank fusion with sparse coding to improve the performance of multi-frame super-resolution. The proposed method gets the high-resolution image by a three-stage process. First, a fused low-resolution image is obtained from multi-frame image by the method of registration and low-rank fusion. Then, we use the jointly training method to train a pair of learning dictionaries which have good adaptive ability. Finally, we use the learning dictionaries combined with sparse coding theory to realize super-resolution reconstruction of the fused low-resolution image. As the experiment results show, this method can recover the lost high frequency information, and has good robustness.

[1]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization and Its Applications to Low Level Vision , 2016, International Journal of Computer Vision.

[2]  Ashok Kumar,et al.  Image interpolation by adaptive 2-D autoregressive modeling , 2010, International Conference on Digital Image Processing.

[3]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[4]  A. Lazarov Iterative MMSE method and recurrent Kalman procedure for ISAR image reconstruction , 2001 .

[5]  Tao Yu,et al.  Image Super-Resolution via Low-Rank Representation , 2014 .

[6]  H Stark,et al.  High-resolution image recovery from image-plane arrays, using convex projections. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[7]  Aggelos K. Katsaggelos,et al.  Sparse Representation-Based Multiple Frame Video Super-Resolution , 2017, IEEE Transactions on Image Processing.

[8]  Xuelong Li,et al.  Image Super-Resolution With Sparse Neighbor Embedding , 2012, IEEE Transactions on Image Processing.

[9]  Guowu Yang,et al.  Identifying APT Malware Domain Based on Mobile DNS Logging , 2017 .

[10]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.

[11]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[12]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[13]  Qiliang Li,et al.  New Collaborative Filtering Algorithms Based on SVD , 2017 .

[14]  Jing Huang,et al.  Semantic Description and Information Retrieval Research of Surveillance Video in Smart Transportation System , 2015 .

[15]  Zhang Jie Region-based Bicubic Image Interpolation Algorithm , 2010 .

[16]  Hideitsu Hino,et al.  Double sparsity for multi-frame super resolution , 2017, Neurocomputing.

[17]  Xuan Zhu,et al.  Super-resolution image reconstruction via patch haar wavelet feature extraction combined with sparse coding , 2015, 2015 IEEE International Conference on Information and Automation.

[18]  Hideitsu Hino,et al.  Multi-frame image super resolution based on sparse coding , 2015, Neural Networks.

[19]  Robert L. Stevenson,et al.  A Bayesian approach to image expansion for improved definitio , 1994, IEEE Trans. Image Process..

[20]  Hai Xia Yan,et al.  Research of Adaptive Gradient Projection Algorithm on Remote Sensing Image Reconstruction , 2013 .

[21]  Seungryong Cho,et al.  Analytic image reconstruction from partial data for a single-scan cone-beam CT with scatter correction. , 2015, Medical physics.

[22]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[23]  Luc Van Gool,et al.  Anchored Neighborhood Regression for Fast Example-Based Super-Resolution , 2013, 2013 IEEE International Conference on Computer Vision.

[24]  John Wright,et al.  Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices via Convex Optimization , 2009, NIPS.

[25]  Jun Wang,et al.  Image Super-Resolution Based on Sparse Representation via Direction and Edge Dictionaries , 2017 .