Single Image Super-Resolution via the Implementation of the Hardware-Friendly Sparse Coding

Sparse representation is one of the effective approaches to perform the feature extraction on the high-dimensional signals and has been widely used in the field of image processing. In this paper, a novel single image super-resolution (SR) reconstruction algorithm based on sparse coding is presented. Specifically, due to the fact that sparse coding has the potential to greatly facilitate the biological-neural system and to deal with a large amount of complex data, while consuming a finite amount of energy, a memristor crossbar array synthesized by a threshold-type memristor model is constructed for the implementation of a hardware-friendly sparse coding method, i.e., the Locally Competitive Algorithm (LCA). Meanwhile, the relevant online dictionary learning method is provided, along with the description of weight programming strategy. Furthermore, the specific description of the image SR via the LCA sparse coding is provided. For the verification purpose, a series of experiments are carried out to illustrate the validity and effectiveness of the entire scheme.

[1]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[2]  Xuelong Li,et al.  Single Image Super-Resolution With Multiscale Similarity Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[3]  F. Corinto,et al.  Memristor Model Comparison , 2013, IEEE Circuits and Systems Magazine.

[4]  Michael Elad,et al.  Generalizing the Nonlocal-Means to Super-Resolution Reconstruction , 2009, IEEE Transactions on Image Processing.

[5]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  Deepu Rajan,et al.  Generalized interpolation and its application in super-resolution imaging , 2001, Image Vis. Comput..

[7]  Thomas S. Huang,et al.  Coupled Dictionary Training for Image Super-Resolution , 2012, IEEE Transactions on Image Processing.

[8]  Russell Zaretzki,et al.  Beta Process Joint Dictionary Learning for Coupled Feature Spaces with Application to Single Image Super-Resolution , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  L. Chua.  Memristor-The missing circuit element , 1971 .

[12]  R. Williams,et al.  How We Found The Missing Memristor , 2008, IEEE Spectrum.

[13]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[14]  Aggelos K. Katsaggelos,et al.  Reconstruction of a high-resolution image by simultaneous registration, restoration, and interpolation of low-resolution images , 1995, Proceedings., International Conference on Image Processing.

[15]  Dalibor Biolek,et al.  SPICE Model of Memristor with Nonlinear Dopant Drift , 2009 .

[16]  Jieping Ye,et al.  Two-Dimensional Linear Discriminant Analysis , 2004, NIPS.

[17]  Shukai Duan,et al.  Multiple Memristor Circuit Parametric Fault Diagnosis Using Feedback-Control Doublet Generator , 2016, IEEE Access.

[18]  G. C. Sirakoulis,et al.  A Novel Design and Modeling Paradigm for Memristor-Based Crossbar Circuits , 2012, IEEE Transactions on Nanotechnology.

[19]  Kwang In Kim,et al.  Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[21]  Edmund Y. Lam,et al.  A Total Variation Regularization Based Super-Resolution Reconstruction Algorithm for Digital Video , 2007, EURASIP J. Adv. Signal Process..

[22]  Shukai Duan,et al.  A general memristor-based pulse coupled neural network with variable linking coefficient for multi-focus image fusion , 2018, Neurocomputing.

[23]  Xuelong Li,et al.  Image Super-Resolution With Sparse Neighbor Embedding , 2012, IEEE Transactions on Image Processing.

[24]  Gaofeng Meng,et al.  Edge-Directed Single-Image Super-Resolution Via Adaptive Gradient Magnitude Self-Interpolation , 2013, IEEE Transactions on Circuits and Systems for Video Technology.