Multi-spectral missing label prediction via restoration using deep residual dictionary learning

Dictionary learning (DL) is one of the popular sparse coding machine learning techniques. In image processing literature, every input image is represented as the sparse linear combination of basis vectors. DL has been shown to have wide applications for image restoration as well as pattern recognition problems. In DL, the input image is factorized into dictionary and sparse codes. This factorization always leaves a residual or approximation error. Very few works in the literature had focused on to leverage the information present in this residual. In this paper, we use residuals within our framework and show that the restoration performance or accurate prediction of missing label in multi-spectral images can be significantly improved over conventional DL based techniques. We initially show that the higher order frequencies are propagated through residuals. Then we show that incorporating this residual in the image restoration methodology can significantly improve the outcomes. Finally, we propose a technique to solve the problem of missing label prediction by using a restoration based deep residual dictionary learning framework.

[1]  Rajat Raina,et al.  Self-taught learning: transfer learning from unlabeled data , 2007, ICML '07.

[2]  David Zhang,et al.  Sparse Representation Based Fisher Discrimination Dictionary Learning for Image Classification , 2014, International Journal of Computer Vision.

[3]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[4]  Xuelong Li,et al.  Fast and Accurate Matrix Completion via Truncated Nuclear Norm Regularization , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Enhong Chen,et al.  Image Denoising and Inpainting with Deep Neural Networks , 2012, NIPS.

[6]  Debin Zhao,et al.  Image super-resolution via dual-dictionary learning and sparse representation , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[7]  Minh N. Do,et al.  Semantic Image Inpainting with Perceptual and Contextual Losses , 2016, ArXiv.

[8]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[9]  John P. Fulton,et al.  An overview of current and potential applications of thermal remote sensing in precision agriculture , 2017, Comput. Electron. Agric..

[10]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[11]  J. Mansfield,et al.  Multispectral imaging in biology and medicine: Slices of life , 2006, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[12]  Narendra Ahuja,et al.  Image completion using planar structure guidance , 2014, ACM Trans. Graph..

[13]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[14]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[15]  Dimitris N. Metaxas,et al.  Deformable segmentation via sparse representation and dictionary learning , 2012, Medical Image Anal..

[16]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[17]  Jian Sun,et al.  Statistics of Patch Offsets for Image Completion , 2012, ECCV.

[18]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[19]  Karthikeyan Natesan Ramamurthy,et al.  Learning Stable Multilevel Dictionaries for Sparse Representations , 2013, IEEE Transactions on Neural Networks and Learning Systems.