Application of regression analysis in K-SVD dictionary learning

Abstract Recent past has witnessed the use of sparse coding of images using learned dictionaries for image compression, denoising and deblurring applications. Though, few of the works reported in literature have addressed the issue of determining the optimum size of the dictionary to be learned and the extent of learning required and largely depends on trial and error approach for finding it. This paper analyses the dictionary learning process and models it using multiple regression analysis, a mathematical tool for determining the statistical relationship among variables. The model can be used as a reference for learning dictionaries from the same training set for different applications. Though the analysis returns a fit model, it lacks generality due to the specific training image set used. However, while using a larger or content specific image set for learning a dictionary, such an analysis is extremely useful.

[1]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[2]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[3]  Kjersti Engan,et al.  Recursive Least Squares Dictionary Learning Algorithm , 2010, IEEE Transactions on Signal Processing.

[4]  Kjersti Engan,et al.  Image compression using learned dictionaries by RLS-DLA and compared with K-SVD , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[6]  Michael Elad,et al.  Compression of facial images using the K-SVD algorithm , 2008, J. Vis. Commun. Image Represent..

[7]  Kjersti Engan,et al.  Method of optimal directions for frame design , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).