Dictionary Learning for Image Coding Based on Multisample Sparse Representation

In this brief we propose a multisample sparse representation (MSR)-based online dictionary-learning approach to encode images more efficiently. To minimize the reconstructed error while handling a variety of image samples, we develop a multisample sparse representation method capable of obtaining sparser coefficients combined with learning dictionaries on-the-fly. With a well-learned dictionary, we further derive an MSR-based image coding approach to encode the quantized sparse coefficients with reduced reconstructed errors. Experimental results demonstrate rapid convergence of the proposed dictionary-learning algorithm and improved rate-distortion performance over other competitive image compression schemes both subjectively and quantitatively, validating the effectiveness of the proposed approach.

[1]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[2]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[3]  Zhihua Zhang,et al.  A non-convex relaxation approach to sparse dictionary learning , 2011, CVPR 2011.

[4]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[5]  Kjersti Engan,et al.  Image compression using learned dictionaries by RLS-DLA and compared with K-SVD , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Cewu Lu,et al.  Online Robust Dictionary Learning , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[8]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[9]  Mohsen Guizani,et al.  Resource Allocation with Incomplete Information for QoE-Driven Multimedia Communications , 2013, IEEE Transactions on Wireless Communications.

[10]  Jianhua Lu,et al.  Online Dictionary Learning Based Intra-frame Video Coding , 2012, The 15th International Symposium on Wireless Personal Multimedia Communications.

[11]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[12]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[13]  P. Tseng Convergence of a Block Coordinate Descent Method for Nondifferentiable Minimization , 2001 .

[14]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[15]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[16]  W. Marsden I and J , 2012 .

[17]  Barnabás Póczos,et al.  Online group-structured dictionary learning , 2011, CVPR 2011.

[18]  Michael Elad,et al.  Dictionaries for Sparse Representation Modeling , 2010, Proceedings of the IEEE.

[19]  Christine Guillemot,et al.  Image Compression Using Sparse Representations and the Iteration-Tuned and Aligned Dictionary , 2011, IEEE Journal of Selected Topics in Signal Processing.

[20]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[21]  Kjersti Engan,et al.  Recursive Least Squares Dictionary Learning Algorithm , 2010, IEEE Transactions on Signal Processing.

[22]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[23]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[24]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[25]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[26]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1992 .

[27]  Michael Elad,et al.  Compression of facial images using the K-SVD algorithm , 2008, J. Vis. Commun. Image Represent..

[28]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[29]  Jianhua Lu,et al.  Sparse representation of texture patches for low bit-rate image compression , 2012, 2012 Visual Communications and Image Processing.

[30]  Lingfen Sun,et al.  QoE Prediction Model and its Application in Video Quality Adaptation Over UMTS Networks , 2012, IEEE Transactions on Multimedia.

[31]  Kjersti Engan,et al.  Method of optimal directions for frame design , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[32]  Dimitri P. Bertsekas,et al.  Convex Analysis and Optimization , 2003 .

[33]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .