Structured Dictionary Learning Based on Composite Absolute Penalties

In this paper, we focus on the problem of learning dictionaries with structural features for the sparse representations of natural images. Dictionaries learned by traditional techniques such as MOD, K-SVD lack structure. Each atom of them is treated independently and the possible relationships are not fully explored, which is insufficient for some cases. We propose a framework for structured dictionary learning by integrating the Composite Absolute Penalties (CAP) into the K-SVD algorithm. Atoms of the learned dictionary are laid out in a predefined fashion, i.e., group or tree structure. Such a setting is more appropriate to exploit the latent relationships existing between the patches of natural images. Experiments show that dictionaries learned by our method achieve better results for image restoration tasks. Our approach can also be integrated into other sparse representation-based applications of image processing.

[1]  P. Zhao,et al.  The composite absolute penalties family for grouped and hierarchical variable selection , 2009, 0909.0411.

[2]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[3]  Stéphane Mallat,et al.  Sparse geometric image representations with bandelets , 2005, IEEE Transactions on Image Processing.

[4]  Jaakko Astola,et al.  From Local Kernel to Nonlocal Multiple-Model Image Denoising , 2009, International Journal of Computer Vision.

[5]  Kjersti Engan,et al.  Method of optimal directions for frame design , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[6]  D. Donoho Wedgelets: nearly minimax estimation of edges , 1999 .

[7]  Bhaskar D. Rao,et al.  FOCUSS-based dictionary learning algorithms , 2000, SPIE Optics + Photonics.

[8]  E. Candès,et al.  Recovering edges in ill-posed inverse problems: optimality of curvelet frames , 2002 .

[9]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[10]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[12]  Michael J. Black,et al.  Fields of Experts: a framework for learning image priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Eero P. Simoncelli,et al.  Image restoration using Gaussian scale mixtures in the wavelet domain , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[14]  Julien Mairal,et al.  Proximal Methods for Hierarchical Sparse Coding , 2010, J. Mach. Learn. Res..

[15]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.