Learning Multilevel Dictionaries for Compressed Sensing Using Discriminative Clustering

The performance of sparse recovery using compressed measurements improves when dictionaries learned from training data are used in place of predefined dictionaries. In this paper, we propose to learn incoherent multilevel dictionaries using discriminative clustering in each level. To this end, we present the discriminative K-lines clustering that iterates between identifying the cluster centers and computing the discriminant directions. A scheme for computing representations using the proposed dictionary is also developed. Simulation results for compressed sensing using standard images demonstrate that incorporating incoherence in the dictionary results in improved recovery performance. Furthermore, we implement the proposed algorithms as part of a sparse representations toolbox for the J-DSP software package.

[1]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[2]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[3]  Michael Elad,et al.  Dictionaries for Sparse Representation Modeling , 2010, Proceedings of the IEEE.

[4]  Karthikeyan Natesan Ramamurthy,et al.  Optimality and stability of the K-hyperline clustering algorithm , 2011, Pattern Recognit. Lett..

[5]  Andreas Spanias,et al.  Interactive online undergraduate laboratories using J-DSP , 2005, IEEE Transactions on Education.

[6]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[7]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[8]  Karthikeyan Natesan Ramamurthy,et al.  Mixing matrix estimation using discriminative clustering for blind source separation , 2013, Digit. Signal Process..

[9]  Pavel Pudil,et al.  Introduction to Statistical Pattern Recognition , 2006 .

[10]  Andreas Spanias,et al.  Multilevel dictionary learning for sparse representation of images , 2011, 2011 Digital Signal Processing and Signal Processing Education Meeting (DSP/SPE).

[11]  Yuanqing Li,et al.  K-hyperline clustering learning for sparse component analysis , 2009, Signal Process..