Stability Analysis of $\ell _{0,\infty }$-Norm Based Convolutional Sparse Coding Using Stripe Coherence

Theoretical guarantees for the <inline-formula><tex-math notation="LaTeX">$\ell _{0,\infty }$</tex-math></inline-formula>-pseudo-norm based convolutional sparse coding have been established in a recent work. However, the stability analysis in the noisy case via the stripe coherence is absent. This coherence is a stronger characterization of the convolutional dictionary, and a considerably more informative measure than the standard global mutual coherence. The present paper supplements this missing part. Formally, three main results together with their proofs are given. The first one is for the stability of the solution to the <inline-formula><tex-math notation="LaTeX">$P_{0,\infty }^{\epsilon }$</tex-math></inline-formula> problem, the second one and the third one are for the stable recovery of orthogonal matching pursuit (OMP) algorithm in the presence of noise. Under a reasonable assumption, the first two results are compared with the corresponding two that use the global mutual coherence in the previous work, respectively, showing the advantages of our results: 1) the stability guarantee conditions are at least as strong as the existing ones; 2) the upper-bound of the distance between the true sparse vector and the solution to the <inline-formula><tex-math notation="LaTeX">$P_{0,\infty }^{\epsilon }$</tex-math></inline-formula> problem is tighter than the counterpart, so is the one between the true sparse vector and the solution obtained by OMP. Moreover, the second result is compared with the third one, stressing the difference in the restriction on noise energy. Also, some experiments are presented to intuitively compare the aforesaid upper-bounds.

[1]  J. H. Wilkinson The algebraic eigenvalue problem , 1966 .

[2]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[3]  E.J. Candes Compressive Sampling , 2022 .

[4]  Brendt Wohlberg,et al.  Efficient Algorithms for Convolutional Sparse Representations , 2016, IEEE Transactions on Image Processing.

[5]  Petre Stoica,et al.  Approaching peak correlation bounds via alternating projections , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Anders P. Eriksson,et al.  Fast Convolutional Sparse Coding , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  José Carlos Príncipe,et al.  A fast proximal method for convolutional sparse coding , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[8]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[9]  Raja Giryes,et al.  A Greedy Approach to 𝓁0, ∞ Based Convolutional Sparse Coding , 2019, SIAM J. Imaging Sci..

[10]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[11]  Jian Wang Support Recovery With Orthogonal Matching Pursuit in the Presence of Noise , 2015, IEEE Transactions on Signal Processing.

[12]  Michael Elad,et al.  Working Locally Thinking Globally: Theoretical Guarantees for Convolutional Sparse Coding , 2017, IEEE Transactions on Signal Processing.

[13]  Lloyd R. Welch,et al.  Lower bounds on the maximum cross correlation of signals (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[14]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[15]  Yuan F. Zheng,et al.  Fully Decomposable Compressive Sampling With Joint Optimization for Multidimensional Sparse Representation , 2018, IEEE Transactions on Signal Processing.

[16]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[17]  Lei Zhang,et al.  Convolutional Sparse Coding for Image Super-Resolution , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  Daniel W. C. Ho,et al.  Underdetermined blind source separation based on sparse representation , 2006, IEEE Transactions on Signal Processing.

[19]  Gordon Wetzstein,et al.  Fast and flexible convolutional sparse coding , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[21]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[22]  Jocelyn Chanussot,et al.  Nonlocal Patch Tensor Sparse Representation for Hyperspectral Image Super-Resolution , 2019, IEEE Transactions on Image Processing.

[23]  Michael Elad,et al.  Rethinking the CSC Model for Natural Images , 2019, NeurIPS.

[24]  Brendt Wohlberg,et al.  Efficient convolutional sparse coding , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[25]  Wen Gao,et al.  Group-Based Sparse Representation for Image Restoration , 2014, IEEE Transactions on Image Processing.

[26]  Qionghai Dai,et al.  Convolutional Sparse Coding for RGB+NIR Imaging , 2018, IEEE Transactions on Image Processing.