Automatic parameter tuning for image denoising with learned sparsifying transforms

Data-driven and learning-based sparse signal models outperform analytical models (e.g, wavelets), for image denoising, but require careful parameter tuning to reach peak performance. In this work, we provide a solution to the problem of parameter tuning for image denoising with transform sparsity regularization. We show that by viewing a learned sparsifying transform as a filter bank we can utilize the SURELET denoising algorithm to automatically tune parameters for an image denoising task. Numerical experiments show that combining SURELET with a learned sparsifying transform provides the best of both worlds. Our approach requires no parameter tuning for image denoising, yet outperforms SURELET with analytic transforms and matches the performance of transform learning denoising with hand-tuned parameters.

[1]  Thierry Blu,et al.  The SURE-LET Approach to Image Denoising , 2007, IEEE Transactions on Image Processing.

[2]  Yoram Bresler,et al.  Sparsifying transform learning for Compressed Sensing MRI , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[3]  Yoram Bresler,et al.  Learning sparsifying filter banks , 2015, SPIE Optical Engineering + Applications.

[4]  Rick Chartrand,et al.  Shrinkage mappings and their induced penalty functions , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Yunjin Chen,et al.  Insights Into Analysis Operator Learning: From Patch-Based Sparse Models to Higher Order MRFs , 2014, IEEE Transactions on Image Processing.

[6]  Yoram Bresler,et al.  $\ell_{0}$ Sparsifying Transform Learning With Efficient Optimal Updates and Convergence Guarantees , 2015, IEEE Transactions on Signal Processing.

[7]  Yoram Bresler,et al.  Model-based iterative tomographic reconstruction with adaptive sparsifying transforms , 2014, Electronic Imaging.

[8]  Rémi Gribonval,et al.  Noise aware analysis operator learning for approximately cosparse signals , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Guillermo Sapiro,et al.  Sparse representations for limited data tomography , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[10]  Yanjun Li,et al.  When sparsity meets low-rankness: Transform learning with non-local low-rank constraint for image restoration , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Pascal Frossard,et al.  Dictionary Learning , 2011, IEEE Signal Processing Magazine.

[12]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[13]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[14]  Thierry Blu,et al.  Monte-Carlo Sure: A Black-Box Optimization of Regularization Parameters for General Denoising Algorithms , 2008, IEEE Transactions on Image Processing.

[15]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[16]  Eero P. Simoncelli,et al.  Optimal Denoising in Redundant Representations , 2008, IEEE Transactions on Image Processing.

[17]  Yoram Bresler,et al.  Structured Overcomplete Sparsifying Transform Learning with Convergence Guarantees and Applications , 2015, International Journal of Computer Vision.

[18]  Rémi Gribonval,et al.  Constrained Overcomplete Analysis Operator Learning for Cosparse Signal Modelling , 2012, IEEE Transactions on Signal Processing.

[19]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[20]  Klaus Diepold,et al.  Analysis Operator Learning and its Application to Image Reconstruction , 2012, IEEE Transactions on Image Processing.

[21]  Yonina C. Eldar Generalized SURE for Exponential Families: Applications to Regularization , 2008, IEEE Transactions on Signal Processing.

[22]  Yoram Bresler,et al.  Learning Sparsifying Transforms , 2013, IEEE Transactions on Signal Processing.

[23]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[24]  Y. Bresler,et al.  Adaptive Sparsifying Transforms for Iterative Tomographic Reconstruction , 2014 .

[25]  Gabriel Peyré,et al.  Learning Analysis Sparsity Priors , 2011 .

[26]  Yonina C. Eldar,et al.  The Projected GSURE for Automatic Parameter Tuning in Iterative Shrinkage Methods , 2010, Applied and Computational Harmonic Analysis.

[27]  Lei Zhang,et al.  Low-Dose X-ray CT Reconstruction via Dictionary Learning , 2012, IEEE Transactions on Medical Imaging.

[28]  Simon Ameer-Beg,et al.  Biomedical Imaging: From Nano to Macro , 2008 .

[29]  Yoram Bresler,et al.  Tomographic reconstruction with adaptive sparsifying transforms , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[30]  Thierry Blu,et al.  An Iterative Linear Expansion of Thresholds for $\ell_{1}$-Based Image Restoration , 2013, IEEE Transactions on Image Processing.

[31]  C. Stein Estimation of the Mean of a Multivariate Normal Distribution , 1981 .

[32]  Michael Elad,et al.  Sparsity-based Sinogram Denoising for low-dose Computed Tomography , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[33]  Rémi Gribonval,et al.  Analysis operator learning for overcomplete cosparse representations , 2011, 2011 19th European Signal Processing Conference.