Image Decomposition and Separation Using Sparse Representations: An Overview

This paper gives essential insights into the use of sparsity and morphological diversity in image decomposition and source separation by reviewing our recent work in this field. The idea to morphologically decompose a signal into its building blocks is an important problem in signal processing and has far-reaching applications in science and technology. Starck , proposed a novel decomposition method-morphological component analysis (MCA)-based on sparse representation of signals. MCA assumes that each (monochannel) signal is the linear mixture of several layers, the so-called morphological components, that are morphologically distinct, e.g., sines and bumps. The success of this method relies on two tenets: sparsity and morphological diversity. That is, each morphological component is sparsely represented in a specific transform domain, and the latter is highly inefficient in representing the other content in the mixture. Once such transforms are identified, MCA is an iterative thresholding algorithm that is capable of decoupling the signal content. Sparsity and morphological diversity have also been used as a novel and effective source of diversity for blind source separation (BSS), hence extending the MCA to multichannel data. Building on these ingredients, we will provide an overview the generalized MCA introduced by the authors in and as a fast and efficient BSS method. We will illustrate the application of these algorithms on several real examples. We conclude our tour by briefly describing our software toolboxes made available for download on the Internet for sparse signal and image decomposition and separation.

[1]  Ronald R. Coifman,et al.  Brushlets: A Tool for Directional Image Analysis and Image Compression , 1997 .

[2]  Michael Elad,et al.  Morphological diversity and source separation , 2006, IEEE Signal Processing Letters.

[3]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing, 2nd Edition , 1999 .

[4]  Mohamed-Jalal Fadili,et al.  Morphological Diversity and Sparsity for Multichannel Data Restoration , 2009, Journal of Mathematical Imaging and Vision.

[5]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[6]  Fionn Murtagh,et al.  Image Processing and Data Analysis - The Multiscale Approach , 1998 .

[7]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[8]  Jean-Luc Starck,et al.  Dictionary learning with spatio-spectral sparsity constraints , 2009 .

[9]  P. Tseng,et al.  Block Coordinate Relaxation Methods for Nonparametric Wavelet Denoising , 2000 .

[10]  Michael Elad,et al.  MCALab: Reproducible Research in Signal and Image Decomposition and Inpainting , 2010, Computing in Science & Engineering.

[11]  L. Wood,et al.  From the Authors , 2003, European Respiratory Journal.

[12]  Michael Elad,et al.  Submitted to Ieee Transactions on Image Processing Image Decomposition via the Combination of Sparse Representations and a Variational Approach , 2022 .

[13]  Jean-Luc Starck,et al.  Blind Source Separation: the Sparsity Revolution , 2008 .

[14]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[15]  E. Candès,et al.  Ridgelets: a key to higher-dimensional intermittency? , 1999, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[16]  S. Mallat A wavelet tour of signal processing , 1998 .

[17]  Mohamed-Jalal Fadili,et al.  Sparsity and Morphological Diversity in Blind Source Separation , 2007, IEEE Transactions on Image Processing.

[18]  L. Demanet,et al.  Wave atoms and sparsity of oscillatory patterns , 2007 .

[19]  Jean-Luc Starck,et al.  Learning adapted dictionaries for geometry and texture separation , 2007, SPIE Optical Engineering + Applications.

[20]  Barak A. Pearlmutter,et al.  Blind source separation by sparse decomposition , 2000, SPIE Defense + Commercial Sensing.

[21]  D. Donoho,et al.  Redundant Multiscale Transforms and Their Application for Morphological Component Separation , 2004 .

[22]  Rémi Gribonval,et al.  Under-determined source separation via mixed-norm regularized minimization , 2008, 2008 16th European Signal Processing Conference.

[23]  Erkki Oja,et al.  Efficient Variant of Algorithm FastICA for Independent Component Analysis Attaining the CramÉr-Rao Lower Bound , 2006, IEEE Transactions on Neural Networks.

[24]  Rémi Gribonval,et al.  Beyond sparsity: recovering structured representations by l¹ minimization and greedy algorithms. - Application to the analysis of sparse underdetermined ICA - , 2005 .

[25]  Stanley Osher,et al.  Modeling Textures with Total Variation Minimization and Oscillating Patterns in Image Processing , 2003, J. Sci. Comput..

[26]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[27]  Yves Meyer,et al.  Oscillating Patterns in Image Processing and Nonlinear Evolution Equations: The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures , 2001 .

[28]  Morten Nielsen,et al.  Beyond sparsity: Recovering structured representations by ${\ell}^1$ minimization and greedy algorithms , 2007, Adv. Comput. Math..

[29]  Radu V. Balan,et al.  Estimator for Number of Sources Using Minimum Description Length Criterion for Blind Sparse Source Mixtures , 2007, ICA.

[30]  Michael Elad,et al.  From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images , 2009, SIAM Rev..

[31]  Michael Zibulevsky,et al.  Underdetermined blind source separation using sparse representations , 2001, Signal Process..

[32]  Jean-Francois Cardoso,et al.  Blind signal separation: statistical principles , 1998, Proc. IEEE.

[33]  Mohamed-Jalal Fadili,et al.  Morphological Component Analysis: An Adaptive Thresholding Strategy , 2007, IEEE Transactions on Image Processing.

[34]  Fabian J. Theis,et al.  Sparse component analysis and blind source separation of underdetermined mixtures , 2005, IEEE Transactions on Neural Networks.

[35]  M. Zibulevsky BLIND SOURCE SEPARATION WITH RELATIVE NEWTON METHOD , 2003 .

[36]  P. Tichavský,et al.  Efficient variant of algorithm fastica for independent component analysis attaining the cramer-RAO lower bound , 2005, IEEE/SP 13th Workshop on Statistical Signal Processing, 2005.