Bayesian Separation of Images Modeled With MRFs Using MCMC

We investigate the source separation problem of random fields within a Bayesian framework. The Bayesian formulation enables the incorporation of prior image models in the estimation of sources. Due to the intractability of the analytical solution, we resort to numerical methods for the joint maximization of the a posteriori distribution of the unknown variables and parameters. We construct the prior densities of pixels using Markov random fields based on a statistical model of the gradient image, and we use a fully Bayesian method with modified-Gibbs sampling. We contrast our work to approximate Bayesian solutions such as iterated conditional modes (ICM) and to non-Bayesian solutions of ICA variety. The performance of the method is tested on synthetic mixtures of texture images and astrophysical images under various noise scenarios. The proposed method is shown to outperform significantly both its approximate Bayesian and non-Bayesian competitors.

[1]  K. Riedel.  Numerical Bayesian Methods Applied to Signal Processing , 1996 .

[2]  Hichem Snoussi,et al.  Fast joint separation and segmentation of mixed images , 2004, J. Electronic Imaging.

[3]  G. Zotti,et al.  All-sky astrophysical component separation with Fast Independent Component Analysis (FastICA) , 2001, astro-ph/0108362.

[4]  Ali Mohammad-Djafari,et al.  Bayesian Wavelet Based Signal and Image Separation , 2003 .

[5]  Brendan J. Frey,et al.  A comparison of algorithms for inference and learning in probabilistic graphical models , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Anna Tonazzini,et al.  Source separation in astrophysical maps using independent factor analysis , 2003, Neural Networks.

[7]  Adel Belouchrani Jean-Fran,et al.  Maximum likelihood source separation for discrete sources , 2007 .

[8]  Kai-Kuang Ma,et al.  A MCMC approach for Bayesian super-resolution image reconstruction , 2005, IEEE International Conference on Image Processing 2005.

[9]  Michel Barlaud,et al.  Deterministic edge-preserving regularization in computed imaging , 1997, IEEE Trans. Image Process..

[10]  D. Rowe.  A Bayesian approach to blind source separation , 2002 .

[11]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[12]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[13]  Sylvia Richardson,et al.  Markov Chain Monte Carlo in Practice , 1997 .

[14]  Ken D. Sauer,et al.  A generalized Gaussian image model for edge-preserving MAP estimation , 1993, IEEE Trans. Image Process..

[15]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[16]  Dinh-Tuan Pham,et al.  Markovian source separation , 2003, IEEE Trans. Signal Process..

[17]  Simon P. Wilson,et al.  Fully Bayesian Source Separation of Astrophysical Images Modelled by Mixture of Gaussians , 2008, IEEE Journal of Selected Topics in Signal Processing.

[18]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.

[19]  Jean-Francois Cardoso,et al.  THE THREE EASY ROUTES TO INDEPENDENT COMPONENT ANALYSIS; CONTRASTS AND GEOMETRY , 2001 .

[20]  Kevin H. Knuth.  A Bayesian approach to source separation , 1999 .

[21]  Anna Tonazzini,et al.  A Markov model for blind image separation by a mean-field EM algorithm , 2006, IEEE Transactions on Image Processing.

[22]  Jean-Luc Starck,et al.  Blind Component Separation in Wavelet Space: Application to CMB Analysis , 2005, EURASIP J. Adv. Signal Process..

[23]  Aapo Hyvärinen,et al.  Nonlinear independent component analysis: Existence and uniqueness results , 1999, Neural Networks.

[24]  D. M. Titterington,et al.  On some Bayesian/regularization methods for image restoration , 1995, IEEE Trans. Image Process..

[25]  Nando de Freitas,et al.  An Introduction to MCMC for Machine Learning , 2004, Machine Learning.

[26]  Harri Lappalainen,et al.  Ensemble learning for independent component analysis , 1999 .

[27]  Anna Tonazzini,et al.  Separation of Correlated Astrophysical Sources Using Multiple-Lag Data Covariance Matrices , 2005, EURASIP J. Adv. Signal Process..

[28]  Hichem Snoussi,et al.  Bayesian source separation with mixture of Gaussians prior for sources and Gaussian prior for mixture coefficients , 2001 .

[29]  Eric Moulines,et al.  Maximum likelihood for blind separation and deconvolution of noisy signals using mixture models , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[30]  Anna Tonazzini,et al.  Source separation in noisy astrophysical images modelled by Markov random fields , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[31]  William Addison.  BLIND SOURCE SEPARATION WITH NON-STATIONARY MIXING USING WAVELETS , 2006 .

[32]  Ercan E. Kuruoglu,et al.  Image separation using particle filters , 2007, Digit. Signal Process..

[33]  Hichem Snoussi.  FAST MCMC SPECTRAL MATCHING SEPARATION IN NOISY GAUSSIAN MIXTURES , 2006 .

[34]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[35]  Aapo Hyvärinen,et al.  Gaussian moments for noisy independent component analysis , 1999, IEEE Signal Processing Letters.

[36]  K OrJ.  Numerical Bayesian methods applied to signal processing , 1996 .

[37]  E. Salerno,et al.  BLIND SEPARATION OF AUTO-CORRELATED IMAGES FROM NOISY MIXTURES USING MRF MODELS , 2003 .

[38]  Hichem Snoussi,et al.  Blind separation of noisy Gaussian stationary sources. Application to cosmic microwave background imaging , 2002, 2002 11th European Signal Processing Conference.

[39]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[40]  Yen-Wei Chen,et al.  Ensemble learning for independent component analysis , 2006, Pattern Recognit..

[41]  Hagai Attias,et al.  Independent Factor Analysis , 1999, Neural Computation.

[42]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[43]  Peter Green,et al.  Markov chain Monte Carlo in Practice , 1996 .

[44]  S Makeig,et al.  Analysis of fMRI data by blind separation into independent spatial components , 1998, Human brain mapping.