A partially collapsed Gibbs sampler with accelerated convergence for EEG source localization

This paper addresses the problem of designing efficient sampling moves in order to accelerate the convergence of MCMC methods. The Partially collapsed Gibbs sampler (PCGS) takes advantage of variable reordering, marginalization and trimming to accelerate the convergence of the traditional Gibbs sampler. This work studies two specific moves which allow the convergence of the PCGS to be further improved. It considers a Bayesian model where structured sparsity is enforced using a multivariate Bernoulli Laplacian prior. The posterior distribution associated with this model depends on mixed discrete and continuous random vectors. Due to the discrete part of the posterior, the conventional PCGS gets easily stuck around local maxima. Two Metropolis-Hastings moves based on multiple dipole random shifts and inter-chain proposals are proposed to overcome this problem. The resulting PCGS is applied to EEG source localization. Experiments conducted with synthetic data illustrate the effectiveness of this PCGS with accelerated convergence.

[1]  Christian P. Robert,et al.  Monte Carlo Statistical Methods , 2005, Springer Texts in Statistics.

[2]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[3]  S. Bourguignon,et al.  Bernoulli-Gaussian spectral analysis of unevenly spaced astrophysical data , 2005, IEEE/SP 13th Workshop on Statistical Signal Processing, 2005.

[4]  Volker Roth,et al.  The Bayesian group-Lasso for analyzing contingency tables , 2009, ICML '09.

[5]  D. V. van Dyk,et al.  Partially Collapsed Gibbs Samplers: Illustrations and Applications , 2009 .

[6]  C. Geyer Markov Chain Monte Carlo Maximum Likelihood , 1991 .

[7]  Andrew Gelman,et al.  General methods for monitoring convergence of iterative simulations , 1998 .

[8]  C. Robert The Bayesian choice : a decision-theoretic motivation , 1996 .

[9]  Jean-Yves Tourneret,et al.  EEG source localization based on a structured sparsity prior and a partially collapsed Gibbs sampler , 2015, 2015 IEEE 6th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[10]  C. Geyer,et al.  Annealing Markov chain Monte Carlo with applications to ancestral inference , 1995 .

[11]  Kathryn B. Laskey,et al.  Population Markov Chain Monte Carlo , 2004, Machine Learning.

[12]  Bart Vanrumste,et al.  Journal of Neuroengineering and Rehabilitation Open Access Review on Solving the Inverse Problem in Eeg Source Analysis , 2022 .

[13]  D. V. van Dyk,et al.  Partially Collapsed Gibbs Samplers , 2008 .

[14]  Hoon Kim,et al.  Monte Carlo Statistical Methods , 2000, Technometrics.

[15]  V. Šmídl,et al.  The Variational Bayes Method in Signal Processing , 2005 .

[16]  C. Robert Discretization and Mcmc Convergence Assessment , 1998 .

[17]  Alfred O. Hero,et al.  Tutorial on Stochastic Simulation and Optimization Methods in Signal Processing , 2015, ArXiv.