A gradient adaptive population importance sampler

Monte Carlo (MC) methods are widely used in signal processing and machine learning. A well-known class of MC methods is composed of importance sampling and its adaptive extensions (e.g., population Monte Carlo). In this paper, we introduce an adaptive importance sampler using a population of proposal densities. The novel algorithm dynamically optimizes the cloud of proposals, adapting them using information about the gradient and Hessian matrix of the target distribution. Moreover, a new kind of interaction in the adaptation of the proposal densities is introduced, establishing a trade-off between attaining a good performance in terms of mean square error and robustness to initialization.

[1]  William J. Fitzgerald,et al.  Markov chain Monte Carlo methods with applications to signal processing , 2001, Signal Process..

[2]  P. Minvielle,et al.  Sparse Antenna Array Optimization With the Cross-Entropy Method , 2011, IEEE Transactions on Antennas and Propagation.

[3]  Jung-Chieh Chen.  Partial Transmit Sequences for Peak-to-Average Power Ratio Reduction of OFDM Signals With the Cross-Entropy Method , 2009, IEEE Signal Processing Letters.

[4]  A. Owen,et al.  Safe and Effective Importance Sampling , 2000 .

[5]  Radford M. Neal.  5 MCMC Using Hamiltonian Dynamics , 2011 .

[6]  R. Srinivasan.  Importance Sampling: Applications in Communications and Detection , 2010 .

[7]  Jean-Marie Cornuet,et al.  Adaptive Multiple Importance Sampling , 2009, 0907.1254.

[8]  O. Cappé,et al.  Population Monte Carlo , 2004 .

[9]  K. Yuen.  Bayesian Methods for Structural Dynamics and Civil Engineering , 2010 .

[10]  Rong Chen,et al.  Monte Carlo Bayesian Signal Processing for Wireless Communications , 2002, J. VLSI Signal Process..

[11]  G. Pflug.  Stochastic Approximation Methods for Constrained and Unconstrained Systems - Kushner, HJ.; Clark, D.S. , 1980 .

[12]  R. Douc,et al.  Minimum variance importance sampling via Population Monte Carlo , 2007 .

[13]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[14]  Maurizio Dapor.  Monte Carlo Strategies , 2020, Transport of Energetic Electrons in Solids.

[15]  Jukka Corander,et al.  An adaptive population importance sampler , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Xiaodong Wang,et al.  Monte Carlo methods for signal processing: a review in the statistical signal processing context , 2005, IEEE Signal Processing Magazine.

[17]  J. Corander,et al.  Reconstructing population histories from single nucleotide polymorphism data. , 2011, Molecular biology and evolution.

[18]  Leonidas J. Guibas,et al.  Optimally combining sampling techniques for Monte Carlo rendering , 1995, SIGGRAPH.

[19]  Jukka Corander,et al.  An Adaptive Population Importance Sampler: Learning From Uncertainty , 2015, IEEE Transactions on Signal Processing.

[20]  Harold J. Kushner,et al.  wchastic. approximation methods for constrained and unconstrained systems , 1978 .

[21]  Jukka Corander,et al.  An adaptive population importance sampler , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Xiaodong Wang,et al.  Monte Carlo methods for signal processing , 2005 .

[23]  David A. Clausi,et al.  An adaptive Monte Carlo approach to nonlinear image denoising , 2008, 2008 19th International Conference on Pattern Recognition.

[24]  Tim Hesterberg,et al.  Monte Carlo Strategies in Scientific Computing , 2002, Technometrics.