An adaptive population importance sampler

Monte Carlo (MC) methods are well-known computational techniques, widely used in different fields such as signal processing, communications and machine learning. An important class of MC methods is composed of importance sampling (IS) and its adaptive extensions, such as population Monte Carlo (PMC) and adaptive multiple IS (AMIS). In this work, we introduce a novel adaptive and iterated importance sampler using a population of proposal densities. The proposed algorithm, named adaptive population importance sampling (APIS), provides a global estimation of the variables of interest iteratively, making use of all the samples previously generated. APIS combines a sophisticated scheme to build the IS estimators (based on the deterministic mixture approach) with a simple temporal adaptation (based on epochs). In this way, APIS is able to keep all the advantages of both AMIS and PMC, while minimizing their drawbacks. Furthermore, APIS is easily parallelizable. The cloud of proposals is adapted in such a way that local features of the target density can be better taken into account compared to single global adaptation procedures. The result is a fast, simple, robust and high-performance algorithm applicable to a wide range of problems. Numerical results show the advantages of the proposed sampling scheme in four synthetic examples and a localization problem in a wireless sensor network.

[1]  J. Marin,et al.  Consistency of the Adaptive Multiple Importance Sampling , 2012, 1211.2548.

[2]  J. Corander,et al.  Reconstructing population histories from single nucleotide polymorphism data. , 2011, Molecular biology and evolution.

[3]  Jean-Marie Cornuet,et al.  Adaptive Multiple Importance Sampling , 2009, 0907.1254.

[4]  O. Cappé,et al.  Population Monte Carlo , 2004 .

[5]  Petar M. Djuric,et al.  Gibbs sampling approach for generation of truncated multivariate Gaussian random variables , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[6]  M. Evans,et al.  Methods for Approximating Integrals in Statistics with Special Emphasis on Bayesian Integration Problems , 1995 .

[7]  J. Skilling.  Nested sampling for general Bayesian computation , 2006 .

[8]  Jukka Corander,et al.  An adaptive population importance sampler , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Mónica F. Bugallo,et al.  Marginalized population Monte Carlo , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  T. Hesterberg,et al.  Weighted Average Importance Sampling and Defensive Mixture Distributions , 1995 .

[11]  Z. Botev.  An algorithm for rare-event probability estimation using the product rule of probability theory , 2008 .

[12]  Dirk P. Kroese,et al.  An Efficient Algorithm for Rare-event Probability Estimation, Combinatorial Optimization, and Counting , 2008 .

[13]  Mónica F. Bugallo,et al.  Joint Model Selection and Parameter Estimation by Population Monte Carlo Simulation , 2010, IEEE Journal of Selected Topics in Signal Processing.

[14]  Jean-Michel Marin,et al.  Adaptive importance sampling in general mixture classes , 2007, Stat. Comput..

[15]  Petar M. Djuric,et al.  Applications of particle filtering to communications: A review , 2002, 2002 11th European Signal Processing Conference.

[16]  Tim B. Swartz,et al.  Approximating Integrals Via Monte Carlo and Deterministic Methods , 2000 .

[17]  Petar M. Djuric,et al.  Gaussian particle filtering , 2003, IEEE Trans. Signal Process..

[18]  Luca Martino,et al.  Fully adaptive Gaussian mixture Metropolis-Hastings algorithm , 2012, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  Joaquín Míguez,et al.  Robust mixture populationmonte Carlo scheme with adaptation of the number of components , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[20]  G. Parisi,et al.  Simulated tempering: a new Monte Carlo scheme , 1992, hep-lat/9205018.

[21]  A. Owen,et al.  Safe and Effective Importance Sampling , 2000 .

[22]  Luca Pozzi,et al.  A R Adaptive Multiple Importance Sampling (ARAMIS) , 2013 .

[23]  Walter R. Gilks,et al.  RESAMPLE-MOVE Filtering with Cross-Model Jumps , 2001, Sequential Monte Carlo Methods in Practice.

[24]  S. Godsill,et al.  Special issue on Monte Carlo methods for statistical signal processing , 2002 .

[25]  Leonidas J. Guibas,et al.  Optimally combining sampling techniques for Monte Carlo rendering , 1995, SIGGRAPH.

[26]  Nando de Freitas,et al.  An Introduction to MCMC for Machine Learning , 2004, Machine Learning.

[27]  R. Douc,et al.  Minimum variance importance sampling via Population Monte Carlo , 2007 .

[28]  H. Haario,et al.  An adaptive Metropolis algorithm , 2001 .

[29]  Andreas M. Ali,et al.  An Empirical Study of Collaborative Acoustic Source Localization , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[30]  Joaquín Míguez,et al.  A population Monte Carlo scheme with transformed weights and its application to stochastic kinetic models , 2012, Stat. Comput..

[31]  Yukito IBA,et al.  Population Monte Carlo algorithms , 2000, cond-mat/0008226.

[32]  Jean-Michel Marin,et al.  Convergence of Adaptive Sampling Schemes , 2004 .

[33]  John W. Fisher,et al.  Nonparametric belief propagation for self-localization of sensor networks , 2005, IEEE Journal on Selected Areas in Communications.

[34]  C. Robert,et al.  Properties of nested sampling , 2008, 0801.3887.

[35]  Rong Chen,et al.  Monte Carlo Bayesian Signal Processing for Wireless Communications , 2002, J. VLSI Signal Process..

[36]  R. Carroll,et al.  Advanced Markov Chain Monte Carlo Methods: Learning from Past Samples , 2010 .

[37]  Luca Martino,et al.  Generalized rejection sampling schemes and applications in signal processing , 2009, Signal Process..

[38]  P. Djurić,et al.  Particle filtering , 2003, IEEE Signal Process. Mag..

[39]  Michael Habeck,et al.  Bayesian evidence and model selection , 2014, Digit. Signal Process..

[40]  D. W. Scott,et al.  Multivariate Density Estimation, Theory, Practice and Visualization , 1992 .

[41]  William J. Fitzgerald,et al.  Markov chain Monte Carlo methods with applications to signal processing , 2001, Signal Process..

[42]  Xiaodong Wang,et al.  Monte Carlo methods for signal processing , 2005 .