Resampling methods for particle filtering: identical distribution, a new method, and comparable study

Resampling is a critical procedure that is of both theoretical and practical significance for efficient implementation of the particle filter. To gain an insight of the resampling process and the filter, this paper contributes in three further respects as a sequel to the tutorial (Li et al., 2015). First, identical distribution (ID) is established as a general principle for the resampling design, which requires the distribution of particles before and after resampling to be statistically identical. Three consistent metrics including the (symmetrical) Kullback-Leibler divergence, Kolmogorov-Smirnov statistic, and the sampling variance are introduced for assessment of the ID attribute of resampling, and a corresponding, qualitative ID analysis of representative resampling methods is given. Second, a novel resampling scheme that obtains the optimal ID attribute in the sense of minimum sampling variance is proposed. Third, more than a dozen typical resampling methods are compared via simulations in terms of sample size variation, sampling variance, computing speed, and estimation accuracy. These form a more comprehensive understanding of the algorithm, providing solid guidelines for either selection of existing resampling methods or new implementations.

[1]  Rong Chen,et al.  A Theoretical Framework for Sequential Importance Sampling with Resampling , 2001, Sequential Monte Carlo Methods in Practice.

[2]  Pierre Del Moral,et al.  Discrete Filtering Using Branching and Interacting Particle Systems , 1998 .

[3]  P. Djurić,et al.  Particle filtering , 2003, IEEE Signal Process. Mag..

[4]  Mónica F. Bugallo,et al.  A New Class of Particle Filters for Random Dynamic Systems with Unknown Statistics , 2004, EURASIP J. Adv. Signal Process..

[5]  Tian-Cheng Li,et al.  Double-resampling Based Monte Carlo Localization for Mobile Robot: Double-resampling Based Monte Carlo Localization for Mobile Robot , 2010 .

[6]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[7]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[8]  Li Tian,et al.  Double-resampling Based Monte Carlo Localization for Mobile Robot , 2010 .

[9]  P. Good.  Resampling Methods , 1999, Birkhäuser Boston.

[10]  Moon Gi Kang,et al.  Super-resolution image reconstruction , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[11]  Simon J. Godsill,et al.  An Overview of Existing Methods and Recent Advances in Sequential Monte Carlo , 2007, Proceedings of the IEEE.

[12]  Petar M. Djuric,et al.  Resampling Methods for Particle Filtering , 2015 .

[13]  M. Siyau,et al.  Applied Technology in Adapting the Number of Particles while Maintaining the Diversity in the Particle Filter , 2014 .

[14]  Gon Woo Kim,et al.  A new compensation technique based on analysis of resampling process in FastSLAM , 2008, Robotica.

[15]  Chandan Mazumdar,et al.  Priori-sensitive resampling particle filter for dynamic state estimation of UUVs , 2013, 2013 8th International Workshop on Systems, Signal Processing and their Applications (WoSSPA).

[16]  X. R. Li,et al.  Distributed implementations of particle filters , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[17]  Jun S. Liu,et al.  Sequential Imputations and Bayesian Missing Data Problems , 1994 .

[18]  Sungjoon Lim,et al.  Flexible zeroth-order resonant antenna independent of substrate deformation , 2010 .

[19]  Jiming Chen,et al.  A Low-Power Memory-Efficient Resampling Architecture for Particle Filters , 2010, Circuits Syst. Signal Process..

[20]  P. Fearnhead,et al.  On‐line inference for hidden Markov models via particle filters , 2003 .

[21]  Carles Ferrer,et al.  Particle filters and resampling techniques: Importance in computational complexity analysis , 2013, 2013 Conference on Design and Architectures for Signal and Image Processing.

[22]  G. Kitagawa.  Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[23]  Mark R. Morelande,et al.  A mode preserving particle filter , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Simon J. Godsill,et al.  Models and Algorithms for Tracking of Maneuvering Objects Using Variable Rate Particle Filters , 2007, Proceedings of the IEEE.

[25]  Eric Moulines,et al.  Comparison of resampling schemes for particle filtering , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[26]  Robert Babuska,et al.  Saturated Particle Filter: Almost sure convergence and improved resampling , 2013, Autom..

[27]  Abhijit Sinha,et al.  An Optimization-Based Parallel Particle Filter for Multitarget Tracking , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[28]  Dieter Fox,et al.  Adapting the Sample Size in Particle Filters Through KLD-Sampling , 2003, Int. J. Robotics Res..

[29]  Tiancheng Li,et al.  Adapting sample size in particle filters through KLD-resampling , 2013, ArXiv.

[30]  Juan M. Corchado,et al.  Fight sample degeneracy and impoverishment in particle filters: A review of intelligent approaches , 2013, Expert Syst. Appl..

[31]  Petar M. Djuric,et al.  Resampling Methods for Particle Filtering: Classification, implementation, and strategies , 2015, IEEE Signal Processing Magazine.

[32]  LiTiancheng,et al.  Algorithm design for parallel implementation of the SMC-PHD filter , 2016 .

[33]  Xiao-Li Hu,et al.  A General Convergence Result for Particle Filtering , 2011, IEEE Transactions on Signal Processing.

[34]  R. Douc,et al.  Long-term stability of sequential Monte Carlo methods under verifiable conditions , 2012, 1203.6898.

[35]  D. Crisan,et al.  A particle approximation of the solution of the Kushner–Stratonovitch equation , 1999 .

[36]  Petar M. Djuric,et al.  Sequential estimation of linear models in distributed settings , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[37]  D. Rubin,et al.  The calculation of posterior distributions by data augmentation , 1987 .

[38]  Arnaud Doucet,et al.  A survey of convergence results on particle filtering methods for practitioners , 2002, IEEE Trans. Signal Process..

[39]  Tianjiang Wang,et al.  Particle filter with spline resampling and global transition model , 2015, IET Comput. Vis..

[40]  P. Fearnhead,et al.  On‐line inference for multiple changepoint problems , 2007 .

[41]  Andrea Simonetto,et al.  Recent Developments in Distributed Particle Filtering: Towards Fast and Accurate Algorithms , 2009 .

[42]  Adang Suwandi Ahmad,et al.  New resampling algorithm for particle filter localization for mobile robot with 3 ultrasonic sonar sensor , 2011, Proceedings of the 2011 International Conference on Electrical Engineering and Informatics.

[43]  Christian P. Robert,et al.  Monte Carlo Statistical Methods , 2005, Springer Texts in Statistics.

[44]  Simo Särkkä,et al.  Moment conditions for convergence of particle filters with unbounded importance weights , 2014, Signal Process..

[45]  Tianjiang Wang,et al.  Anadvanced integrated framework for moving object tracking , 2014, Journal of Zhejiang University SCIENCE C.

[46]  Petar M. Djuric,et al.  New resampling algorithms for particle filters , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[47]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[48]  Pierre Del Moral,et al.  On the Concentration Properties of Interacting Particle Processes , 2011, Found. Trends Mach. Learn..

[49]  Arnaud Doucet,et al.  Sequential Monte Carlo Methods , 2006, Handbook of Graphical Models.

[50]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[51]  Tiancheng Li,et al.  A fast resampling scheme for particle filters , 2013 .

[52]  Javier Bajo,et al.  An Adaptive Particle Filter for Indoor Robot Localization , 2015, ISAmI.

[53]  Yuguo Chen,et al.  Stopping‐time resampling for sequential Monte Carlo methods , 2005 .

[54]  Frank Nielsen,et al.  A family of statistical symmetric divergences based on Jensen's inequality , 2010, ArXiv.

[55]  Jun S. Liu,et al.  Sequential Monte Carlo methods for dynamic systems , 1997 .

[56]  F Gustafsson,et al.  Particle filter theory and practice with positioning applications , 2010, IEEE Aerospace and Electronic Systems Magazine.

[57]  Petar M. Djuric,et al.  Assessment of Nonlinear Dynamic Models by Kolmogorov–Smirnov Statistics , 2010, IEEE Transactions on Signal Processing.

[58]  Juan M. Corchado,et al.  Algorithm design for parallel implementation of the SMC-PHD filter , 2016, Signal Process..

[59]  Fredrik Gustafsson,et al.  On Resampling Algorithms for Particle Filters , 2006, 2006 IEEE Nonlinear Statistical Signal Processing Workshop.

[60]  Flemming Topsøe,et al.  Some inequalities for information divergence and related measures of discrimination , 2000, IEEE Trans. Inf. Theory.

[61]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[62]  Robert Tibshirani,et al.  Resampling Methods of Estimation , 2001 .

[63]  A. Beskos,et al.  On the stability of sequential Monte Carlo methods in high dimensions , 2011, 1103.3965.

[64]  Yuji Matsumoto,et al.  Particle Filter , 2022 .

[65]  J. Holliday.  Sun , 1995 .

[66]  Lawrence M. Murray,et al.  GPU acceleration of the particle filter: the Metropolis resampler , 2012, ArXiv.

[67]  Tiancheng Li,et al.  Deterministic resampling: Unbiased sampling to avoid sample impoverishment in particle filters , 2012, Signal Process..

[68]  M. J. Rufo,et al.  Quasi-Random Sampling Importance Resampling , 2005 .

[69]  N. Whiteley.  Stability properties of some particle filters , 2011, 1109.6779.

[70]  Hendrik W. Lenstra,et al.  Integer Programming with a Fixed Number of Variables , 1983, Math. Oper. Res..