Particle flow for nonlinear filters, Bayesian decisions and transport

We derive a new algorithm for particle flow with non-zero diffusion corresponding to Bayes' rule, and we report the results of Monte Carlo simulations which show that the new filter is an order of magnitude more accurate than the extended Kalman filter for a difficult nonlinear filter problem. Our new algorithm is simple and fast to compute, and it has an especially nice intuitive formula, which is the same as Newton's method to solve the maximum likelihood estimation (MLE) problem (but for each particle rather than only the MLE), and it is also the same as the extended Kalman filter for the special case of Gaussian densities (but for each particle rather than just the point estimate). All of these particle flows apply to arbitrary multimodal densities with smooth nowhere vanishing non-Gaussian densities.

[1]  Lingji Chen,et al.  A study of nonlinear filters with particle flow induced by log-homotopy , 2010, Defense + Commercial Sensing.

[2]  D. Rudolf,et al.  Hit-and-Run for Numerical Integration , 2012, 1212.4486.

[3]  Robert D. Russell,et al.  Adaptivity with moving grids , 2009, Acta Numerica.

[4]  H. Rue,et al.  Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations , 2009 .

[5]  Fred Daum,et al.  Particle flow with non-zero diffusion for nonlinear filters , 2013, Defense, Security, and Sensing.

[6]  C. Villani.  The founding fathers of optimal transport , 2009 .

[7]  Simon J. Godsill,et al.  Improvement Strategies for Monte Carlo Particle Filters , 2001, Sequential Monte Carlo Methods in Practice.

[8]  Gian Luca Delzanno,et al.  The fluid dynamic approach to equidistribution methods for grid adaptation , 2011, Comput. Phys. Commun..

[9]  Fred Daum,et al.  Fourier transform particle flow for nonlinear filters , 2013, Defense, Security, and Sensing.

[10]  Bernard Dacorogna,et al.  Existence and regularity of solutions of d ! = f with Dirichlet boundary conditions , 2005 .

[11]  Daniel Rudolf,et al.  Explicit error bounds for lazy reversible Markov chain Monte Carlo , 2008, J. Complex..

[12]  R. Chartrand,et al.  A Gradient Descent Solution to the Monge-Kantorovich Problem , 2009 .

[13]  Robert D. Russell,et al.  Optimal mass transport for higher dimensional adaptive grid generation , 2011, J. Comput. Phys..

[14]  A. Shnirelman,et al.  Evolution of singularities, generalized Liapunov function and generalized integral for an ideal incompressible fluid , 1997 .

[15]  Fred Daum,et al.  Coulomb's law particle flow for nonlinear filters , 2011, Optical Engineering + Applications.

[16]  Mark R. Morelande,et al.  Optimal parameterization of posterior densities using homotopy , 2011, 14th International Conference on Information Fusion.

[17]  C. Villani.  Topics in Optimal Transportation , 2003 .

[18]  Christian Musso,et al.  Improving Regularised Particle Filters , 2001, Sequential Monte Carlo Methods in Practice.

[19]  Omar Hijab.  A class of infinite dimensional filters , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[20]  Fred Daum,et al.  Particle degeneracy: root cause and solution , 2011, Defense + Commercial Sensing.

[21]  J. Lions.  Optimal Control of Systems Governed by Partial Differential Equations , 1971 .

[22]  Frederick Daum.  A new nonlinear filtering formula non-Gaussian discrete time measurements , 1986, 1986 25th IEEE Conference on Decision and Control.

[23]  Xiao-Li Meng,et al.  Simulating Normalizing Constants: From Importance Sampling to Bridge Sampling to Path Sampling , 1998 .

[24]  Emily Jane Walsh.  Moving mesh methods for problems in meteorology , 2010 .

[25]  Branko Ristic,et al.  Beyond the Kalman Filter: Particle Filters for Tracking Applications , 2004 .

[26]  F. Daum.  Nonlinear filters: beyond the Kalman filter , 2005, IEEE Aerospace and Electronic Systems Magazine.

[27]  Frederick E. Daum.  Exact Finite Dimensional Filters for Cryptodeterministic Systems , 1986, 1986 American Control Conference.

[28]  Erich Novak,et al.  Simple Monte Carlo and the Metropolis algorithm , 2007, J. Complex..

[29]  Fred Daum,et al.  Particle flow inspired by Knothe-Rosenblatt transport for nonlinear filters , 2013, Defense, Security, and Sensing.

[30]  Fred Daum,et al.  Nonlinear filters with log-homotopy , 2007, SPIE Optical Engineering + Applications.

[31]  Fred Daum,et al.  Numerical experiments for nonlinear filters with exact particle flow induced by log-homotopy , 2010, Defense + Commercial Sensing.

[32]  Gian Luca Delzanno,et al.  The fluid dynamic approach to equidistribution methods for grid generation and adaptation , 2009 .

[33]  Tim B. Swartz,et al.  Approximating Integrals Via Monte Carlo and Deterministic Methods , 2000 .

[34]  Fred Daum,et al.  Numerical experiments for Coulomb's law particle flow for nonlinear filters , 2011, Optical Engineering + Applications.

[35]  Fred Daum,et al.  Friendly rebuttal to Chen and Mehra: incompressible particle flow for nonlinear filters , 2012, Defense + Commercial Sensing.

[36]  Uwe D. Hanebeck,et al.  Progressive Bayes: a new framework for nonlinear state estimation , 2003, SPIE Defense + Commercial Sensing.

[37]  Fred Daum,et al.  Hollywood log-homotopy: movies of particle flow for nonlinear filters , 2011, Defense + Commercial Sensing.

[38]  Washek F. Pfeffer,et al.  Distributions for which div v = F has a continuous solution , 2008 .

[39]  A. Doucet,et al.  A Tutorial on Particle Filtering and Smoothing: Fifteen years later , 2008 .

[40]  Frederick Daum.  A new nonlinear filtering formula for discrete time measurements , 1985, 1985 24th IEEE Conference on Decision and Control.

[41]  Fred Daum,et al.  Small curvature particle flow for nonlinear filters , 2012, Defense + Commercial Sensing.

[42]  Peter K. Jimack,et al.  Moving mesh methods for solving parabolic partial differential equations , 2011 .

[43]  Fred Daum,et al.  Particle flow with non-zero diffusion for nonlinear filters, Bayesian decisions and transport , 2013, Optics & Photonics - Optical Engineering + Applications.

[44]  Fred Daum,et al.  Seventeen dubious methods to approximate the gradient for nonlinear filters with particle flow , 2009, Optical Engineering + Applications.

[45]  Fred Daum,et al.  Exact particle flow for nonlinear filters , 2010, Defense + Commercial Sensing.

[46]  Frederick E. Daum,et al.  Particle flow and Monge-Kantorovich transport , 2012, 2012 15th International Conference on Information Fusion.

[47]  Fred Daum,et al.  A fresh perspective on research for nonlinear filters , 2010, Defense + Commercial Sensing.

[48]  Allen R. Tannenbaum,et al.  An Efficient Numerical Method for the Solution of the L2 Optimal Mass Transfer Problem , 2010, SIAM J. Sci. Comput..

[49]  J. Stoyanov.  The Oxford Handbook of Nonlinear Filtering , 2012 .

[50]  M. Girolami,et al.  Riemann manifold Langevin and Hamiltonian Monte Carlo methods , 2011, Journal of the Royal Statistical Society: Series B (Statistical Methodology).

[51]  Fred Daum,et al.  Generalized particle flow for nonlinear filters , 2010, Defense + Commercial Sensing.

[52]  V. Arnold,et al.  Topological methods in hydrodynamics , 1998 .

[53]  R. Caflisch.  Monte Carlo and quasi-Monte Carlo methods , 1998, Acta Numerica.

[54]  Fred Daum,et al.  Exact particle flow for nonlinear filters: Seventeen dubious solutions to a first order linear underdetermined PDE , 2010, 2010 Conference Record of the Forty Fourth Asilomar Conference on Signals, Systems and Computers.

[55]  Fred Daum,et al.  Zero curvature particle flow for nonlinear filters , 2012, Defense, Security, and Sensing.

[56]  B. Rozovskii,et al.  The Oxford Handbook of Nonlinear Filtering , 2011 .