Can local particle filters beat the curse of dimensionality

The discovery of particle filtering methods has enabled the use of nonlinear filtering in a wide array of applications. Unfortunately, the approximation error of particle filters typically grows exponentially in the dimension of the underlying model. This phenomenon has rendered particle filters of limited use in complex data assimilation problems. In this paper, we argue that it is often possible, at least in principle, to develop local particle filtering algorithms whose approximation error is dimension-free. The key to such developments is the decay of correlations property, which is a spatial counterpart of the much better understood stability property of nonlinear filters. For the simplest possible algorithm of this type, our results provide under suitable assumptions an approximation error bound that is uniform both in time and in the model dimension. More broadly, our results provide a framework for the investigation of filtering problems and algorithms in high dimension.

[1]  Hans-Otto Georgii,et al.  Gibbs Measures and Phase Transitions , 1988 .

[2]  J. Lebowitz,et al.  Statistical mechanics of probabilistic cellular automata , 1990 .

[3]  R. L. Dobrushin,et al.  Stochastic cellular systems : ergodicity, memory, morphogenesis , 1990 .

[4]  M. Blank Discreteness and Continuity in Problems of Chaotic Dynamics , 1997 .

[5]  P. Moral,et al.  On the stability of interacting processes with applications to filtering and genetic algorithms , 2001 .

[6]  Sekhar Tatikonda,et al.  Loopy Belief Propogation and Gibbs Measures , 2002, UAI.

[7]  Fabio Martinelli,et al.  Relaxation Times of Markov Chains in Statistical Mechanics and Combinatorial Structures , 2004 .

[8]  Eric Moulines,et al.  Inference in hidden Markov models , 2010, Springer series in statistics.

[9]  Eric Moulines,et al.  Inference in Hidden Markov Models (Springer Series in Statistics) , 2005 .

[10]  Haikady N. Nagaraja,et al.  Inference in Hidden Markov Models , 2006, Technometrics.

[11]  P. Bickel,et al.  Obstacles to High-Dimensional Particle Filtering , 2008 .

[12]  Andrew M. Stuart,et al.  Data assimilation: Mathematical and statistical perspectives , 2008 .

[13]  P. Bickel,et al.  Sharp failure rates for the bootstrap particle filter in high dimensions , 2008, 0805.3287.

[14]  Peter Jan,et al.  Particle Filtering in Geophysical Systems , 2009 .

[15]  Andrew M. Stuart,et al.  Evaluating Data Assimilation Algorithms , 2011, ArXiv.

[16]  A. Beskos,et al.  Error Bounds and Normalizing Constants for Sequential Monte Carlo in High Dimensions , 2011, 1112.1544.

[17]  C. Snyder Particle filters, the "optimal" proposal and high-dimensio nal systems , 2011 .

[18]  Andrew J. Majda,et al.  Filtering Complex Turbulent Systems , 2012 .

[19]  R. Handel,et al.  CONDITIONAL ERGODICITY IN INFINITE DIMENSION , 2012, 1208.3182.

[20]  R. Handel,et al.  Comparison Theorems for Gibbs Measures , 2013, 1308.4117.

[21]  R. Handel,et al.  Phase transitions in nonlinear filtering , 2014, 1401.6450.