A second-order iterated smoothing algorithm

Simulation-based inference for partially observed stochastic dynamic models is currently receiving much attention due to the fact that direct computation of the likelihood is not possible in many practical situations. Iterated filtering methodologies enable maximization of the likelihood function using simulation-based sequential Monte Carlo filters. Doucet et al. (2013) developed an approximation for the first and second derivatives of the log likelihood via simulation-based sequential Monte Carlo smoothing and proved that the approximation has some attractive theoretical properties. We investigated an iterated smoothing algorithm carrying out likelihood maximization using these derivative approximations. Further, we developed a new iterated smoothing algorithm, using a modification of these derivative estimates, for which we establish both theoretical results and effective practical performance. On benchmark computational challenges, this method beat the first-order iterated filtering algorithm. The method’s performance was comparable to a recently developed iterated filtering algorithm based on an iterated Bayes map. Our iterated smoothing algorithm and its theoretical justification provide new directions for future developments in simulation-based inference for latent variable models such as partially observed Markov process models.

[1]  James C. Spall,et al.  Introduction to stochastic search and optimization - estimation, simulation, and control , 2003, Wiley-Interscience series in discrete mathematics and optimization.

[2]  Ajay Jasra,et al.  Parameter Estimation in Hidden Markov Models With Intractable Likelihoods Using Sequential Monte Carlo , 2013, 1311.4117.

[3]  A. Doucet,et al.  Derivative-Free Estimation of the Score Vector and Observed Information Matrix with Application to State-Space Models , 2013, 1304.5768.

[4]  S. Wood.  Statistical inference for noisy nonlinear ecological dynamic systems , 2010, Nature.

[5]  G. Macdonald.  The Epidemiology and Control of Malaria. , 1957 .

[6]  P. Kloeden,et al.  Numerical Solution of Stochastic Differential Equations , 1992 .

[7]  David Welch,et al.  Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems , 2009, Journal of The Royal Society Interface.

[8]  E L Ionides,et al.  Inference for nonlinear dynamical systems , 2006, Proceedings of the National Academy of Sciences.

[9]  M. Pascual,et al.  Inapparent infections and cholera dynamics , 2008, Nature.

[10]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[11]  Edward L. Ionides,et al.  Plug-and-play inference for disease dynamics: measles in large and small populations as a case study , 2009, Journal of The Royal Society Interface.

[12]  Aaron A. King,et al.  Time series analysis via mechanistic models , 2008, 0802.0021.

[13]  Nicolas Chopin,et al.  SMC2: an efficient algorithm for sequential analysis of state space models , 2011, 1101.1528.

[14]  M. Pascual,et al.  The Potential Elimination of Plasmodium vivax Malaria by Relapse Treatment: Insights from a Transmission Model and Surveillance Data from NW India , 2013, PLoS neglected tropical diseases.

[15]  Ioannis G. Kevrekidis,et al.  Equation-free: The computer-aided analysis of complex multiscale systems , 2004 .

[16]  J. Dushoff,et al.  Inferring the causes of the three waves of the 1918 influenza pandemic in England and Wales , 2013, Proceedings of the Royal Society B: Biological Sciences.

[17]  P. Rohani,et al.  Resolving pertussis immunity and vaccine effectiveness using incidence time series , 2012, Expert review of vaccines.

[18]  O. Cappé,et al.  Sequential Monte Carlo smoothing with application to parameter estimation in nonlinear state space models , 2006, math/0609514.

[19]  Harold J. Kushner,et al.  wchastic. approximation methods for constrained and unconstrained systems , 1978 .

[20]  Johan Dahlin,et al.  Particle Metropolis–Hastings using gradient and Hessian information , 2013, Statistics and Computing.

[21]  Dao Nguyen,et al.  Statistical Inference for Partially Observed Markov Processes via the R Package pomp , 2015, 1509.00503.

[22]  B T Grenfell,et al.  Noisy Clockwork: Time Series Analysis of Population Fluctuations in Animals , 2001, Science.

[23]  C. Steiner,et al.  Identifying the Interaction Between Influenza and Pneumococcal Pneumonia Using Incidence Data , 2013, Science Translational Medicine.

[24]  Sumeetpal S. Singh,et al.  Particle approximations of the score and observed information matrix in state space models with application to parameter estimation , 2011 .

[25]  Fabrice Carrat,et al.  Explaining rapid reinfections in multiple-wave influenza outbreaks: Tristan da Cunha 1971 epidemic as a case study , 2011, Proceedings of the Royal Society B: Biological Sciences.

[26]  E. Ionides,et al.  Inference for dynamic and latent variable models via iterated, perturbed Bayes maps , 2015, Proceedings of the National Academy of Sciences.

[27]  S. Altizer,et al.  Resolving the roles of immunity, pathogenesis, and immigration for rabies persistence in vampire bats , 2013, Proceedings of the National Academy of Sciences.

[28]  A. Doucet,et al.  A Tutorial on Particle Filtering and Smoothing: Fifteen years later , 2008 .

[29]  Eric Moulines,et al.  Comparison of resampling schemes for particle filtering , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[30]  E. Ionides,et al.  Dynamic Variation in Sexual Contact Rates in a Cohort of HIV-Negative Gay Men. , 2015, American journal of epidemiology.

[31]  J. Botella de Maglia,et al.  [Prevention of malaria]. , 1999, Revista clinica espanola.

[32]  Mercedes Pascual,et al.  Forcing Versus Feedback: Epidemic Malaria and Monsoon Rains in Northwest India , 2010, PLoS Comput. Biol..

[33]  N. Whiteley.  Stability properties of some particle filters , 2011, 1109.6779.

[34]  N. Grassly,et al.  The role of older children and adults in wild poliovirus transmission , 2014, Proceedings of the National Academy of Sciences.

[35]  Mark M. Tanaka,et al.  Sequential Monte Carlo without likelihoods , 2007, Proceedings of the National Academy of Sciences.

[36]  C. Sokhna,et al.  Dynamical malaria models reveal how immunity buffers effect of climate variability , 2015, Proceedings of the National Academy of Sciences.

[37]  P. Fearnhead,et al.  Particle Approximations of the Score and Observed Information Matrix for Parameter Estimation in State–Space Models With Linear Computational Cost , 2013, 1306.0735.

[38]  Aaron A. King,et al.  Immune Boosting Explains Regime-Shifts in Prevaccine-Era Pertussis Dynamics , 2013, PloS one.

[39]  Pejman Rohani,et al.  Statistical Inference for Multi-Pathogen Systems , 2011, PLoS Comput. Biol..

[40]  D. Cummings,et al.  Deciphering the impacts of vaccination and immunity on pertussis epidemiology in Thailand , 2013, Proceedings of the National Academy of Sciences.

[41]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[42]  J. Dushoff,et al.  Effects of School Closure on Incidence of Pandemic Influenza in Alberta, Canada , 2012 .

[43]  A. King,et al.  Unraveling the Transmission Ecology of Polio , 2015, PLoS Biology.

[44]  Pejman Rohani,et al.  Avoidable errors in the modelling of outbreaks of emerging pathogens, with special reference to Ebola , 2014, Proceedings of the Royal Society B: Biological Sciences.

[45]  Anindya Bhadra,et al.  Malaria in Northwest India: Data Analysis via Partially Observed Stochastic Differential Equation Models Driven by Lévy Noise , 2011 .

[46]  Yves F. Atchad'e,et al.  Iterated filtering , 2009, 0902.0347.