Variance-reduced HMM for Stochastic Slow-Fast Systems

Abstract We propose a novel variance reduction strategy based on control variables for simulating the averaged equation of a stochastic slow-fast system. In this system, we assume that the fast equation is ergodic, implying the existence of an invariant measure, for every fixed value of the slow variable. The right hand side of the averaged equation contains an integral with respect to this unknown invariant measure, which is approximated by the heterogeneous multiscale method (HMM). The HMM method corresponds to a Markov chain Monte Carlo method in which samples are generated by simulating the fast equation for a fixed value of the slow variable. As a consequence, the variance of the HMM estimator decays slowly. Here, we introduce a variance-reduced HMM estimator based on control variables: from the current time HMM estimation, we subtract a second HMM estimator at the previous time step using the same seed as the current time HMM estimator. To avoid introducing a bias, we add the previously calculated variance-reduced estimator. We analyze convergence of the proposed estimator and apply it to a linear and nonlinear model.

[1]  Eric Vanden Eijnden Numerical techniques for multi-scale dynamical systems with stochastic effects , 2003 .

[2]  S. Jonathan Chapman,et al.  Analysis of a Stochastic Chemical System Close to a SNIPER Bifurcation of Its Mean-Field Model , 2008, SIAM J. Appl. Math..

[3]  Grigorios A. Pavliotis,et al.  Multiscale Methods: Averaging and Homogenization , 2008 .

[4]  Ioannis G. Kevrekidis,et al.  Variance Reduction for the Equation-Free Simulation of Multiscale Stochastic Systems , 2007, Multiscale Model. Simul..

[5]  E. Weinan,et al.  Effectiveness of implicit methods for stiff stochastic differential equations , 2008 .

[6]  Ioannis G. Kevrekidis,et al.  Strong convergence of projective integration schemes for singularly perturbed stochastic differential systems , 2006 .

[7]  Desmond J. Higham,et al.  An Algorithmic Introduction to Numerical Simulation of Stochastic Differential Equations , 2001, SIAM Rev..

[8]  Giovanni Samaey,et al.  Individual-based models for bacterial chemotaxis in the diffusion asymptotics , 2011, 1111.5140.

[9]  Eric Vanden-Eijnden,et al.  NUMERICAL TECHNIQUES FOR MULTI-SCALE DYNAMICAL SYSTEMS WITH STOCHASTIC EFFECTS ⁄ , 2003 .

[10]  A. Stuart,et al.  Extracting macroscopic dynamics: model problems and algorithms , 2004 .

[11]  T. Lelièvre,et al.  Free Energy Computations: A Mathematical Perspective , 2010 .

[12]  Mark S Gordon,et al.  Nonlinear response time-dependent density functional theory combined with the effective fragment potential method. , 2014, The Journal of chemical physics.

[13]  Matthew J. Smith,et al.  Model reduction for slow-fast stochastic systems with metastable behaviour. , 2014, The Journal of chemical physics.