Reconstruction and prediction of random dynamical systems under borrowing of strength

We propose a Bayesian nonparametric model based on Markov Chain Monte Carlo (MCMC) methods for the joint reconstruction and prediction of discrete time stochastic dynamical systems, based on $m$-multiple time-series data, perturbed by additive dynamical noise. We introduce the Pairwise Dependent Geometric Stick-Breaking Reconstruction (PD-GSBR) model, which relies on the construction of a $m$-variate nonparametric prior over the space of densities supported over $\mathbb{R}^m$. We are focusing in the case where at least one of the time-series has a sufficiently large sample size representation for an independent and accurate Geometric Stick-Breaking estimation, as defined in Merkatas et al. (2017). Our contention, is that whenever the dynamical error processes perturbing the underlying dynamical systems share common characteristics, underrepresented data sets can benefit in terms of model estimation accuracy. The PD-GSBR estimation and prediction procedure is demonstrated specifically in the case of maps with polynomial nonlinearities of an arbitrary degree. Simulations based on synthetic time-series are presented.

[1]  Mark J. Jensen,et al.  Bayesian Semiparametric Stochastic Volatility Modeling , 2008 .

[2]  Michael I. Jordan,et al.  Sharing Features among Dynamical Systems with Beta Processes , 2009, NIPS.

[3]  David S. Broomhead,et al.  Delay embedding in the presence of dynamical noise , 1998 .

[4]  J. Peinke,et al.  Reconstruction of the Deterministic Dynamics of Stochastic Systems , 2004, Int. J. Bifurc. Chaos.

[5]  S. Chatterjee,et al.  Chaos, Fractals and Statistics , 1992 .

[6]  David Middleton,et al.  Statistical-Physical Models of Electromagnetic Interference , 1977, IEEE Transactions on Electromagnetic Compatibility.

[7]  M. Shinde,et al.  Signal Detection in the Presence of Atmospheric Noise in Tropics , 1974, IEEE Trans. Commun..

[8]  V N Smelyanskiy,et al.  Reconstruction of stochastic nonlinear dynamical models from trajectory measurements. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  Stephen G. Walker,et al.  Dependent mixtures of geometric weights priors , 2017, Comput. Stat. Data Anal..

[10]  Michael I. Jordan,et al.  An HDP-HMM for systems with state persistence , 2008, ICML '08.

[11]  Fernando Quintana,et al.  A Bayesian Non‐Parametric Dynamic AR Model for Multiple Time Series Analysis , 2016 .

[12]  Nelson Christensen,et al.  Fast Bayesian reconstruction of chaotic dynamical systems via extended Kalman filtering. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Matt Taddy,et al.  Markov switching Dirichlet process mixture regression , 2009 .

[14]  F. Takens,et al.  On the nature of turbulence , 1971 .

[15]  A. Duggento,et al.  Inferential framework for nonstationary dynamics. I. Theory. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  Meyer,et al.  Bayesian reconstruction of chaotic dynamical systems , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[17]  Ramsés H. Mena,et al.  Geometric stick-breaking processes for continuous-time Bayesian nonparametric modeling , 2011 .

[18]  H. Kantz,et al.  Nonlinear time series analysis , 1997 .

[19]  Patrick E. McSharry,et al.  Better Nonlinear Models from Noisy Data: Attractors with Maximum Likelihood , 1999, chao-dyn/9912002.

[20]  Enrique ter Horst,et al.  Bayesian dynamic density estimation , 2008 .

[21]  Stark,et al.  Estimation of noise levels for models of chaotic dynamical systems , 2000, Physical review letters.