Fast Bayesian inference of the multivariate Ornstein-Uhlenbeck process.

The multivariate Ornstein-Uhlenbeck process is used in many branches of science and engineering to describe the regression of a system to its stationary mean. Here we present an O(N) Bayesian method to estimate the drift and diffusion matrices of the process from N discrete observations of a sample path. We use exact likelihoods, expressed in terms of four sufficient statistic matrices, to derive explicit maximum a posteriori parameter estimates and their standard errors. We apply the method to the Brownian harmonic oscillator, a bivariate Ornstein-Uhlenbeck process, to jointly estimate its mass, damping, and stiffness and to provide Bayesian estimates of the correlation functions and power spectral densities. We present a Bayesian model comparison procedure, embodying Ockham's razor, to guide a data-driven choice between the Kramers and Smoluchowski limits of the oscillator. These provide novel methods of analyzing the inertial motion of colloidal particles in optical traps.

[1]  A. Einstein.  Über die von der molekularkinetischen Theorie der Wärme geforderte Bewegung von in ruhenden Flüssigkeiten suspendierten Teilchen [AdP 17, 549 (1905)] , 2005, Annalen der Physik.

[2]  J. Waals.  On the Theory of the Brownian Movement , 1918 .

[3]  L. M. M.-T..  Theory of Probability , 1929, Nature.

[4]  G. Uhlenbeck,et al.  On the Theory of the Brownian Motion , 1930 .

[5]  J. Doob,et al.  The Brownian Movement and Stochastic Equations , 1942 .

[6]  S. Chandrasekhar.  Stochastic problems in Physics and Astronomy , 1943 .

[7]  L. Goddard.  Information Theory , 1962, Nature.

[8]  R. Kubo.  The fluctuation-dissipation theorem , 1966 .

[9]  R. Kashyap.  A Bayesian comparison of different classes of dynamic models using empirical data , 1977 .

[10]  Sheldon M. Ross,et al.  Stochastic Processes , 2018, Gauge Integral Structures for Stochastic Calculus and Quantum Electrodynamics.

[11]  C. Gardiner.  Handbook of Stochastic Methods , 1983 .

[12]  A. Zellner,et al.  Basic Issues in Econometrics. , 1986 .

[13]  C. Gardiner.  Adiabatic elimination in stochastic systems. I: Formulation of methods and application to few-variable systems , 1984 .

[14]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[15]  W. Ebeling.  Stochastic Processes in Physics and Chemistry , 1995 .

[16]  José M. F. Moura,et al.  Matrices with banded inverses: Inversion algorithms and factorization of Gauss-Markov processes , 2000, IEEE Trans. Inf. Theory.

[17]  B. Schölkopf,et al.  Sparse Greedy Matrix Approximation for Machine Learning , 2000, ICML.

[18]  Christopher K. I. Williams,et al.  Using the Nyström Method to Speed Up Kernel Machines , 2000, NIPS.

[19]  Lehel Csató,et al.  Sparse On-Line Gaussian Processes , 2002, Neural Computation.

[20]  E. Jaynes.  Probability theory : the logic of science , 2003 .

[21]  H. Flyvbjerg,et al.  Power spectrum analysis for optical tweezers , 2004 .

[22]  M. Tribus,et al.  Probability theory: the logic of science , 2003 .

[23]  Carl E. Rasmussen,et al.  A Unifying View of Sparse Approximate Gaussian Process Regression , 2005, J. Mach. Learn. Res..

[24]  Philip C. Gregory,et al.  Bayesian Logical Data Analysis for the Physical Sciences: Acknowledgements , 2005 .

[25]  J. Cadzow.  Maximum Entropy Spectral Analysis , 2006 .

[26]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[27]  H. Rue,et al.  An explicit link between Gaussian fields and Gaussian Markov random fields: the stochastic partial differential equation approach , 2011 .

[28]  Colin Fox,et al.  Sampling Gaussian Distributions in Krylov Spaces with Conjugate Gradients , 2012, SIAM J. Sci. Comput..

[29]  Jonathan M. Cooper,et al.  Microrheology with optical tweezers: data analysis , 2012 .

[30]  Doreen Eichel,et al.  Data Analysis A Bayesian Tutorial , 2016 .

[31]  Ayan Banerjee,et al.  Simultaneous measurement of mass and rotation of trapped absorbing particles in air. , 2016, Optics letters.

[32]  Daniel Foreman-Mackey,et al.  corner.py: Scatterplot matrices in Python , 2016, J. Open Source Softw..

[33]  Ayan Banerjee,et al.  Fast Bayesian inference of optical trap stiffness and particle diffusion , 2016, Scientific Reports.