Mixed‐Effects State‐Space Models for Analysis of Longitudinal Dynamic Systems

The rapid development of new biotechnologies allows us to deeply understand biomedical dynamic systems in more detail and at a cellular level. Many of the subject-specific biomedical systems can be described by a set of differential or difference equations that are similar to engineering dynamic systems. In this article, motivated by HIV dynamic studies, we propose a class of mixed-effects state-space models based on the longitudinal feature of dynamic systems. State-space models with mixed-effects components are very flexible in modeling the serial correlation of within-subject observations and between-subject variations. The Bayesian approach and the maximum likelihood method for standard mixed-effects models and state-space models are modified and investigated for estimating unknown parameters in the proposed models. In the Bayesian approach, full conditional distributions are derived and the Gibbs sampler is constructed to explore the posterior distributions. For the maximum likelihood method, we develop a Monte Carlo EM algorithm with a Gibbs sampler step to approximate the conditional expectations in the E-step. Simulation studies are conducted to compare the two proposed methods. We apply the mixed-effects state-space model to a data set from an AIDS clinical trial to illustrate the proposed methodologies. The proposed models and methods may also have potential applications in other biomedical system analyses such as tumor dynamics in cancer research and genetic regulatory network modeling.

[1]  N. Shephard,et al.  The simulation smoother for time series models , 1995 .

[2]  Fred C. Schweppe,et al.  Evaluation of likelihood functions for Gaussian signals , 1965, IEEE Trans. Inf. Theory.

[3]  R. Kohn,et al.  Markov chain Monte Carlo in conditionally Gaussian state space models , 1996 .

[4]  G. Kitagawa.  Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[5]  Hulin Wu,et al.  Hierarchical Bayesian Methods for Estimation of Parameters in a Longitudinal HIV Dynamic System , 2006, Biometrics.

[6]  Alan S. Perelson,et al.  Decay characteristics of HIV-1-infected compartments during combination therapy , 1997, Nature.

[7]  A. Perelson,et al.  Rapid turnover of plasma virions and CD4 lymphocytes in HIV-1 infection , 1995, Nature.

[8]  M. Rahiala.  Miscellanea. Random coefficient autoregressive models for longitudinal data , 1999 .

[9]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[10]  Andrew Harvey,et al.  Forecasting, Structural Time Series Models and the Kalman Filter. , 1991 .

[11]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[12]  Adrian Pagan,et al.  Some identification and estimation results for regression models with stochastically varying coefficients , 1980 .

[13]  Ting Chen,et al.  Modeling Gene Expression with Differential Equations , 1998, Pacific Symposium on Biocomputing.

[14]  M A Nowak,et al.  Viral dynamics in hepatitis B virus infection. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[15]  J F Boisvieux,et al.  Alternative approaches to estimation of population pharmacokinetic parameters: comparison with the nonlinear mixed-effect model. , 1984, Drug metabolism reviews.

[16]  R. Kohn,et al.  On Gibbs sampling for state space models , 1994 .

[17]  P. Diggle.  Analysis of Longitudinal Data , 1995 .

[18]  Jun S. Liu,et al.  Mixture Kalman filters , 2000 .

[19]  J. Ware,et al.  Random-effects models for longitudinal data. , 1982, Biometrics.

[20]  V De Gruttola,et al.  Estimation of HIV dynamic parameters. , 1998, Statistics in medicine.

[21]  R. Kass.  Nonlinear Regression Analysis and its Applications , 1990 .

[22]  Kok Lay Teo,et al.  Optimal Control of Drug Administration in Cancer Chemotherapy , 1993 .

[23]  Jens Ledet Jensen,et al.  Asymptotic normality of the maximum likelihood estimator in state space models , 1999 .

[24]  G. Kitagawa.  Non-Gaussian state space modeling of time series , 1987, 26th IEEE Conference on Decision and Control.

[25]  G. Kitagawa.  Non-Gaussian State—Space Modeling of Nonstationary Time Series , 1987 .

[26]  M. West,et al.  Bayesian forecasting and dynamic models , 1989 .

[27]  R. Engle,et al.  A One-Factor Multivariate Time Series Model of Metropolitan Wage Rates , 1981 .

[28]  R. Engle,et al.  Alternative Algorithms for the Estimation of Dynamic Factor , 1983 .

[29]  É. Moulines,et al.  Convergence of a stochastic approximation version of the EM algorithm , 1999 .

[30]  Marie Davidian,et al.  Nonlinear Models for Repeated Measurement Data , 1995 .

[31]  Nicholas G. Polson,et al.  A Monte Carlo Approach to Nonnormal and Nonlinear State-Space Modeling , 1992 .

[32]  Jun S. Liu,et al.  Sequential Monte Carlo methods for dynamic systems , 1997 .

[33]  Richard H. Jones.  Longitudinal data with serial correlation , 1993 .

[34]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[35]  H Wu,et al.  Population HIV‐1 Dynamics In Vivo: Applicable Models and Inferential Tools for Virological Data from AIDS Clinical Trials , 1999, Biometrics.

[36]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[37]  Neal S. Holter,et al.  Dynamic modeling of gene expression data. , 2001, Proceedings of the National Academy of Sciences of the United States of America.