Functional mixed effects models

In this article, a new class of functional models in which smoothing splines are used to model fixed effects as well as random effects is introduced. The linear mixed effects models are extended to nonparametric mixed effects models by introducing functional random effects, which are modeled as realizations of zero-mean stochastic processes. The fixed functional effects and the random functional effects are modeled in the same functional space, which guarantee the population-average and subject-specific curves have the same smoothness property. These models inherit the flexibility of the linear mixed effects models in handling complex designs and correlation structures, can include continuous covariates as well as dummy factors in both the fixed or random design matrices, and include the nested curves models as special cases. Two estimation procedures are proposed. The first estimation procedure exploits the connection between linear mixed effects models and smoothing splines and can be fitted using existing software. The second procedure is a sequential estimation procedure using Kalman filtering. This algorithm avoids inversion of large dimensional matrices and therefore can be applied to large data sets. A generalized maximum likelihood (GML) ratio test is proposed for inference and model selection. An application to comparison of cortisol profiles is used as an illustration.

[1]  C. Ansley,et al.  The Signal Extraction Approach to Nonlinear Regression and Spline Smoothing , 1983 .

[2]  B. Silverman,et al.  Functional Data Analysis , 1997 .

[3]  Wensheng Guo.  Functional Mixed Effects Models , 2002 .

[4]  Grace Wahba,et al.  Spline Models for Observational Data , 1990 .

[5]  J. Rice,et al.  Smoothing spline models for the analysis of nested and crossed samples of curves , 1998 .

[6]  M. Kenward,et al.  The Analysis of Designed Experiments and Longitudinal Data by Using Smoothing Splines , 1999 .

[7]  J. Hart,et al.  Kernel Regression Estimation Using Repeated Measurements Data , 1986 .

[8]  Petros G. Voulgaris,et al.  On optimal ℓ∞ to ℓ∞ filtering , 1995, Autom..

[9]  Yuedong Wang,et al.  Mixed-Effects Smoothing Spline ANOVA , 1998 .

[10]  P. Diggle,et al.  Semiparametric models for longitudinal data with application to CD4 cell numbers in HIV seroconverters. , 1994, Biometrics.

[11]  G. Wahba,et al.  Semiparametric Analysis of Variance with Tensor Product Thin Plate Splines , 1993 .

[12]  Jeremy M. G. Taylor,et al.  A Stochastic Model for Analysis of Longitudinal AIDS Data , 1994 .

[13]  Siem Jan Koopman,et al.  Fast Filtering and Smoothing for Multivariate State Space Models , 2000 .

[14]  R. Pearl.  Biometrics , 1914, The American Naturalist.

[15]  Daniel Barry.  An Empirical Bayes Approach to Growth Curve Analysis , 1996 .

[16]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[17]  D. Cox.  Nonparametric Regression and Generalized Linear Models: A roughness penalty approach , 1993 .

[18]  G. Robinson.  That BLUP is a Good Thing: The Estimation of Random Effects , 1991 .

[19]  J M Taylor,et al.  Inference for smooth curves in longitudinal data with application to an AIDS clinical trial. , 1995, Statistics in medicine.

[20]  N. Aronszajn.  Theory of Reproducing Kernels. , 1950 .

[21]  Colin O. Wu,et al.  Nonparametric Mixed Effects Models for Unequally Sampled Noisy Curves , 2001, Biometrics.

[22]  R. Tibshirani,et al.  Generalized Additive Models , 1991 .

[23]  Yuedong Wang.  Smoothing Spline Models with Correlated Random Errors , 1998 .

[24]  Terry Speed,et al.  [That BLUP is a Good Thing: The Estimation of Random Effects]: Comment , 1991 .

[25]  Robert Kohn,et al.  The Performance of Cross-Validation and Maximum Likelihood Estimators of Spline Smoothing Parameters , 1991 .

[26]  G. Wahba.  Improper Priors, Spline Smoothing and the Problem of Guarding Against Model Errors in Regression , 1978 .

[27]  K. Liang,et al.  Asymptotic Properties of Maximum Likelihood Estimators and Likelihood Ratio Tests under Nonstandard Conditions , 1987 .

[28]  J. Faraway.  Regression analysis for a functional response , 1997 .

[29]  J. Ware,et al.  Random-effects models for longitudinal data. , 1982, Biometrics.

[30]  J. Raz,et al.  Semiparametric Stochastic Mixed Models for Longitudinal Data , 1998 .

[31]  R H Jones,et al.  Smoothing splines for longitudinal data. , 1995, Statistics in medicine.

[32]  Hulin Wu,et al.  Local Polynomial Mixed-Effects Models for Longitudinal Data , 2002 .

[33]  B. Silverman,et al.  Estimating the mean and covariance structure nonparametrically when the data are curves , 1991 .

[34]  R. Tibshirani,et al.  Varying‐Coefficient Models , 1993 .

[35]  G. Wahba.  Bayesian "Confidence Intervals" for the Cross-validated Smoothing Spline , 1983 .