Prediction Accuracy in Multivariate Repeated-Measures Bayesian Forecasting Models with Examples Drawn from Research on Sleep and Circadian Rhythms

In study designs with repeated measures for multiple subjects, population models capturing within- and between-subjects variances enable efficient individualized prediction of outcome measures (response variables) by incorporating individuals response data through Bayesian forecasting. When measurement constraints preclude reasonable levels of prediction accuracy, additional (secondary) response variables measured alongside the primary response may help to increase prediction accuracy. We investigate this for the case of substantial between-subjects correlation between primary and secondary response variables, assuming negligible within-subjects correlation. We show how to determine the accuracy of primary response predictions as a function of secondary response observations. Given measurement costs for primary and secondary variables, we determine the number of observations that produces, with minimal cost, a fixed average prediction accuracy for a model of subject means. We illustrate this with estimation of subject-specific sleep parameters using polysomnography and wrist actigraphy. We also consider prediction accuracy in an example time-dependent, linear model and derive equations for the optimal timing of measurements to achieve, on average, the best prediction accuracy. Finally, we examine an example involving a circadian rhythm model and show numerically that secondary variables can improve individualized predictions in this time-dependent nonlinear model as well.

[1]  Maria L. Thomas,et al.  Patterns of performance degradation and restoration during sleep restriction and subsequent recovery: a sleep dose‐response study , 2003, Journal of sleep research.

[2]  I. Feinberg,et al.  Homeostatic behavior of fast fourier transform power in very low frequency non-rapid eye movement human electroencephalogram , 2006, Neuroscience.

[3]  Robert E. Ployhart,et al.  Growth Modeling Using Random Coefficient Models: Model Building, Testing, and Illustrations , 2002 .

[4]  Erik Olofsen,et al.  Nonlinear mixed-effects modeling: individualization and prediction. , 2004, Aviation, space, and environmental medicine.

[5]  Pietro Badia,et al.  Inter‐ and intra‐individual variability in performance near the circadian nadir during sleep deprivation , 2004, Journal of sleep research.

[6]  D. Hurley,et al.  Objective measurements of sleep for non‐laboratory settings as alternatives to polysomnography – a systematic review , 2011, Journal of sleep research.

[7]  A. Dahan,et al.  Population pharmacokinetics/pharmacodynamics of anesthetics , 2005, The AAPS Journal.

[8]  V. Carey,et al.  Mixed-Effects Models in S and S-Plus , 2001 .

[9]  K. Chaloner Optimal Bayesian Experimental Design for Linear Models , 1984 .

[10]  Gregory C. Reinsel,et al.  Mean Squared Error Properties of Empirical Bayes Estimators in a Multivariate Random Effects General Linear Model , 1985 .

[11]  T. Balkin,et al.  Current Approaches and Challenges to Development of an Individualized Sleep and Performance Prediction Model , 2010 .

[12]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[13]  Geert Crombez,et al.  Pain-related fear is more disabling than pain itself: evidence on the role of pain-related fear in chronic back pain disability , 1999, Pain.

[14]  Frédéric Y Bois,et al.  Evaluation of antiangiogenic treatment effects on tumors' microcirculation by Bayesian physiological pharmacokinetic modeling and magnetic resonance imaging. , 2006, Magnetic resonance imaging.

[15]  D. Dinges,et al.  Dynamic circadian modulation in a biomathematical model for the effects of sleep and sleep loss on waking neurobehavioral performance. , 2013, Sleep.

[16]  Hans P A Van Dongen,et al.  Trait interindividual differences in the sleep physiology of healthy young adults , 2007, Journal of sleep research.

[17]  Peter S. Winne,et al.  The Range and Consistency of Individual Differences in Continuous Work , 1980 .

[18]  D. Dinges,et al.  Systematic interindividual differences in neurobehavioral impairment from sleep loss: evidence of trait-like differential vulnerability. , 2004, Sleep.

[19]  J. Phillips,et al.  Predicting individual differences in response to sleep loss: application of current techniques. , 2011, Aviation, space, and environmental medicine.

[20]  Jen-Kuang Huang,et al.  Confidence Intervals for Individualized Performance Models , 2007 .

[21]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[22]  Edward R. Dougherty,et al.  Application of the Bayesian MMSE estimator for classification error to gene expression microarray data , 2011, Bioinform..

[23]  T. Balkin,et al.  Fatigue models for applied research in warfighting. , 2004, Aviation, space, and environmental medicine.

[24]  S. Daan,et al.  Timing of human sleep: recovery process gated by a circadian pacemaker. , 1984, The American journal of physiology.

[25]  D. J. Mullaney,et al.  Automatic sleep/wake identification from wrist activity. , 1992, Sleep.

[26]  D. Dinges,et al.  The cumulative cost of additional wakefulness: dose-response effects on neurobehavioral functions and sleep physiology from chronic sleep restriction and total sleep deprivation. , 2003, Sleep.

[27]  E. Kamen,et al.  Introduction to Optimal Estimation , 1999 .

[28]  A. Borbély A two process model of sleep regulation. , 1982, Human neurobiology.

[29]  Steven R. Hursh,et al.  Chapter 66 – Fatigue and Performance Modeling , 2010 .

[30]  J. Ware,et al.  Random-effects models for longitudinal data. , 1982, Biometrics.

[31]  D. Dinges,et al.  Optimization of biomathematical model predictions for cognitive performance impairment in individuals: accounting for unknown traits and uncertain states in homeostatic and circadian processes. , 2007, Sleep.

[32]  Greg Maislin,et al.  Dealing with inter-individual differences in the temporal dynamics of fatigue and performance: importance and techniques. , 2004, Aviation, space, and environmental medicine.