Regime Switching State-Space Models Applied to Psychological Processes: Handling Missing Data and Making Inferences

Many psychological processes are characterized by recurrent shifts between distinct regimes or states. Examples that are considered in this paper are the switches between different states associated with premenstrual syndrome, hourly fluctuations in affect during a major depressive episode, and shifts between a “hot hand” and a “cold hand” in a top athlete. We model these processes with the regime switching state-space model proposed by Kim (J. Econom. 60:1–22, 1994), which results in both maximum likelihood estimates for the model parameters and estimates of the latent variables and the discrete states of the process. However, the current algorithm cannot handle missing data, which limits its applicability to psychological data. Moreover, the performance of standard errors for the purpose of making inferences about the parameter estimates is yet unknown. In this paper we modify Kim’s algorithm so it can handle missing data and we perform a simulation study to investigate its performance in (relatively) short time series in cases of different kinds of missing data and in case of complete data. Finally, we apply the regime switching state-space model to the three empirical data sets described above.

[1]  E. Freeman.  Premenstrual syndrome and premenstrual dysphoric disorder: definitions and diagnosis 1 1 Adapted from the symposium on Premenstrual Syndrome and Premenstrual Dysphoric Disorders, July 17, 2000, Rhodes, Greece , 2003, Psychoneuroendocrinology.

[2]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[3]  D. Freedman,et al.  On The So-Called “Huber Sandwich Estimator” and “Robust Standard Errors” , 2006 .

[4]  James D. Hamilton.  Time Series Analysis , 1994 .

[5]  Theodore A. Walls,et al.  Models for intensive longitudinal data , 2006 .

[6]  Francis Tuerlinckx,et al.  A Hierarchical Ornstein–Uhlenbeck Model for Continuous Repeated Measurement Data , 2009 .

[7]  Sylvia Frühwirth-Schnatter,et al.  Finite Mixture and Markov Switching Models , 2006 .

[8]  Peter C. M. Molenaar,et al.  The integrated trait–state model , 2007 .

[9]  Siem Jan Koopman,et al.  Time Series Analysis by State Space Methods , 2001 .

[10]  Chang‐Jin Kim,et al.  State-Space Models with Regime-Switching: Classical and Gibbs Sampling Approaches with Applications , 1999 .

[11]  Thomas H. McCurdy,et al.  Duration-Dependent Transitions in a Markov Model of U.S. GNP Growth , 1994 .

[12]  Sy-Miin Chow,et al.  Using State-Space Model with Regime Switching to Represent the Dynamics of Facial Electromyography (EMG) Data , 2010 .

[13]  Peter C M Molenaar,et al.  Statistical Modeling of the Individual: Rationale and Application of Multivariate Stationary Time Series Analysis , 2005, Multivariate behavioral research.

[14]  W. Meredith.  Measurement invariance, factor analysis and factorial invariance , 1993 .

[15]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[16]  Andrew Harvey,et al.  Forecasting, Structural Time Series Models and the Kalman Filter , 1990 .

[17]  H.L.J. van der Maas,et al.  Stagewise cognitive development: an application of catastrophe theory. , 1992, Psychological review.

[18]  Ellen L. Hamaker,et al.  Regime-switching models to study psychological processes , 2010 .

[19]  R. Ratcliff,et al.  Estimation and interpretation of 1/fα noise in human cognition , 2004 .

[20]  Conor V Dolan,et al.  Discrete Latent Markov Models for Normally Distributed Response Data , 2005, Multivariate behavioral research.

[21]  Ellen A. Skinner,et al.  Perceived control, effort, and academic performance: Interindividual, intraindividual, and multivariate time-series analyses. , 1993 .

[22]  Robert J. DeRubeis,et al.  Reliability and validity of a daily diary for premenstrual syndrome , 1996, Psychiatry Research.

[23]  J. Russell.  Affective space is bipolar. , 1979 .

[24]  Janet B W Williams,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[25]  Dc Washington.  Diagnostic and Statistical Manual of Mental Disorders, 4th Ed. , 1994 .

[26]  Guangjian Zhang,et al.  Bootstrap Standard Error Estimates in Dynamic Factor Analysis , 2010, Multivariate behavioral research.

[27]  H. Wittchen,et al.  Prevalence, incidence and stability of premenstrual dysphoric disorder in the community , 2002, Psychological Medicine.

[28]  H. White.  Maximum Likelihood Estimation of Misspecified Models , 1982 .

[29]  Jorge Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[30]  James D. Hamilton.  A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle , 1989 .

[31]  B. Dean,et al.  Evaluating the criteria used for identification of PMS. , 2006, Journal of women's health.

[32]  E. Hamaker,et al.  Investigating inter-individual differences in short-term intra-individual variability. , 2012, Psychological methods.

[33]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[34]  Theodore A. Walls,et al.  Multilevel Autoregressive Modeling of Interindividual Differences in the Stability of a Process , 2006 .

[35]  M. Peruggia.  Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach (2nd ed.) , 2003 .

[36]  K. Newell,et al.  Individual pathways of change: Statistical models for analyzing learning and development. , 2010 .

[37]  Iven Van Mechelen,et al.  Posterior predictive checks: Principles and discussion , 2000, Comput. Stat..

[38]  Chang‐Jin Kim,et al.  Dynamic linear models with Markov-switching , 1994 .