A Note on the Use of Mixture Models for Individual Prediction

Mixture models capture heterogeneity in data by decomposing the population into latent subgroups, each of which is governed by its own subgroup-specific set of parameters. Despite the flexibility and widespread use of these models, most applications have focused solely on making inferences for whole or subpopulations, rather than individual cases. This article presents a general framework for computing marginal and conditional predicted values for individuals using mixture model results. These predicted values can be used to characterize covariate effects, examine the fit of the model for specific individuals, or forecast future observations from previous ones. Two empirical examples are provided to demonstrate the usefulness of individual predicted values in applications of mixture models. The first example examines the relative timing of initiation of substance use using a multiple event process survival mixture model, whereas the second example evaluates changes in depressive symptoms over adolescence using a growth mixture model.

[1]  B. Muthén,et al.  Structural Equation Models and Mixture Models With Continuous Nonnormal Skewed Distributions , 2016 .

[2]  K. Sijtsma,et al.  Detecting and Explaining Aberrant Responding to the Outcome Questionnaire–45 , 2015, Assessment.

[3]  Bethany E. Kok,et al.  Visualizing Confidence Bands for Semiparametrically Estimated Nonlinear Relations Among Latent Variables , 2015 .

[4]  Daniel J. Bauer,et al.  Delineating prototypical patterns of substance use initiations over time. , 2015, Addiction.

[5]  Holger Brandt,et al.  A Nonlinear Structural Equation Mixture Modeling Approach for Nonnormally Distributed Latent Predictor Variables , 2014 .

[6]  Daniel J. Bauer,et al.  Predictions of Individual Change Recovered With Latent Class or Random Coefficient Growth Models , 2014 .

[7]  Daniel J Bauer,et al.  A discrete-time Multiple Event Process Survival Mixture (MEPSUM) model. , 2014, Psychological methods.

[8]  Nisha C. Gottfredson,et al.  Using a shared parameter mixture model to estimate change during treatment when termination is related to recovery speed. , 2014, Journal of consulting and clinical psychology.

[9]  Sarah Depaoli,et al.  Mixture class recovery in GMM under varying degrees of class separation: frequentist versus Bayesian estimation. , 2013, Psychological methods.

[10]  Stephanie T. Lanza,et al.  Latent Class Analysis With Distal Outcomes: A Flexible Model-Based Approach , 2013, Structural equation modeling : a multidisciplinary journal.

[11]  Nisha C. Gottfredson,et al.  Diagnostic Procedures for Detecting Nonlinear Relationships Between Latent Variables , 2012 .

[12]  Katherine E. Masyn,et al.  Not Quite Normal: Consequences of Violating the Assumption of Normality in Regression Mixture Models , 2012, Structural equation modeling : a multidisciplinary journal.

[13]  Kristopher J Preacher,et al.  Advantages of Monte Carlo Confidence Intervals for Indirect Effects , 2012 .

[14]  Daniel J. Bauer,et al.  Modeling complex interactions: Person–centered and variable–centered approaches , 2012 .

[15]  Daniel J. Bauer,et al.  Confidence Intervals for a Semiparametric Approach to Modeling Nonlinear Relations among Latent Variables , 2011 .

[16]  Christophe Maïano,et al.  General Growth Mixture Analysis of Adolescents' Developmental Trajectories of Anxiety: The Impact of Untested Invariance Assumptions on Substantive Interpretations , 2011 .

[17]  Jeroen K. Vermunt,et al.  Latent Class Modeling with Covariates: Two Improved Three-Step Approaches , 2010, Political Analysis.

[18]  Daniel J Bauer,et al.  Matching method with theory in person-oriented developmental psychopathology research , 2010, Development and Psychopathology.

[19]  Stephen J Tueller,et al.  Evaluation of Structural Equation Mixture Models: Parameter Estimates and Correct Class Assignment , 2010, Structural equation modeling : a multidisciplinary journal.

[20]  G. Bonanno,et al.  Psychopathology and resilience following traumatic injury: a latent growth mixture model analysis. , 2010, Rehabilitation psychology.

[21]  A. Team Mental Health of College Students and Their Non-College-Attending Peers: Results From the National Epidemiologic Study on Alcohol and Related Conditions , 2010 .

[22]  Nilam Ram,et al.  Methods and Measures: Growth mixture modeling: A method for identifying differences in longitudinal change among unobserved groups , 2009, International journal of behavioral development.

[23]  S. Rabe-Hesketh,et al.  Prediction in multilevel generalized linear models , 2009 .

[24]  M. Olfson,et al.  Mental health of college students and their non-college-attending peers: results from the National Epidemiologic Study on Alcohol and Related Conditions. , 2008, Archives of general psychiatry.

[25]  Carol M Woods,et al.  Detection of Aberrant Responding on a Personality Scale in a Military Sample: an Application of Evaluating Person Fit with Two-level Logistic Regression Two-level Logistic Regression for Person Fit the Person Response Function , 2022 .

[26]  Erik Meijer,et al.  Resampling Multilevel Models , 2008 .

[27]  Thomas H. Ollendick,et al.  COMPARING PERSONAL TRAJECTORIES AND DRAWING CAUSAL INFERENCES FROM LONGITUDINAL DATA , 2008 .

[28]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[29]  S. McCabe,et al.  Adolescents' Motivations to Abuse Prescription Medications , 2006, Pediatrics.

[30]  Daniel J. Bauer,et al.  Computational Tools for Probing Interactions in Multiple Linear Regression, Multilevel Modeling, and Latent Curve Analysis , 2006 .

[31]  J. Hoeksma,et al.  On growth curves and mixture models , 2006 .

[32]  Erika Hoff,et al.  Person-Centered and Variable-Centered Approaches to Longitudinal Data , 2006 .

[33]  N. Volkow,et al.  Abuse of prescription drugs and the risk of addiction. , 2006, Drug and alcohol dependence.

[34]  C. Anderson‐Cook,et al.  Group-Based Modeling of Development , 2006 .

[35]  Milorad S. Kovacevic Bootstrapping For Variance Estimation in Multi-Level Models Fitted To Survey Data , 2006 .

[36]  Richard E. Tremblay,et al.  DEVELOPMENTAL TRAJECTORY GROUPS: FACT OR A USEFUL STATISTICAL FICTION?* , 2005 .

[37]  Karen Bandeen-Roche,et al.  Residual Diagnostics for Growth Mixture Models , 2005 .

[38]  Jianguo Sun,et al.  Maximum Likelihood Estimation in a Semiparametric Logistic/Proportional‐Hazards Mixture Model , 2005 .

[39]  M. Windle,et al.  Assessing Covariates of Adolescent Delinquency Trajectories: A Latent Growth Mixture Modeling Approach , 2004 .

[40]  Daniel J Bauer,et al.  Testing main effects and interactions in latent curve analysis. , 2004, Psychological methods.

[41]  Karen Bandeen-Roche,et al.  Building an identifiable latent class model with covariate effects on underlying and measured variables , 2004 .

[42]  Daniel J Bauer,et al.  The integration of continuous and discrete latent variable models: potential problems and promising opportunities. , 2004, Psychological methods.

[43]  Marcel Croon,et al.  Estimating Latent Structure Models with Categorical Variables: One-Step Versus Three-Step Estimators , 2004, Political Analysis.

[44]  Daniel J Bauer,et al.  Distributional assumptions of growth mixture models: implications for overextraction of latent trajectory classes. , 2003, Psychological methods.

[45]  J. de Leeuw,et al.  Prediction in Multilevel Models , 2005 .

[46]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.

[47]  D. Kandel Stages and Pathways of Drug Involvement: Examining The Gateway Hypothesis , 2002 .

[48]  H. White,et al.  Stages and Pathways of Drug Involvement: Drug Sequences, Age of Onset, and Use Trajectories as Predictors of Drug Abuse/Dependence in Young Adulthood , 2002 .

[49]  Petter Laake,et al.  Regression among factor scores , 2001 .

[50]  J W Grice,et al.  Computing and Evaluating Factor Scores , 2004 .

[51]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[52]  S. Reise,et al.  Using Multilevel Logistic Regression to Evaluate Person-Fit in IRT Models , 2000, Multivariate behavioral research.

[53]  B. Muthén,et al.  Integrating person-centered and variable-centered analyses: growth mixture modeling with latent trajectory classes. , 2000, Alcoholism, clinical and experimental research.

[54]  B. Muthén,et al.  Finite Mixture Modeling with Mixture Outcomes Using the EM Algorithm , 1999, Biometrics.

[55]  Daniel S. Nagin,et al.  Analyzing developmental trajectories: A semiparametric, group-based approach , 1999 .

[56]  Anthony C. Davison,et al.  Bootstrap Methods and Their Application , 1998 .

[57]  L R Bergman,et al.  A person-oriented approach in research on developmental psychopathology , 1997, Development and Psychopathology.

[58]  Ke-Hai Yuan,et al.  Mean and Covariance Structure Analysis: Theoretical and Practical Improvements , 1997 .

[59]  J. Gfroerer,et al.  Substance use in the US college-age population: differences according to educational status and living arrangement. , 1997, American journal of public health.

[60]  P. Bentler,et al.  Bootstrapping Techniques in Analysis of Mean and Covariance Structures , 1996 .

[61]  Clifford C. Clogg,et al.  Handbook of statistical modeling for the social and behavioral sciences , 1995 .

[62]  G. Arminger,et al.  Specification and Estimation of Mean- and Covariance-Structure Models , 1995 .

[63]  Scott R. Eliason Maximum likelihood estimation: Logic and practice. , 1994 .

[64]  Bani K. Mallick,et al.  Generalized linear models with unknown link functions , 1994 .

[65]  A. Satorra,et al.  Corrections to test statistics and standard errors in covariance structure analysis. , 1994 .

[66]  L. Leemis Applied Linear Regression Models , 1991 .

[67]  Albert Satorra,et al.  Robustness issues in structural equation modeling: a review of recent developments , 1990 .

[68]  William Meredith,et al.  Latent curve analysis , 1990 .

[69]  Ronald Schoenberg,et al.  Pseudo maximum likelihood estimation and a test for misspecification in mean and covariance structure models , 1989 .

[70]  A. F. Smith,et al.  Statistical analysis of finite mixture distributions , 1986 .

[71]  J. Neter,et al.  Applied Linear Regression Models , 1983 .

[72]  T. Louis Finding the Observed Information Matrix When Using the EM Algorithm , 1982 .

[73]  H. White Maximum Likelihood Estimation of Misspecified Models , 1982 .

[74]  R. D. Bock,et al.  Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm , 1981 .

[75]  F. Krauss Latent Structure Analysis , 1980 .

[76]  J. Whitley,et al.  Mental health of college students. , 1979, Journal of the American College Health Association.

[77]  B. Efron,et al.  Assessing the accuracy of the maximum likelihood estimator: Observed versus expected Fisher information , 1978 .

[78]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[79]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[80]  D. Lindley,et al.  Bayes Estimates for the Linear Model , 1972 .

[81]  Ledyard R Tucker,et al.  Relations of factor score estimates to their use , 1970 .

[82]  H. Darvish,et al.  The long-term outcome for adolescent drug users: a follow-up study of 76 users and 146 nonusers. , 1970, Proceedings of the annual meeting of the American Psychopathological Association.

[83]  Neil Henry Latent structure analysis , 1969 .

[84]  P. J. Huber The behavior of maximum likelihood estimates under nonstandard conditions , 1967 .

[85]  W. Gibson Three multivariate models: Factor analysis, latent structure analysis, and latent profile analysis , 1959 .

[86]  Shauna J. Sweet,et al.  Structural Equation Modeling: A Multidisciplinary Journal , 2022 .