Multimethod latent class analysis

Correct and, hence, valid classifications of individuals are of high importance in the social sciences as these classifications are the basis for diagnoses and/or the assignment to a treatment. The via regia to inspect the validity of psychological ratings is the multitrait-multimethod (MTMM) approach. First, a latent variable model for the analysis of rater agreement (latent rater agreement model) will be presented that allows for the analysis of convergent validity between different measurement approaches (e.g., raters). Models of rater agreement are transferred to the level of latent variables. Second, the latent rater agreement model will be extended to a more informative MTMM latent class model. This model allows for estimating (i) the convergence of ratings, (ii) method biases in terms of differential latent distributions of raters and differential associations of categorizations within raters (specific rater bias), and (iii) the distinguishability of categories indicating if categories are satisfyingly distinct from each other. Finally, an empirical application is presented to exemplify the interpretation of the MTMM latent class model.

[1]  L. A. Goodman Exploratory latent structure analysis using both identifiable and unidentifiable models , 1974 .

[2]  Alan Agresti,et al.  Categorical Data Analysis , 2003 .

[3]  R. Zwick,et al.  Another look at interrater agreement. , 1988, Psychological bulletin.

[4]  C. Clogg,et al.  Discrete Latent Variable Models. , 1994 .

[5]  Jeroen K. Vermunt,et al.  LEM: A general program for the analysis of categorical data. Users manual , 1997 .

[6]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[7]  A. Formann Linear Logistic Latent Class Analysis for Polytomous Data , 1992 .

[8]  Jeroen K. Vermunt,et al.  AVOIDING BOUNDARY ESTIMATES IN LATENT CLASS ANALYSIS BY BAYESIAN POSTERIOR MODE ESTIMATION , 2006 .

[9]  C. Schuster,et al.  Estimating with a Latent Class Model the Reliability of Nominal Judgments Upon Which Two Raters Agree , 2006 .

[10]  E. Maris Estimating multiple classification latent class models , 1999 .

[11]  Sophia Rabe-Hesketh,et al.  Structural Equation Models , 2005 .

[12]  L. A. Goodman The Analysis of Systems of Qualitative Variables When Some of the Variables Are Unobservable. Part I-A Modified Latent Structure Approach , 1974, American Journal of Sociology.

[13]  D. Hibbs On analyzing the effects of policy interventions : Box-Jenkins and Box-Tiao vs. structural equation models , 1977 .

[14]  Fridtjof W. Nussbeck Assessing Multimethod Association with Categorical Variables , 2006 .

[15]  A Agresti,et al.  Modelling patterns of agreement and disagreement , 1992, Statistical methods in medical research.

[16]  J. Vermunt,et al.  Causal log-linear modeling with latent variables and missing data , 1996 .

[17]  Jeroen K. Vermunt,et al.  Testing log-linear models with inequality constraints : A comparison of asymptotic, bootstrap, and posterior predictive P values , 2005 .

[18]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[19]  Michael Eid,et al.  Structural Equation Models for Multitrait-Multimethod Data , 2006 .

[20]  D. Funder On the accuracy of personality judgment: a realistic approach. , 1995, Psychological review.

[21]  T. Wickens Elementary Signal Detection Theory , 2001 .

[22]  J. Vermunt Mixed-Effects Logistic Regression Models for Indirectly Observed Discrete Outcome Variables , 2005, Multivariate behavioral research.

[23]  S. Haberman Analysis of qualitative data , 1978 .

[24]  J. Vermunt,et al.  Tilburg University Mixed-effects logistic regression models for indirectly observed outcome variables , 2004 .

[25]  T. Ferguson A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[26]  Jeroen K. Vermunt,et al.  7. Multilevel Latent Class Models , 2003 .

[27]  J. Hagenaars Loglinear Models with Latent Variables , 1993 .

[28]  Andrew Thomas,et al.  WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility , 2000, Stat. Comput..

[29]  J. Vermunt,et al.  Latent class and finite mixture models for multilevel data sets , 2008, Statistical methods in medical research.

[30]  S. Haynes,et al.  Clinical Psychology: Construct Validation With Multiple Sources of Information and Multiple Settings. , 2006 .

[31]  Jacques A. Hagenaars,et al.  Categorical Longitudinal Data: Log-Linear Panel, Trend, and Cohort Analysis , 1990 .