Testing measurement invariance across groups: applications in cross-cultural research.

Researchers often compare groups of individuals on psychological variables. When comparing groups an assumption is made that the instrument measures the same psychological construct in all groups. If this assumption holds, the comparisons are valid and differences/similarities between groups can be meaningfully interpreted. If this assumption does not hold, comparisons and interpretations are not fully meaningful. The establishment of measurement invariance is a prerequisite for meaningful comparisons across groups. This paper first reviews the importance of equivalence in psychological research, and then the main theoretical and methodological issues regarding measurement invariance within the framework of confirmatory factor analysis. A step-by-step empirical example of measurement invariance testing is provided along with syntax examples for fitting such models in LISREL

[1]  P. Bentler,et al.  Evaluating model fit. , 1995 .

[2]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[3]  Robert C. MacCallum,et al.  Model specification: Procedures, strategies, and related issues. , 1995 .

[4]  Gordon W. Cheung,et al.  Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance , 2002 .

[5]  F. Vijver,et al.  Cambridge Handbook of Culture, Organizations, and Work: Improving methodological robustness in cross-cultural organizational research , 2009 .

[6]  R. Brislin.  Cross-cultural research methods , 1973 .

[7]  Noel A. Card,et al.  Latent variable structural equation modeling in cross-cultural research: Multigroup and multilevel approaches , 2008 .

[8]  James C. Anderson,et al.  STRUCTURAL EQUATION MODELING IN PRACTICE: A REVIEW AND RECOMMENDED TWO-STEP APPROACH , 1988 .

[9]  Y. Poortinga,et al.  Cross-Cultural Generalization and Universality , 1982 .

[10]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[11]  F.J.R. van de Vijver,et al.  Methods and Data Analysis for Cross-Cultural Research , 1997 .

[12]  R. P. McDonald,et al.  Structural Equations with Latent Variables , 1989 .

[13]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[14]  G. Bohrnstedt,et al.  Social Measurement: Current Issues , 1981 .

[15]  J. H. Steiger.  Statistically based tests for the number of common factors , 1980 .

[16]  Fang Fang Chen,et al.  What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research. , 2008, Journal of personality and social psychology.

[17]  B. Byrne.  Structural Equation Modeling with LISREL, PRELIS, and SIMPLIS: Basic Concepts, Applications, and Programming , 1998 .

[18]  Gordon W. Cheung,et al.  Assessing Extreme and Acquiescence Response Sets in Cross-Cultural Research Using Structural Equations Modeling , 2000 .

[19]  D. Kaplan.  Structural Equation Modeling: Foundations and Extensions , 2000 .

[20]  T. Little.  Mean and Covariance Structures (MACS) Analyses of Cross-Cultural Data: Practical and Theoretical Issues. , 1997, Multivariate behavioral research.

[21]  H. Marsh.  Confirmatory factor analysis models of factorial invariance: A multifaceted approach , 1994 .

[22]  Paul R. Yarnold,et al.  Reading and understanding MORE multivariate statistics. , 2000 .

[23]  L. Cameron,et al.  A Cross-Cultural Study of Environmental Motive Concerns and Their Implications for Proenvironmental Behavior , 2006 .

[24]  Sharon Glazer,et al.  Individualism-collectivism as Descriptive Norms , 2009 .

[25]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[26]  E. Carmines,et al.  Analyzing models with unobserved variables: analysis of covariance structures , 1981 .

[27]  Bengt Muthén,et al.  Testing for the Equivalence of Factor Covariance and Mean Structures : The Issue of Partial Measurement In variance , 1989 .

[28]  R. MacCallum,et al.  Power analysis and determination of sample size for covariance structure modeling. , 1996 .

[29]  Karl G. Jöreskog,et al.  Lisrel 8: Structural Equation Modeling With the Simplis Command Language , 1993 .

[30]  R. Vandenberg,et al.  A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research , 2000 .

[31]  B. Muthén,et al.  Assessing Reliability and Stability in Panel Models , 1977 .

[32]  F. V. D. van de Vijver,et al.  Methodological Issues in Psychological Research on Culture , 2000 .

[33]  Micah Altman,et al.  Encyclopedia of Social Measurement , 2004 .

[34]  Gordon W. Cheung,et al.  Testing Factorial Invariance across Groups: A Reconceptualization and Proposed New Method , 1999 .

[35]  B. Thompson.  Ten commandments of structural equation modeling. , 2000 .

[36]  H. Akaike.  Factor analysis and AIC , 1987 .

[37]  J. Steenkamp,et al.  Assessing Measurement Invariance in Cross-National Consumer Research , 1998 .

[38]  R. Hoyle.  Structural equation modeling: concepts, issues, and applications , 1997 .

[39]  K. G. J8reskoC,et al.  Simultaneous Factor Analysis in Several Populations , 2007 .

[40]  T. Milfont,et al.  The Higher Order Structure of Environmental Attitudes: A Cross-Cultural Examination , 2010 .

[41]  B. Byrne,et al.  Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. , 1989 .

[42]  R. P. McDonald,et al.  An index of goodness-of-fit based on noncentrality , 1989 .

[43]  M. Browne,et al.  Single Sample Cross-Validation Indices for Covariance Structures. , 1989, Multivariate behavioral research.

[44]  T. Milfont,et al.  Life Satisfaction in Brazil: Testing the Psychometric Properties of the Satisfaction With Life Scale (SWLS) in Five Brazilian Samples , 2008 .

[45]  H. Bozdogan.  Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions , 1987 .

[46]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[47]  Donald E. Brown.  Cross-cultural psychology: Research and applications , 1996 .

[48]  S. Mulaik,et al.  EVALUATION OF GOODNESS-OF-FIT INDICES FOR STRUCTURAL EQUATION MODELS , 1989 .