Testing Measurement Invariance for a Second-Order Factor. A Cross-National Test of the Alienation Scale

Multiple group confirmatory factor analysis has become the most common technique for assessing measurement invariance. However, higher-order factor modeling is less frequently discussed in this context. In particular, the literature provides only very general guidelines for testing measurement invariance of second-order factor models, which is a prerequisite for conducting meaningful comparative research using higher-order factors. The current paper attempts to fill this gap. First, we explicate the constraints required for identification of the invariance levels in a multiple group second-order factor model. Second, in addition to the conventional interpretation of the results of this assessment, we suggest an alternative view on the invariance properties of a second-order factor as evidence of structural rather than measurement invariance. Third, we present an empirical application of the test which builds on Seeman’s alienation scale and utilizes data from eight countries collected in 2008-2009. We found empirical support for metric invariance of both the firstand second-order factors, but no support for scalar invariance of the first- and second-order factors. However, we find pairs of countries where scalar invariance for both the first- and second-order factors is supported by the data. We finalize with a discussion of the results and their interpretation.

[1]  Holger Steinmetz,et al.  Estimation and Comparison of Latent Means Across Cultures , 2018 .

[2]  S. Shalom,et al.  Testing the invariance of values in the Benelux countries with the European Social Survey: Accounting for ordinality and non-normality of the data , 2018 .

[3]  Gilbert Swinnen,et al.  Biased latent variable mean comparisons due to measurement noninvariance. A simulation study , 2018 .

[4]  Myeongsun Yoon,et al.  Two-Step Approach to Partial Factorial Invariance: Selecting a Reference Variable and Identifying the Source of Noninvariance , 2017 .

[5]  Hao Wu,et al.  Identification of Confirmatory Factor Analysis Models of Different Levels of Invariance for Ordered Categorical Outcomes , 2016, Psychometrika.

[6]  Bengt Muthén,et al.  Multiple-Group Factor Analysis Alignment , 2014 .

[7]  P. Schmidt,et al.  Measurement Equivalence in Cross-National Research , 2014 .

[8]  S. Schwartz,et al.  A Hierarchical Structure of Basic Human Values in a Third-Order Confirmatory Factor Analysis , 2014 .

[9]  Lars Tummers,et al.  Facing off with Scylla and Charybdis: a comparison of scalar, partial, and the novel possibility of approximate measurement invariance , 2013, Front. Psychol..

[10]  Eldad Davidov,et al.  Refining the theory of basic individual values. , 2012, Journal of personality and social psychology.

[11]  J. Hox,et al.  A checklist for testing measurement invariance , 2012 .

[12]  A. Zick,et al.  Social Status and Anti-Immigrant Attitudes in Europe: An Examination from the Perspective of Social Dominance Theory , 2010 .

[13]  Dimiter M. Dimitrov,et al.  Testing for Factorial Invariance in the Context of Construct Validation , 2010 .

[14]  Emily C. Johnson,et al.  The Role of Referent Indicators in Tests of Measurement Invariance , 2009 .

[15]  Holger Steinmetz,et al.  Testing measurement invariance using multigroup CFA: differences between educational groups in human values measurement , 2009 .

[16]  F. Chen.  Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance , 2007 .

[17]  J. Berge,et al.  Tucker's congruence coefficient as a meaningful index of factor similarity. , 2006 .

[18]  S. West,et al.  A Comparison of Bifactor and Second-Order Models of Quality of Life , 2006, Multivariate behavioral research.

[19]  Denis Huschka,et al.  Social Anomie and Racial Segregation in South Africa , 2006 .

[20]  Todd D. Little,et al.  A Non-arbitrary Method of Identifying and Scaling Latent Variables in SEM and MACS Models , 2006 .

[21]  S. West,et al.  Teacher's Corner: Testing Measurement Invariance of Second-Order Factor Models , 2005 .

[22]  Roger E. Millsap,et al.  Assessing Factorial Invariance in Ordered-Categorical Measures , 2004 .

[23]  H. Marsh,et al.  In Search of Golden Rules: Comment on Hypothesis-Testing Approaches to Setting Cutoff Values for Fit Indexes and Dangers in Overgeneralizing Hu and Bentler's (1999) Findings , 2004 .

[24]  Gordon W. Cheung,et al.  Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance , 2002 .

[25]  J. Vantassel-Baska.  Book Review: The g-factor, the science of mental ability , 2001 .

[26]  R. Vandenberg,et al.  A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research , 2000 .

[27]  W. Meredith.  Measurement invariance, factor analysis and factorial invariance , 1993 .

[28]  S. Schwartz,et al.  Toward a theory of the universal content and structure of values: Extensions and cross-cultural replications. , 1990 .

[29]  B. Byrne,et al.  Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. , 1989 .

[30]  D. Krebs,et al.  Life feeling scales for use in German and American samples , 1989 .

[31]  H. Triandis,et al.  Measurement in Cross-Cultural Psychology , 1985 .

[32]  M. Seeman.  Alienation motifs in contemporary theorizing: The hidden continuity of the classic themes. , 1983 .

[33]  John P. Robinson,et al.  Measures of social psychological attitudes , 1976 .

[34]  H. Costner.  Theory, Deduction, and Rules of Correspondence , 1969, American Journal of Sociology.

[35]  H MCCLOSKY,et al.  PSYCHOLOGICAL DIMENSIONS OF ANOMY. , 1965, American sociological review.

[36]  Arthur G. Neal,et al.  Organizations and Powerlessness: A Test of the Mediation Hypothesis , 1964 .

[37]  R. Middleton.  Alienation, Race, and Education , 1963 .

[38]  D. Dean.  Alienation: Its meaning and measurement. , 1961 .

[39]  M. Seeman.  On The Meaning of Alienation , 1959 .

[40]  Leslie Kish,et al.  A Procedure for Objective Respondent Selection within the Household , 1949 .

[41]  Monika Richter,et al.  Methods And Data Analysis For Cross Cultural Research , 2016 .

[42]  T. Brown.  Confirmatory factor analysis for applied research, 2nd ed. , 2015 .

[43]  S. West,et al.  Model fit and model selection in structural equation modeling. , 2012 .

[44]  A. Zick,et al.  Intolerance, Prejudice and Discrimination - A European Report , 2011 .

[45]  Arien Strasheim.  Testing the invariance of second-order confirmatory factor analysis models that include means and intercepts , 2011 .

[46]  Eldad Davidov,et al.  Cross cultural analysis: Methods and applications , 2010 .

[47]  K. G. J8reskoC,et al.  Simultaneous Factor Analysis in Several Populations , 2007 .

[48]  Comparison Levine,et al.  Quantitative Applications in the Social Sciences , 2006 .

[49]  D. Borsboom,et al.  The Theoretical Status of Latent Variables , 2003 .

[50]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[51]  S. Srivastava,et al.  The Big Five Trait taxonomy: History, measurement, and theoretical perspectives. , 1999 .

[52]  David Thissen,et al.  On the relationship between the higher-order factor model and the hierarchical factor model , 1999 .

[53]  Catherine E. Ross,et al.  A new look at urban alienation : The effect of neighborhood disorder on perceived powerlessness , 1998 .

[54]  James L. Arbuckle,et al.  Full Information Estimation in the Presence of Incomplete Data , 1996 .

[55]  Paul T. Costa,et al.  Personality Disorders and the Five-Factor Model of Personality , 1994 .

[56]  J. Horn,et al.  A practical and theoretical guide to measurement invariance in aging research. , 1992, Experimental aging research.

[57]  D. Rindskopf,et al.  Some Theory and Applications of Confirmatory Second-Order Factor Analysis. , 1988, Multivariate behavioral research.

[58]  Steven Lukes,et al.  Alienation and Anomie , 1977 .

[59]  C. G. Hempel,et al.  The Meaning of Theoretical Terms: A Critique of the Standard Empiricist Construal , 1973 .