Dealing with Extreme Response Style in Cross-Cultural Research: A Restricted Latent Class Factor Analysis Approach

Cross-cultural comparison of attitudes using rating scales may be seriously biased by response styles. This paper deals with statistical methods for detection of and correction for extreme response style (ERS), which is one of the well-documented response styles. After providing an overview of available statistical methods for dealing with ERS, we argue that the latent class factor analysis (LCFA) approach proposed by Moors (2003) has several advantages compared to other methods. Moors' method involves defining a latent variable model which, in addition to the substantive factors of interest, contains an ERS factor. In LCFA the observed ratings can be treated as nominal responses, which is necessary for modeling ERS. We find strong evidence for the presence of ERS and, moreover, find that the groups differ not only in their attitudes but also in ERS. These findings underscore the importance of controlling for ERS when examining attitudes in cross-cultural research.

[1]  R. Darrell Bock,et al.  Estimating item parameters and latent ability when responses are scored in two or more nominal categories , 1972 .

[2]  Alan Agresti,et al.  Categorical Data Analysis , 2003 .

[3]  Norbert K Tanzer,et al.  Bias and equivalence , 2000 .

[4]  Stan Lipovetsky,et al.  Generalized Latent Variable Modeling: Multilevel,Longitudinal, and Structural Equation Models , 2005, Technometrics.

[5]  D. Hamilton,et al.  Personality attributes associated with extreme response style. , 1968, Psychological bulletin.

[6]  Delroy L. Paulhus,et al.  Social desirable responding: The evolution of a construct , 2002 .

[7]  D. Paulhus.  Measurement and control of response bias. , 1991 .

[8]  G. Moors.  Facts and Artefacts in the Comparison of Attitudes Among Ethnic Minorities. A Multigroup Latent Class Structure Model with Adjustment for Response Style Behavior , 2004 .

[9]  J. Turner.  Contemporary Sociological Theory , 2012 .

[10]  J. Krosnick,et al.  Survey research. , 1999, Annual review of psychology.

[11]  Young Ik Cho,et al.  The Relation Between Culture and Response Styles , 2005 .

[12]  Bert Weijters,et al.  Assessing response styles across modes of data collection , 2008 .

[13]  Willem E. Saris,et al.  Different Explanations for Correlated Disturbance Terms in MTMM Studies , 2003 .

[14]  G. Marín,et al.  Extreme Response Style and Acquiescence among Hispanics , 1992 .

[15]  Alison Wolf,et al.  Contemporary sociological theory , 1980 .

[16]  C. Murray,et al.  Enhancing the Validity and Cross-Cultural Comparability of Measurement in Survey Research , 2003, American Political Science Review.

[17]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[18]  Marise Ph. Born,et al.  The Role of Constructs in Psychological and Educational Measurement , 2002 .

[19]  Seymour Sudman,et al.  Response Effects in Surveys: A Review and Synthesis , 1974 .

[20]  John B. Campbell,et al.  Extreme Response Style in Cross-Cultural Research , 1974 .

[21]  Jaak Billiet,et al.  Modeling Acquiescence in Measurement Models for Two Balanced Sets of Items , 2000 .

[22]  Alison Wolf,et al.  Contemporary Sociological Theory: Expanding the Classical Tradition , 1986 .

[23]  G. Moors.  Diagnosing Response Style Behavior by Means of a Latent-Class Factor Approach. Socio-Demographic Correlates of Gender Role Attitudes and Perceptions of Ethnic Discrimination Reexamined , 2003 .

[24]  Patrick M. O'Malley,et al.  Yea-Saying, Nay-Saying, and Going to Extremes: Black-White Differences in Response Styles , 1984 .

[25]  Jennifer A Zellner,et al.  Effects of Language and Meaningfulness on the Use of Extreme Response Style by Spanish-English Bilinguals , 1999 .

[26]  Hans Baumgartner,et al.  Response Styles in Marketing Research: A Cross-National Investigation , 2001 .

[27]  B. Byrne,et al.  Multigroup Comparisons and the Assumption of Equivalent Construct Validity Across Groups: Methodological and Substantive Issues. , 1989, Multivariate behavioral research.

[28]  Harry C. Triandis,et al.  The Instability of Response Sets , 1985 .

[29]  J. Krosnick.  Response strategies for coping with the cognitive demands of attitude measures in surveys , 1991 .

[30]  Y. Poortinga,et al.  Response Styles in Rating Scales , 2004 .

[31]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[32]  Leo A. Goodman,et al.  Association models and the bivariate normal for contingency tables with ordered categories , 1981 .

[33]  Gordon W. Cheung,et al.  Assessing Extreme and Acquiescence Response Sets in Cross-Cultural Research Using Structural Equations Modeling , 2000 .

[34]  K. Jöreskog,et al.  Structural Equation Modeling with Ordinal Variables using LISREL , 2004 .

[35]  Norbert Schwarz,et al.  Response Effects in Surveys , 1987 .

[36]  F.J.R. van de Vijver,et al.  Methods and Data Analysis for Cross-Cultural Research , 1997 .

[37]  E. Diener,et al.  Comparing Typological Structures Across Cultures By Multigroup Latent Class Analysis , 2003 .

[38]  E. Greenleaf,et al.  MEASURING EXTREME RESPONSE STYLE , 1992 .

[39]  E. Greenleaf.  Improving Rating Scale Measures by Detecting and Correcting Bias Components in Some Response Styles , 1992 .

[40]  B. Byrne,et al.  Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. , 1989 .

[41]  David E. Wiley,et al.  Socially Desirable Responding: The Evolution of a Construct , 2001 .

[42]  Karl G. Jöreskog,et al.  On the estimation of polychoric correlations and their asymptotic covariance matrix , 1994 .

[43]  F. V. D. van de Vijver,et al.  Methodological Issues in Psychological Research on Culture , 2000 .

[44]  Irvine Clarke,et al.  Extreme response style in cross‐cultural research , 2001 .

[45]  Jay Magidson,et al.  LG-Syntax user's guide: Manual for Latent GOLD 4.5 Syntax module , 2008 .

[46]  Harry C. Triandis,et al.  Effects of Culture and Response Format on Extreme Response Style , 1989 .

[47]  L. Cronbach.  Further Evidence on Response Sets and Test Design , 1950 .

[48]  Bart Cambré,et al.  Adjustment for Acquiescence in the Assessment of the Construct Equivalence of Likert-Type Score Items , 2003 .

[49]  Richard Goldstein.  Latent Class and Discrete Latent Trait Models: Similarities and Differences , 1998 .

[50]  Jean-Paul Fox,et al.  Using Item Response Theory to Measure Extreme Response Style in Marketing Research: A Global Investigation , 2008 .

[51]  Fons J. R. Vijver.  Towards a theory of bias and equivalence , 1998 .

[52]  M. Gijsberts,et al.  Rapportage minderheden 2003 , 2003 .

[53]  Anne-Wil Harzing.  Response Styles in Cross-national Survey Research , 2006 .

[54]  Klaas Sijtsma,et al.  Introduction to Nonparametric Item Response Theory , 2002 .

[55]  G. Masters.  A rasch model for partial credit scoring , 1982 .

[56]  P. Deb.  Finite Mixture Models , 2008 .

[57]  W. Saris.  The effects of measurement error in cross cultural research , 1998 .

[58]  Timothy R. Johnson,et al.  On the use of heterogeneous thresholds ordinal regression models to account for individual differences in response style , 2003 .

[59]  Donald P. Green,et al.  Measurement Error and the Structure of Attitudes: Are Positive and Negative Judgments Opposites? , 1994 .

[60]  D. Peabody,et al.  Two components in bipolar scales: direction and extremeness. , 1962, Psychological review.

[61]  Jay Magidson,et al.  Latent Class Factor and Cluster Models, Bi-Plots, and Related Graphical Displays , 2001 .