Multiscale Measurement of Extreme Response Style

This article extends a methodological approach considered by Bolt and Johnson for the measurement and control of extreme response style (ERS) to the analysis of rating data from multiple scales. Specifically, it is shown how the simultaneous analysis of item responses across scales allows for more accurate identification of ERS, and more effective control of ERS effects on the substantive trait estimates, than when analyzing just one scale. Moreover, unlike a competing approach presented by Greenleaf, the current strategy can accommodate conditions in which the substantive traits across scales correlate, as is almost always the case in social sciences research. Simulation and real data analyses are used for illustration.

[1]  Harry C. Triandis,et al.  Effects of Culture and Response Format on Extreme Response Style , 1989 .

[2]  Valerie F. Reyna,et al.  Random Intercept Item Factor Analysis , 2006 .

[3]  Jay Magidson,et al.  LG-Syntax user's guide: Manual for Latent GOLD 4.5 Syntax module , 2008 .

[4]  G. Moors.  Diagnosing Response Style Behavior by Means of a Latent-Class Factor Approach. Socio-Demographic Correlates of Gender Role Attitudes and Perceptions of Ethnic Discrimination Reexamined , 2003 .

[5]  Patrick M. O'Malley,et al.  Yea-Saying, Nay-Saying, and Going to Extremes: Black-White Differences in Response Styles , 1984 .

[6]  Hans Baumgartner,et al.  Response Styles in Marketing Research: A Cross-National Investigation , 2001 .

[7]  Peter E. Rossi,et al.  Overcoming Scale Usage Heterogeneity , 2001 .

[8]  L. Cronbach.  Response Sets and Test Validity , 1946 .

[9]  Daniel M. Bolt,et al.  Addressing Score Bias and Differential Item Functioning Due to Individual Differences in Response Style , 2009 .

[10]  M. Geuens,et al.  The stability of individual response styles. , 2008, Psychological methods.

[11]  R. Darrell Bock,et al.  Estimating item parameters and latent ability when responses are scored in two or more nominal categories , 1972 .

[12]  Annette M. Maij-de Meij,et al.  Fitting a Mixture Item Response Theory Model to Personality Questionnaire Data: Characterizing Latent Classes and Investigating Possibilities for Improving Prediction , 2008 .

[13]  G. Moors.  Facts and Artefacts in the Comparison of Attitudes Among Ethnic Minorities. A Multigroup Latent Class Structure Model with Adjustment for Response Style Behavior , 2004 .

[14]  Patrick J.F. Groenen,et al.  Identifying Response Styles: A Latent-Class Bilinear Multinomial Logit Model , 2010 .

[15]  G. Marín,et al.  Extreme Response Style and Acquiescence among Hispanics , 1992 .

[16]  Daniel M. Bolt,et al.  On the Use of Factor-Analytic Multinomial Logit Item Response Models to Account for Individual Differences in Response Style , 2010 .

[17]  G. Masters.  A rasch model for partial credit scoring , 1982 .

[18]  J. Rost,et al.  Applications of Latent Trait and Latent Class Models in the Social Sciences , 1998 .

[19]  I. A. Berg,et al.  Personality and Group Differences in Extreme Response Sets , 1953 .

[20]  N. Lewis,et al.  Anxiety and Extreme Response Preferences , 1955 .

[21]  J. Buckley.  Cross-National Response Styles in International Educational Assessments: Evidence from PISA 2006 , 2009 .

[22]  Timothy R. Johnson,et al.  On the use of heterogeneous thresholds ordinal regression models to account for individual differences in response style , 2003 .

[23]  Jean-Paul Fox,et al.  Using Item Response Theory to Measure Extreme Response Style in Marketing Research: A Global Investigation , 2008 .

[24]  E. Greenleaf,et al.  MEASURING EXTREME RESPONSE STYLE , 1992 .

[25]  E. Greenleaf.  Improving Rating Scale Measures by Detecting and Correcting Bias Components in Some Response Styles , 1992 .