Multidimensional Modeling of Traits and Response Styles

Response styles can influence item responses in addition to a respondent’s latent trait level. A common concern is that comparisons between individuals based on sum scores may be rendered invalid by response style effects. This paper investigates a multidimensional approach to modeling traits and response styles simultaneously. Models incorporating different response styles as well as personality traits (Big Five facets) were compared regarding model fit. Relationships between traits and response styles were investigated and different approaches to modeling extreme response style (ERS) were compared regarding their effects on trait estimates. All multidimensional models showed a better fit than the unidimensional models, indicating that response styles influenced item responses with ERS showing the largest incremental variance explanation. ERS and midpoint response style were mainly trait-independent whereas acquiescence and disacquiescence were strongly related to several personality traits. Expected a posteriori estimates of participants’ trait levels did not differ substantially between two-dimensional and unidimensional models when a set of heterogeneous items was used to model ERS. A minor adjustment of trait estimates occurred when the same items were used to model ERS and the trait, though the ERS dimension in this approach only reflected scale-specific ERS, rather than a general ERS tendency.

[1]  Jürgen Rost,et al.  Rasch Models in Latent Classes: An Integration of Two Approaches to Item Analysis , 1990 .

[2]  Raymond J. Adams,et al.  The Multidimensional Random Coefficients Multinomial Logit Model , 1997 .

[3]  Michael Eid,et al.  Detecting Measurement Invariance in Organizational Surveys* * The original data upon which this paper is based are available at www.hhpub.com/journals/ejpa , 2000 .

[4]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[5]  Devendra Potnis,et al.  Culture's consequences: Economic barriers to owning mobile phones experienced by women in India , 2016, Telematics Informatics.

[6]  Mitsutoshi Okazaki,et al.  Revised NEO Personality Inventory(NEO-PI-R)を用いたてんかん患者におけるパーソナリティ傾向に関する検討 , 2018 .

[7]  G. Rasch On General Laws and the Meaning of Measurement in Psychology , 1961 .

[8]  Eunike Wetzel,et al.  Consistency of extreme response style and non-extreme response style across traits , 2013 .

[9]  Chockalingam Viswesvaran,et al.  Role of social desirability in personality testing for personnel selection: The red herring. , 1996 .

[10]  Young Ik Cho,et al.  The Relation Between Culture and Response Styles , 2005 .

[11]  G. Masters A rasch model for partial credit scoring , 1982 .

[12]  Murray R. Barrick,et al.  THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META-ANALYSIS , 1991 .

[13]  U. Böckenholt Modeling multiple response processes in judgment and choice. , 2012, Psychological methods.

[14]  G. Moors,et al.  Exploring the effect of a middle response category on response style in attitude measurement , 2007, Quality & quantity.

[15]  Ian J. Deary,et al.  Individual differences in response scale use: Mixed Rasch modelling of responses to NEO-FFI items , 2006 .

[16]  Daniel M. Bolt,et al.  Addressing Score Bias and Differential Item Functioning Due to Individual Differences in Response Style , 2009 .

[17]  M. Geuens,et al.  The stability of individual response styles. , 2008, Psychological methods.

[18]  B. Weijters,et al.  The effect of rating scale format on response styles: the number of response categories and response catgory labels , 2010 .

[19]  R. D. Bock,et al.  Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm , 1981 .

[20]  F. Ostendorf,et al.  NEO-Persönlichkeitsinventar nach Costa und McCrae: NEO-PI-R ; Manual , 2004 .

[21]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[22]  I. Zettler,et al.  The Stability of Extreme Response Style and Acquiescence Over 8 Years , 2016, Assessment.

[23]  H. Bozdogan Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions , 1987 .

[24]  E. Greenleaf,et al.  MEASURING EXTREME RESPONSE STYLE , 1992 .

[25]  R. D. Bock,et al.  Marginal maximum likelihood estimation of item parameters , 1982 .

[26]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[27]  N. Nagelkerke,et al.  A note on a general definition of the coefficient of determination , 1991 .

[28]  Troy Devon Thomas,et al.  Response Styles in Survey Research: A Literature Review of Antecedents, Consequences, and Remedies , 2013 .

[29]  Henk Kelderman,et al.  Multidimensional Rasch Models for Partial-Credit Scoring , 1996 .

[30]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[31]  Thorsten Meiser,et al.  Validity of Multiprocess IRT Models for Separating Content and Response Styles , 2014 .

[32]  Daniel M. Bolt,et al.  Multiscale Measurement of Extreme Response Style , 2011 .

[33]  B. Roberts,et al.  Personality and Longevity: Knowns, Unknowns, and Implications for Public Health and Personalized Medicine , 2011, Journal of aging research.

[34]  Hans Baumgartner,et al.  Response Styles in Marketing Research: A Cross-National Investigation , 2001 .