A Mixture IRTree Model for Extreme Response Style: Accounting for Response Process Uncertainty

This paper presents a mixture item response tree (IRTree) model for extreme response style. Unlike traditional applications of single IRTree models, a mixture approach provides a way of representing the mixture of respondents following different underlying response processes (between individuals), as well as the uncertainty present at the individual level (within an individual). Simulation analyses reveal the potential of the mixture approach in identifying subgroups of respondents exhibiting response behavior reflective of different underlying response processes. Application to real data from the Students Like Learning Mathematics (SLM) scale of Trends in International Mathematics and Science Study (TIMSS) 2015 demonstrates the superior comparative fit of the mixture representation, as well as the consequences of applying the mixture on the estimation of content and response style traits. We argue that methodology applied to investigate response styles should attend to the inherent uncertainty of response style influence due to the likely influence of both response styles and the content trait on the selection of extreme response categories.

[1]  Stephanie C Payne,et al.  Personality predictors of extreme response style. , 2009, Journal of personality.

[2]  T. Baker,et al.  Using multidimensional item response theory to evaluate how response styles impact measurement. , 2019, The British journal of mathematical and statistical psychology.

[3]  Lale Khorramdel,et al.  Measuring Response Styles Across the Big Five: A Multiscale Extension of an Approach Using Multinomial Processing Trees , 2014, Multivariate behavioral research.

[4]  Thorsten Meiser,et al.  IRTree models with ordinal and multidimensional decision nodes for response styles and trait-based rating responses. , 2019, The British journal of mathematical and statistical psychology.

[5]  Ian J. Deary,et al.  Individual differences in response scale use: Mixed Rasch modelling of responses to NEO-FFI items , 2006 .

[6]  Jean-Paul Fox,et al.  Using Item Response Theory to Measure Extreme Response Style in Marketing Research: A Global Investigation , 2008 .

[7]  Amery D. Wu,et al.  Item Response Tree Models to Investigate Acquiescence and Extreme Response Styles in Likert-Type Rating Scales , 2019, Educational and psychological measurement.

[8]  D. Paulhus.  Measurement and control of response bias. , 1991 .

[9]  Lale Khorramdel,et al.  Combining mixture distribution and multidimensional IRTree models for the measurement of extreme response styles. , 2019, The British journal of mathematical and statistical psychology.

[10]  Martyn Plummer,et al.  JAGS Version 3.3.0 user manual , 2012 .

[11]  Paul De Boeck,et al.  IRTrees: Tree-Based Item Response Models of the GLMM Family , 2012 .

[12]  Chuansheng Chen,et al.  Response Style and Cross-Cultural Comparisons of Rating Scales Among East Asian and North American Students , 1995 .

[13]  Matthias von Davier,et al.  Polytomous Mixed Rasch Models , 1995 .

[14]  Ulf Böckenholt,et al.  Response style analysis with threshold and multi‐process IRT models: A review and tutorial , 2017, The British journal of mathematical and statistical psychology.

[15]  U. Böckenholt.  Modeling multiple response processes in judgment and choice. , 2012, Psychological methods.

[16]  Minjeong Jeon,et al.  A generalized item response tree model for psychological assessments , 2016, Behavior research methods.

[17]  Thorsten Meiser,et al.  Validity of Multiprocess IRT Models for Separating Content and Response Styles , 2014 .

[18]  Troy Devon Thomas,et al.  Response Styles in Survey Research: A Literature Review of Antecedents, Consequences, and Remedies , 2013 .

[19]  E. Greenleaf,et al.  MEASURING EXTREME RESPONSE STYLE , 1992 .

[20]  G. Meisenberg,et al.  Are acquiescent and extreme response styles related to low intelligence and education , 2008 .

[21]  M. Jeon,et al.  General mixture item response models with different item response structures: Exposition with an application to Likert scales , 2018, Behavior Research Methods.

[22]  Young Ik Cho,et al.  The Relation Between Culture and Response Styles , 2005 .