Unfolding IRT Models for Likert-Type Items With a Don’t Know Option

Attitude surveys are widely used in the social sciences. It has been argued that the underlying response process to attitude items may be more aligned with the ideal-point (unfolding) process than with the cumulative (dominance) process, and therefore, unfolding item response theory (IRT) models are more appropriate than dominance IRT models for these surveys. Missing data and don’t know (DK) responses are common in attitude surveys, and they may not be ignorable in the likelihood for parameter estimation. Existing unfolding IRT models often treat missing data or DK as missing at random. In this study, a new class of unfolding IRT models for nonignorable missing data and DK were developed, in which the missingness and DK were assumed to measure a hierarchy of latent traits, which may be correlated with the latent attitude that a test intended to measure. The Bayesian approach with Markov chain Monte Carlo methods was used to estimate the parameters of the new models. Simulation studies demonstrated that the parameters were recovered fairly well, and ignoring nonignorable missingness or DK resulted in poor parameter estimates. An empirical example of a religious belief scale about health was given.

[1]  R. Tourangeau,et al.  Sensitive questions in surveys. , 2007, Psychological bulletin.

[2]  Robert J. Mislevy,et al.  Posterior Predictive Model Checking for Multidimensionality in Item Response Theory , 2006 .

[3]  Pere J. Ferrando,et al.  FACTOR: A computer program to fit the exploratory factor analysis model , 2006, Behavior research methods.

[4]  Cornelis A.W. Glas,et al.  Modeling Nonignorable Missing Data in Speeded Tests , 2008 .

[5]  Willem J. Heiser,et al.  Computational Statistics and Data Analysis Two Types of Single-peaked Data: Correspondence Analysis as an Alternative to Principal Component Analysis , 2022 .

[6]  J. S. Roberts,et al.  GGUM2004: A Windows-Based Program to Estimate Parameters in the Generalized Graded Unfolding Model , 2006 .

[7]  J. S. Roberts,et al.  A Unidimensional Item Response Model for Unfolding Responses From a Graded Disagree-Agree Response Scale , 1996 .

[8]  Paul De Boeck,et al.  IRTrees: Tree-Based Item Response Models of the GLMM Family , 2012 .

[9]  W. Heiser,et al.  A Model-Free Diagnostic for Single-Peakedness of Item Responses Using Ordered Conditional Means , 2012, Multivariate behavioral research.

[10]  F. Drasgow,et al.  Theoretical, Statistical, and Substantive Issues in the Assessment of Construct Dimensionality , 2012 .

[11]  C. Y. Peng,et al.  Principled missing data methods for researchers , 2013, SpringerPlus.

[12]  R. Mason,et al.  Characteristics of Nonopinion and No Opinion Response Groups , 1978 .

[13]  Finis Welch,et al.  What Do We Really Know about Wages? The Importance of Nonreporting and Census Imputation , 1986, Journal of Political Economy.

[14]  The Random-Threshold Generalized Unfolding Model and Its Application of Computerized Adaptive Testing , 2013 .

[15]  J. S. Roberts,et al.  A General Item Response Theory Model for Unfolding Unidimensional Polytomous Responses , 2000 .

[16]  Martyn Plummer,et al.  JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling , 2003 .

[17]  Ravi Dhar,et al.  Coping with Ambivalence: The Effect of Removing a Neutral Option on Consumer Attitude and Preference Judgments , 2002 .

[18]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[19]  Guanzhong Luo,et al.  A Class of Probabilistic Unfolding Models for Polytomous Responses. , 2001, Journal of mathematical psychology.

[20]  Vasiliki Triga,et al.  'Neither agree, nor disagree': a critical analysis of the middle answer category in Voting Advice Applications , 2012 .

[21]  D. Rubin INFERENCE AND MISSING DATA , 1975 .

[22]  Patrick Sturgis,et al.  Middle Alternatives Revisited , 2010 .

[23]  C. Coombs,et al.  “Don't Know” Item Ambiguity or Respondent Uncertainty? , 1976 .

[24]  Roel Bosker,et al.  Comparing the difficulty of examination subjects with item response theory , 2008 .

[25]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[26]  Usama S. Ali,et al.  Fitting IRT Models to Dichotomous and Polytomous Data: Assessing the Relative Model–Data Fit of Ideal Point and Dominance Models , 2011 .

[27]  Tsung-Hau Jen,et al.  Partial Credit Model , 2016 .

[28]  Minjeong Jeon,et al.  A generalized item response tree model for psychological assessments , 2016, Behavior research methods.

[29]  Elizabeth A. Skewes,et al.  Item Nonresponse: Distinguishing between don't Know and Refuse , 2002 .

[30]  K. A. Hanisch The Job Descriptive Index revisited : questions about the question mark , 1992 .

[31]  Philip Heidelberger,et al.  Simulation Run Length Control in the Presence of an Initial Transient , 1983, Oper. Res..

[32]  J. Krosnick The Causes of No-Opinion Responses to Attitude Measures in Surveys: They Are Rarely What They Appear to Be , 2002 .

[33]  David J. Lunn,et al.  The BUGS Book: A Practical Introduction to Bayesian Analysis , 2013 .

[34]  Rebecca Holman,et al.  Modelling non-ignorable missing-data mechanisms with item response theory models. , 2005, The British journal of mathematical and statistical psychology.

[35]  J. Schafer Multiple imputation: a primer , 1999, Statistical methods in medical research.