A Quantitative Analysis of Rating-scale Response Variability

A quantitative analysis of 3,863 rating-scale standard deviations from 259 independent studies investigated relationships between rating-scale response variability and eleven different scale, study participant, methodological, and substantive factors. Statistically significant relationships were obtained for eight of the relationships investigated. In general, number of rating-scale categories, mode of scale administration (self or other), and gender tended to be the most important moderators of response variability. When college students were study participants, type of study (survey or experiment) moderated response variability.