How meaningful are data from Likert scales? An evaluation of how ratings are made and the role of the response shift in the socially disadvantaged

Likert scales relating to quality of life were completed by the homeless (N = 75); first year students (N = 301) and a town population (N = 72). Participants also completed free text questions. The scale and free text data were often contradictory and the results highlighted three processes to account for these disparities: i) frame of reference: current salient issues influenced how questions were interpreted; ii) within-subject comparisons: ratings were based on expectations given past experiences; iii) time frame: those with more stable circumstances showed habituation to their level of deprivation. Likert scale data should be understood within the context of how ratings are made.

[1]  C. Schwartz,et al.  Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift , 2004, Health and quality of life outcomes.

[2]  R. Garland.  The Mid-Point on a Rating Scale: Is it Desirable? , 1991 .

[3]  L. Festinger.  A Theory of Social Comparison Processes , 1954 .

[4]  D. R. Lehman,et al.  What's wrong with cross-cultural comparisons of subjective Likert scales?: The reference-group effect. , 2002, Journal of personality and social psychology.

[5]  G. Moors,et al.  Variations in response style behavior by response scale format in attitude research , 2010 .

[6]  Mark Kane,et al.  Chapter 17 – Analysing quantitative data , 2004 .

[7]  D. R. Lehman,et al.  Beyond Self-Presentation: Evidence for Self-Criticism among Japanese , 2000 .

[8]  Thomas E. Nelson,et al.  Stereotypes and Standards of Judgment , 1991 .

[9]  M. Mazis,et al.  Determinants of Scale Response: Label versus Position , 1978 .

[10]  M. Lorr,et al.  Manual for the Profile of Mood States , 1971 .

[11]  Patricia M. Greenfield,et al.  Culture as process: Empirical methods for cultural psychology. , 1997 .

[12]  A. Maslow.  A Theory of Human Motivation , 1943 .

[13]  Norman Blaikie,et al.  Analyzing Quantitative Data , 2012 .

[14]  Jacob Jacoby,et al.  Is there an optimal number of alternatives for Likert-scale items? Effects of testing time and scale properties. , 1972 .

[15]  L. Cohen,et al.  Research methods in education, 6th ed. , 2007 .

[16]  Harry C. Triandis,et al.  Effects of Culture and Response Format on Extreme Response Style , 1989 .

[17]  J. Jacoby,et al.  Is There an Optimal Number of Alternatives for Likert Scale Items? Study I: Reliability and Validity , 1971 .

[18]  Eli P. Cox,et al.  The Optimal Number of Response Alternatives for a Scale: A Review , 1980 .

[19]  R. Nisbett,et al.  Validity problems comparing values across cultures and possible solutions. , 1997 .

[20]  Patricia S. Jones,et al.  Cultural differences in responses to a Likert scale. , 2002, Research in nursing & health.

[21]  L. Cohen,et al.  Research Methods in Education , 1980 .

[22]  Chuansheng Chen,et al.  Response Style and Cross-Cultural Comparisons of Rating Scales Among East Asian and North American Students , 1995 .