Validation and Findings Comparing VAS vs. Likert Scales for Psychosocial Measurements

Context: Psychosocial exposures commonly show large variation over time and are usually assessed using multi-item Likert indices. A construct requiring a five-item Likert index could possibly be replaced by a single visual analogue scale (VAS).Objective: To: a) evaluate validity and relative reliability of a single VAS compared to previously validated Likert based items and indices measuring the same construct, b) detect possible statistically significant differences in absolute levels between the single VAS and Likert items and indices respectively. Design: Cross-sectional study conducted in May 2004.Methods: 805 participants responded to a web-based questionnaire including both VAS and Likert based items. Intraclass correlations were utilized to assess agreement between VAS and Likert scales/indices and Marginal homogeneity tests were utilized to detect possible differences in absolute levels.Results: Moderate to strong correlations were found in responses between VAS and Likert based items and indices, and significant differences in absolute levels in seven out of eleven scales.Conclusion: Single VAS questions can, in some cases of uniform construct, replace a single Likert item and also be comparable, but not interchangeable, with multi-item Likert indices.

[1]  Donald D. Price,et al.  A comparison of pain measurement characteristics of mechanical visual analogue and simple numerical rating scales , 1994, Pain.

[2]  Ann Bowling,et al.  Measuring Disease: A Review of Disease-specific Quality of Life Measurement Scales (second edition) , 1995, Quality of Life Research.

[3]  Y. Benyamini,et al.  Self-rated health and mortality: a review of twenty-seven community studies. , 1997, Journal of health and social behavior.

[4]  S. Compton,et al.  Nursing research. Principles and methods: 7th edition , 2005 .

[5]  E. Ohnhaus,et al.  Methodological problems in the measurement of pain: A comparison between the verbal rating scale and the visual analogue scale , 1975, PAIN.

[6]  J M Youngblut,et al.  Single-item indicators in nursing research. , 1993, Research in nursing & health.

[7]  G. A. Smith,et al.  New non-cocaine-containing topical anesthetics compared with tetracaine-adrenaline-cocaine during repair of lacerations. , 1997, Pediatrics.

[8]  Ann Bowling,et al.  Research Methods in Health: Investigating Health and Health Services , 1997 .

[9]  Giuseppe Riva,et al.  The Use of the Internet in Psychological Research: Comparison of Online and Offline Questionnaires , 2003, Cyberpsychology Behav. Soc. Netw..

[10]  N. Lowe,et al.  A critical review of visual analogue scales in the measurement of clinical phenomena. , 1990, Research in nursing & health.

[11]  E Svensson,et al.  Concordance between ratings using different scales for the same variable. , 2000, Statistics in medicine.

[12]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[13]  B. Arnetz.  Staff perception of the impact of health care transformation on quality of care. , 1999, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[14]  S. Knox.  Psychosocial stress and the physiology of atherosclerosis. , 2001, Advances in Psychosomatic Medicine.

[15]  R. M. Mason,et al.  Comparison of fixed interval and visual analogue scales for rating chronic pain , 1975, European Journal of Clinical Pharmacology.

[16]  J. Bolton,et al.  Responsiveness of pain scales: a comparison of three pain intensity measures in chiropractic patients. , 1998, Journal of manipulative and physiological therapeutics.

[17]  Andrew Steptoe,et al.  Burden of Psychosocial Adversity and Vulnerability in Middle Age: Associations With Biobehavioral Risk Factors and Quality of Life , 2003, Psychosomatic medicine.

[18]  S. Shiffman,et al.  Reflections On The Intensive Measurement Of Stress, Coping, And Mood, With An Emphasis On Daily Measures , 1992 .

[19]  G. Brunier,et al.  A comparison of two methods of measuring fatigue in patients on chronic haemodialysis: visual analogue vs Likert scale. , 1996, International journal of nursing studies.

[20]  Alan D. Lopez,et al.  Summary Measures of Population Health: Concepts, Ethics, Measurement and Applications , 2002 .

[21]  C. Robinson,et al.  Prediction and assessment of the severity of post-operative pain and of satisfaction with management , 1998, Pain.

[22]  P M Fayers,et al.  Measuring and analysing quality of life in cancer clinical trials: a review. , 1983, Statistics in medicine.

[23]  S. Syme,et al.  Acculturation and coronary heart disease in Japanese-Americans. , 1976, American journal of epidemiology.

[24]  G. Kaplan,et al.  Perceived health and mortality: a nine-year follow-up of the human population laboratory cohort. , 1983, American journal of epidemiology.

[25]  G H Guyatt,et al.  A comparison of seven-point and visual analogue scales. Data from a randomized trial. , 1990, Controlled clinical trials.

[26]  Elisabeth Svensson,et al.  Comparison of the Quality of Assessments Using Continuous and Discrete Ordinal Rating Scales , 2000 .

[27]  F. Guillemin,et al.  Bias and precision in visual analogue scales: a randomized controlled trial. , 1999, American journal of epidemiology.

[28]  D. Cicchetti,et al.  Comparative reliability of categorical and analogue rating scales in the assessment of psychiatric symptomatology , 1979, Psychological Medicine.

[29]  C. Jenkins.  Recent evidence supporting psychologic and social risk factors for coronary disease. , 1976, The New England journal of medicine.

[30]  C Maxwell,et al.  Sensitivity and accuracy of the visual analogue scale: a psycho-physical classroom experiment. , 1978, British journal of clinical pharmacology.

[31]  John P. Dickerson,et al.  The quality of life: design and evaluation of a self-assessment instrument for use with cancer patients. , 1987, International journal of nursing studies.

[32]  A. Bond,et al.  The use of analogue scales in rating subjective feelings , 1974 .

[33]  B. Arnetz,et al.  Techno-stress: a prospective psychophysiological study of the impact of a controlled stress-reduction program in advanced telecommunication systems design work. , 1996, Journal of occupational and environmental medicine.

[34]  Gerhard Andersson,et al.  Internet administration of the Hospital Anxiety and Depression Scale in a sample of tinnitus patients. , 2003, Journal of psychosomatic research.

[35]  E Svensson,et al.  Construction of a single global scale for multi‐item assessments of the same variable , 2001, Statistics in medicine.

[36]  A. Vickers,et al.  COMPARISON OF AN ORDINAL AND A CONTINUOUS OUTCOME MEASURE OF MUSCLE SORENESS , 1999, International Journal of Technology Assessment in Health Care.

[37]  Kari Anne Holte,et al.  Exploring perceived tension as a response to psychosocial work stress. , 2003, Scandinavian journal of work, environment & health.

[38]  S. Sheather,et al.  Clinical applications of visual analogue scales: a critical review , 1988, Psychological Medicine.

[39]  B. J. Shields,et al.  Pediatric Pain Measurement Using a Visual Analogue Scale: A Comparison of Two Teaching Methods , 2003, Clinical pediatrics.

[40]  R. Rahe,et al.  Stressful Life Events—Their Nature and Effects , 1977 .

[41]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[42]  John Engberg,et al.  Response formats and satisfaction surveys for elders. , 2004, The Gerontologist.

[43]  S. Kelsen,et al.  Comparison of scales used to quantitate the sense of effort to breathe in patients with chronic obstructive pulmonary disease. , 1990, The American review of respiratory disease.

[44]  N. Pritchard,et al.  A Comparison of Three Different Scales for Rating Contact Lens Handling , 2002, Optometry and vision science : official publication of the American Academy of Optometry.

[45]  Töres Theorell,et al.  Workplace expansion, long-term sickness absence, and hospital admission , 2004, The Lancet.

[46]  G Kecklund,et al.  Sleep disturbances, work stress and work hours: a cross-sectional study. , 2002, Journal of psychosomatic research.

[47]  E C Huskisson,et al.  Measurement of functional capacity with visual analogue scales. , 1977, Rheumatology and rehabilitation.

[48]  Denise Polit-O'Hara,et al.  Nursing Research: Principles and Methods , 1978 .

[49]  E. Svensson.  Guidelines to statistical evaluation of data from rating scales and questionnaires. , 2001, Journal of rehabilitation medicine.

[50]  G. Guyatt,et al.  A comparison of Likert and visual analogue scales for measuring change in function. , 1987, Journal of chronic diseases.

[51]  R. Aitken.  Measurement of feelings using visual analogue scales. , 1969, Proceedings of the Royal Society of Medicine.

[52]  Gail R. Casper,et al.  Focus on Psychometrics Single-Item Indicators in Nursing Research , 1993 .

[53]  H. Laerhoven,et al.  A comparison of Likert scale and visual analogue scales as response options in children's questionnaires , 2004, Acta paediatrica.

[54]  A Ahlbom,et al.  Job decision latitude, job demands, and cardiovascular disease: a prospective study of Swedish men. , 1981, American journal of public health.

[55]  W. Downie,et al.  Studies with pain rating scales. , 1978, Annals of the rheumatic diseases.

[56]  J. McMurray,et al.  A comparison of the reproducibility and the sensitivity to change of visual analogue scales, Borg scales, and Likert scales in normal subjects during submaximal exercise. , 1999, Chest.

[57]  S. Groshen,et al.  Comparison of conditional quality of life terminology and visual analogue scale measurements , 1996, Quality of Life Research.

[58]  P Oja,et al.  Self-rated health status as a health measure: the predictive value of self-reported health status on the use of physician services and on mortality in the working-age population. , 1997, Journal of clinical epidemiology.

[59]  P. Jones,et al.  A comparison of the visual analogue scale and modified Borg scale for the measurement of dyspnoea during exercise. , 1989, Clinical science.

[60]  G. Fink.  ENCYCLOPEDIA OF STRESS , 2000, Experimental Neurology.

[61]  J. Lewis,et al.  Methods to assess breathlessness in healthy subjects: a critical evaluation and application to analyse the acute effects of diazepam and promethazine on breathlessness induced by exercise or by exposure to raised levels of carbon dioxide. , 1981, Clinical science.

[62]  Randy L. Carter,et al.  A prospective analysis of stress and fatigue in recurrent low back pain , 1987, Pain.

[63]  R. Seymour.  The use of pain scales in assessing the efficacy of analgesics in post-operative dental pain , 2004, European Journal of Clinical Pharmacology.