Testing the measurement equivalence of paper and touch-screen versions of the EQ-5D visual analog scale (EQ VAS)

ObjectivesThis study examined the measurement equivalence of the original paper-based vertical format of the EQ-5D visual analog scale (EQ VAS) with a touch-screen computer-based horizontal format.MethodsA total of 314 subjects were administered two modes of the EQ VAS in a randomized crossover design. One mode was the original paper-based 20 cm vertical EQ VAS; the other mode was touch-screen-based. Measurement equivalence was assessed by testing the 95% confidence interval of the mean differences from an equivalence threshold of −3 to +3 points on the VAS and evaluating the intraclass correlation coefficient (ICC).ResultsThe adjusted mean (SE) EQ VAS score was 80.96 (0.87) on the paper and 79.59 (0.85) on the touch-screen. The mean (CI) difference between scores on the two formats was 1.37 with a confidence interval of 0.175–2.559, wholly contained within the equivalence interval. The ICC was 0.75, indicating acceptable agreement between the two modes. Almost a third (30.1%) of the respondents reported identical scores on both formats.ConclusionThese results provide evidence for the measurement equivalence of this EQ VAS touch-screen administration mode with the original paper mode.

[1]  J. Olsen,et al.  Treatment costs in Hodgkin's disease: a cost-utility analysis. , 1996, European journal of cancer.

[2]  H. Sintonen,et al.  [Health-related quality of life measures]. , 1993, Sairaanhoitaja.

[3]  Donald D. Price,et al.  A comparison of pain measurement characteristics of mechanical visual analogue and simple numerical rating scales , 1994, Pain.

[4]  J. Ware SF-36 health survey: Manual and interpretation guide , 2003 .

[5]  S. Chinn Obesity and Asthma: Evidence For and Against a Causal Relation , 2003, The Journal of asthma : official journal of the Association for the Care of Asthma.

[6]  A. Garratt,et al.  Generic measures of health-related quality of life in ankylosing spondylitis: reliability, validity and responsiveness. , 2002, Rheumatology.

[7]  W V Slack,et al.  Elements of a computer medical interview system. , 1971, Biomedical sciences instrumentation.

[8]  G Kahn,et al.  Computer-based patient education: a progress report. , 1993, M.D. computing : computers in medical practice.

[9]  D. Osoba,et al.  Patients' experiences using a computerized program with a touch-sensitive video monitor for the assessment of health-related quality of life. , 1998, Quality of Life Research.

[10]  M. Neary,et al.  Estimation of minimally important differences in EQ-5D utility and VAS scores in cancer , 2010, Health and Quality of Life Outcomes.

[11]  John Stewart,et al.  Are touchscreen computer surveys acceptable to medical oncology patients , 1997 .

[12]  H Schipper,et al.  Guidelines and caveats for quality of life measurement in clinical practice and research. , 1990, Oncology.

[13]  R. Dahl,et al.  Assessing equivalence of inhaled drugs. , 1995, Respiratory medicine.

[14]  B. Parasuraman,et al.  Electronic Versus Paper Questionnaires: A Further Comparison in Persons with Asthma , 2003, The Journal of asthma : official journal of the Association for the Care of Asthma.

[15]  R. Brooks EuroQol: the current state of play. , 1996, Health policy.

[16]  D. Forman,et al.  Automated collection of quality-of-life data: a comparison of paper and computer touch-screen questionnaires. , 1999, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[17]  M Sullivan,et al.  Tests of data quality, scaling assumptions, and reliability of the SF-36 in eleven countries: results from the IQOLA Project. International Quality of Life Assessment. , 1998, Journal of clinical epidemiology.

[18]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[19]  Frank de Charro,et al.  The Measurement and Valuation of Health Status Using EQ-5D: A European Perspective , 2003, Springer Netherlands.

[20]  Donald J. Schuirmann A comparison of the Two One-Sided Tests Procedure and the Power Approach for assessing the equivalence of average bioavailability , 1987, Journal of Pharmacokinetics and Biopharmaceutics.

[21]  J C Litte,et al.  Measures of Depressive Mood at Monthly Intervals , 1973, British Journal of Psychiatry.

[22]  Brett Hanscom,et al.  Computerized Questionnaires and the Quality of Survey Data , 2002, Spine.

[23]  W V Slack,et al.  A computer-based physical examination system. , 1967, JAMA.

[24]  N. Jacobson,et al.  Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. , 1991, Journal of consulting and clinical psychology.

[25]  C. McHorney,et al.  Generic Health Measurement: Past Accomplishments and a Measurement Paradigm for the 21st Century , 1997, Annals of Internal Medicine.

[26]  Nigel Rice,et al.  Use of a visual analogue scale in a daily patient diary: modelling cross-sectional time-series data on health-related quality of life. , 2004, Social science & medicine.

[27]  Kevin B. Johnson,et al.  An Electronic Menstrual Cycle Calendar: Comparison of Data Quality With a Paper Version , 2000, Menopause.

[28]  J. J. Caro Sr,et al.  Does electronic implementation of questionnaires used in asthma alter responses compared to paper implementation? , 2004, Quality of Life Research.

[29]  A. Wu,et al.  Validity and responsiveness of the EuroQol as a measure of health-related quality of life in people enrolled in an AIDS clinical trial , 2002, Quality of Life Research.

[30]  A Smith,et al.  Feasibility and compliance of automated measurement of quality of life in oncology practice. , 2003, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[31]  R. Aitken Measurement of feelings using visual analogue scales. , 1969, Proceedings of the Royal Society of Medicine.

[32]  R. Epstein,et al.  Interpretation of quality of life changes , 1993, Quality of Life Research.

[33]  Gordon H Guyatt,et al.  Methods to explain the clinical significance of health status measures. , 2002, Mayo Clinic proceedings.

[34]  G. Burrows,et al.  A Comparative Study of Four Depression Rating Scales* , 1975, The Australian and New Zealand journal of psychiatry.

[35]  E. Juniper,et al.  Quality of life questionnaires: does statistically significant = clinically important? , 1998, The Journal of allergy and clinical immunology.

[36]  P. Kind,et al.  Measuring health-related quality of life in rheumatoid arthritis: validity, responsiveness and reliability of EuroQol (EQ-5D). , 1997, British journal of rheumatology.

[37]  G. Bonsel,et al.  The Impact of Migraine on Health Status , 1995, Headache.

[38]  R. Rabin,et al.  EQ-SD: a measure of health status from the EuroQol Group , 2001, Annals of medicine.

[39]  N K Aaronson,et al.  An empirical comparison of four generic health status measures. The Nottingham Health Profile, the Medical Outcomes Study 36-item Short-Form Health Survey, the COOP/WONCA charts, and the EuroQol instrument. , 1997, Medical care.

[40]  Robyn Attewell,et al.  A comparison of an electronic version of the SF-36 General Health Questionnaire to the standard paper version , 2002, Quality of Life Research.

[41]  David Cella,et al.  The talking touchscreen: A new approach to outcomes assessment in low literacy , 2004, Psycho-oncology.

[42]  F Dexter,et al.  Statistical Analysis of Total Labor Pain Using the Visual Analog Scale and Application to Studies of Analgesic Effectiveness During Childbirth , 1998, Anesthesia and analgesia.

[43]  R. M. Mason,et al.  Comparison of fixed interval and visual analogue scales for rating chronic pain , 1975, European Journal of Clinical Pharmacology.

[44]  M F Roizen,et al.  A proposal to use confidence intervals for visual analog scale data for pain measurement to determine clinical significance. , 1993, Anesthesia and analgesia.

[45]  P. Dolan,et al.  Modeling valuations for EuroQol health states. , 1997, Medical care.

[46]  P Smith,et al.  Randomised controlled trial comparing effectiveness of touch screen system with leaflet for providing women with information on prenatal tests. , 2000, BMJ.

[47]  A. Gift,et al.  Visual Analogue Scales: Measurement of Subjective Phenomena , 1989, Nursing research.

[48]  M Rosen,et al.  The reliability of a linear analogue for evaluating pain , 1976, Anaesthesia.

[49]  M. Rué,et al.  Measuring health and health state preferences among critically ill patients , 1996, Intensive Care Medicine.

[50]  C. Sherbourne,et al.  The MOS 36-Item Short-Form Health Survey (SF-36) , 1992 .

[51]  David Cella,et al.  Health outcomes assessment in vulnerable populations: measurement challenges and recommendations. , 2003, Archives of physical medicine and rehabilitation.

[52]  Donna L Berry,et al.  Computerized symptom and quality-of-life assessment for patients with cancer part II: acceptability and usability. , 2004, Oncology nursing forum.

[53]  Tara Symonds,et al.  Assessing clinical significance in measuring oncology patient quality of life: introduction to the symposium, content overview, and definition of terms. , 2002, Mayo Clinic proceedings.

[54]  E. Ohnhaus,et al.  Methodological problems in the measurement of pain: A comparison between the verbal rating scale and the visual analogue scale , 1975, PAIN.

[55]  Paul S. Myles,et al.  The pain visual analog scale: is it linear or nonlinear? , 1999, Anesthesia and analgesia.

[56]  David C Mohr,et al.  A preliminary report on a skills-based telephone-administered peer support programme for patients with multiple sclerosis , 2005, Multiple sclerosis.

[57]  P. Dolan,et al.  Search for a critical appraisal of EuroQol: a response by the EuroQol group to Gafni and Birch. , 1994, Health policy.

[58]  W. Downie,et al.  Studies with pain rating scales. , 1978, Annals of the rheumatic diseases.

[59]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[60]  Donna L Berry,et al.  Usability of a computerized PAINReportIt in the general public with pain and people with cancer pain. , 2003, Journal of pain and symptom management.

[61]  A. N. Brand,et al.  A comparison of the standard and the computerized versions of the Well-being Questionnaire (WBQ) and the Diabetes Treatment Satisfaction Questionnaire (DTSQ) , 1998, Quality of Life Research.

[62]  G. Choppin Electronic , 1988 .

[63]  R. Makuch,et al.  Sample size requirements for evaluating a conservative therapy. , 1978, Cancer treatment reports.

[64]  M. Atkinson,et al.  Computerized quality-of-life screening in an oncology clinic. , 1997, Cancer practice.

[65]  Gopal H. Badlani,et al.  “Compu-void II”: The computerized voiding diary , 1996, Journal of Medical Systems.

[66]  W M Tierney,et al.  Linking clinical relevance and statistical significance in evaluating intra-individual changes in health-related quality of life. , 1999, Medical care.

[67]  H A Skinner,et al.  Does the computer make a difference? Computerized versus face-to-face versus self-report assessment of alcohol, drug, and tobacco use. , 1983, Journal of consulting and clinical psychology.

[68]  E. Burgess,et al.  The health interview: automated assessment in a multidisciplinary outpatient hypertension treatment program. , 1996, M.D. computing : computers in medical practice.

[69]  L. Kleinman,et al.  User Preferences for Computer Administration of Quality of Life Instruments , 2000 .

[70]  M. Drummond,et al.  The role of economic evaluation in the pricing and reimbursement of medicines. , 1997, Health policy.

[71]  R A Williams,et al.  Evaluation of Group Processes Using Visual Analogue Scales* , 1977, The Australian and New Zealand journal of psychiatry.

[72]  G P Samsa,et al.  Are health-related quality-of-life measures affected by the mode of administration? , 1996, Journal of clinical epidemiology.

[73]  D E Bloom,et al.  Technology, Experimentation, and the Quality of Survey Data , 1998, Science.

[74]  G H Guyatt,et al.  Interviewer versus self-administered questionnaires in developing a disease-specific, health-related quality of life instrument for asthma. , 1993, Journal of clinical epidemiology.

[75]  R. Melzack The McGill Pain Questionnaire: Major properties and scoring methods , 1975, PAIN.

[76]  L Lasagna,et al.  Studies with different types of visual analog scales for measurement of pain , 1983, Clinical pharmacology and therapeutics.

[77]  H. Brown,et al.  Validity of Euroqol--a generic health status instrument--in patients with rheumatoid arthritis. Economic and Health Outcomes Research Group. , 1994, British journal of rheumatology.

[78]  David Cella,et al.  Quality of life III: translating the science of quality-of-life assessment into clinical practice-an example-driven approach for practicing clinicians and clinical researchers. , 2003, Clinical therapeutics.

[79]  G. Norman,et al.  Interpretation of Changes in Health-related Quality of Life: The Remarkable Universality of Half a Standard Deviation , 2003, Medical care.

[80]  A. Cook,et al.  Electronic pain questionnaires: A randomized, crossover comparison with paper questionnaires for chronic pain assessment , 2004, Pain.

[81]  J. Fleiss The design and analysis of clinical experiments , 1987 .

[82]  D G Altman,et al.  Comparison of methods of measuring blood pressure. , 1986, Journal of epidemiology and community health.

[83]  John Brazier,et al.  A review of the use of health status measures in economic evaluation. , 1999, Health technology assessment.

[84]  J Rogers,et al.  Encouraging underscreened women to have cervical cancer screening: the effectiveness of a computer strategy. , 1997, Preventive medicine.