Measuring the value of program outcomes: a review of multiattribute utility measures

Selection of a multiattribute utility instrument for economic evaluation is complex due to competition between developers and inflated claims for instrument properties. This review presents multiattribute utility theoretical requirements and assesses leading multiattribute utility instruments against these. Instruments reviewed are: the QWB, HUI3, 15D, EQ5D, AQoL and SF6D. The key finding is that no current instrument satisfies all the requirements for multiattribute utility measurement. We recommend that users should choose instruments most relevant to their circumstances and that studies should include two instruments. Rigorous sensitivity analyses should be conducted and both results reported. Subject to these caveats, preference should be given to instruments best meeting multiattribute utility theoretical requirements, viz., the AQoL or HUI3. However, we recognise that other instruments may perform as well, or even better, under certain circumstances.

[1]  S. Walker,et al.  Quality of Life Assessment: Key Issues in the 1990s , 1993, Springer Netherlands.

[2]  K. Cook,et al.  A psychometric analysis of the measurement level of the rating scale, time trade-off, and standard gamble. , 2001, Social science & medicine.

[3]  G Loomes,et al.  Visual Analog Scales, Standard Gambles, and Relative Risk Aversion , 2001, Medical decision making : an international journal of the Society for Medical Decision Making.

[4]  D. Feeny,et al.  The Health Utilities Index (HUI®) system for assessing health-related quality of life in clinical studies , 2001, Annals of medicine.

[5]  H. Sintonen.  The 15D instrument of health-related quality of life: properties and applications , 2001, Annals of medicine.

[6]  G. Hawthorne,et al.  A comparison of the Assessment of Quality of Life (AQoL) with four other generic utility instruments , 2001, Annals of medicine.

[7]  E. Nord.  Health state values from multiattribute utility instruments need correction , 2001, Annals of medicine.

[8]  P. Kind.  Measuring quality of life in evaluating clinical interventions: an overview , 2001, Annals of medicine.

[9]  R. Rabin,et al.  EQ-SD: a measure of health status from the EuroQol Group , 2001, Annals of medicine.

[10]  B. Zumbo,et al.  A Statistical Examination of the Health Utility Index-Mark III as a Summary Measure of Health Status for a General Population Health Survey , 2000 .

[11]  P. Fayers,et al.  Quality of Life: Assessment, Analysis, and Interpretation , 2000 .

[12]  J. Brazier,et al.  A Review of the Use of Health Status Measures in Economic Evaluation , 1999, Journal of health services research & policy.

[13]  R M Kaplan,et al.  The Quality of Well-Being Scale: critical similarities and differences with SF-36. , 1998, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[14]  J. Brazier,et al.  Deriving a preference-based single index from the UK SF-36 Health Survey. , 1998, Journal of clinical epidemiology.

[15]  M. Power,et al.  Development of the World Health Organization WHOQOL-BREF Quality of Life Assessment , 1998, Psychological Medicine.

[16]  P. Dolan,et al.  Modeling valuations for EuroQol health states. , 1997, Medical care.

[17]  Jill S. Anderson.  Measuring Health: A Guide to Rating Scales and Questionnaires , 1997 .

[18]  P. Dolan,et al.  Valuing health status using VAS and TTO: what lies behind the numbers? , 1997, Social science & medicine.

[19]  P. Dorman,et al.  Doctors and patients don't agree: cross sectional study of patients' and doctors' perceptions and assessments of disability in multiple sclerosis , 1997, BMJ.

[20]  G H Guyatt,et al.  Users' guides to the medical literature. XII. How to use articles about health-related quality of life. Evidence-Based Medicine Working Group. , 1997, JAMA.

[21]  M Johannesson,et al.  An Experimental Test of a Theoretical Foundation for Rating-scale Valuations , 1997, Medical decision making : an international journal of the Society for Medical Decision Making.

[22]  W F Lawrence,et al.  Predicting Quality of Well-being Scores from the SF-36 , 1997, Medical decision making : an international journal of the Society for Medical Decision Making.

[23]  J. Pater.  Quality of life and pharmacoeconomics in clinical trials , 1996 .

[24]  D. Feeny,et al.  Multiattribute utility function for a comprehensive health status classification system. Health Utilities Index Mark 2. , 1996, Medical care.

[25]  P. Dolan,et al.  Valuing health states: a comparison of methods. , 1996, Journal of health economics.

[26]  C. Lindholm.  The Nottingham Health Profile. , 1996, Journal of wound care.

[27]  Elazar J. Pedhazur,et al.  Measurement, Design, and Analysis: An Integrated Approach , 1994 .

[28]  J. Richardson,et al.  Cost utility analysis: what should be measured? , 1994, Social science & medicine.

[29]  J. Richardson,et al.  Social Evaluation of Health Care Versus Personal Evaluation of Health States: Evidence on the Validity of Four Health-state Scaling Instruments Using Norwegian and Australian Surveys , 1993, International Journal of Technology Assessment in Health Care.

[30]  C. Sherbourne,et al.  The MOS 36-Item Short-Form Health Survey (SF-36) , 1992 .

[31]  N. Jacobson,et al.  Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. , 1991, Journal of consulting and clinical psychology.

[32]  R M Kaplan,et al.  A general health policy model: update and applications. , 1988, Health services research.

[33]  I. McDowell,et al.  Measuring health: A guide to rating scales and questionnaires, 3rd ed. , 2006 .

[34]  G. Torrance.  Measurement of health state utilities for economic appraisal. , 1986, Journal of health economics.

[35]  B. Ford.  International Classification of Impairments, Disabilities and Handicaps , 1984, Releve epidemiologique hebdomadaire.

[36]  George W. Torrance,et al.  Application of Multi-Attribute Utility Theory to Measure Social Preferences for Health States , 1982, Oper. Res..

[37]  M. Bergner,et al.  The Sickness Impact Profile: Development and Final Revision of a Health Status Measure , 1981, Medical care.

[38]  S P McKenna,et al.  The Nottingham Health Profile: subjective health status and medical consultations. , 1981, Social science & medicine. Part A, Medical sociology.

[39]  R M Kaplan,et al.  Health Status Index: Category Rating versus Magnitude Estimation for Measuring Levels of Well-Being , 1979, Medical care.

[40]  J R Morris,et al.  The Sickness Impact Profile: Conceptual Formulation and Methodology for the Development of a Health Status Measure , 1976, International journal of health services : planning, administration, evaluation.

[41]  J. Ware.  SF-36 health survey: Manual and interpretation guide , 2003 .

[42]  J. Richardson,et al.  Construction and Utility Scaling of the Assessment of Quality of Life ( AQoL ) Instrument , 2001 .

[43]  G. Hawthorne.  Using the Assessment of Quality of Life ( AQoL ) Version 1 Dr , 2001 .

[44]  Graeme Hawthorne,et al.  Negative Utilities and the Evaluation of Complex Health States: Issues Arising From the Scaling of a Multiattribute Utility Instrument - Working Paper 113 , 2000 .

[45]  G. Hawthorne,et al.  Difficulty with life and death: methodological issues and results from the utility scaling of the Assessment of Quality of Life (AQoL) Instrument , 1999 .

[46]  M. Boyle,et al.  Multiplicative Multi-Attribute Utility Function for the Health Utilities Index Mark 3 (HUI3) System: A Technical Report , 1998 .

[47]  S. Saxena,et al.  The World Health Organization Quality of Life Assessment (WHOQOL): development and general psychometric properties. , 1998, Social science & medicine.

[48]  B. Spilker,et al.  Quality of life and pharmacoeconomics in clinical trials , 1996 .

[49]  G. Hawthorne,et al.  The Australian Multi-attribute Utility (AMAU) construction and Initial Evaluation , 1996 .

[50]  G W Torrance,et al.  Multi-attribute preference functions. Health Utilities Index. , 1995, PharmacoEconomics.

[51]  Harri Sintonen,et al.  The 15-D Measure of Health Related Quality of Life . II Feasibility , Reliability and Validity of its Valuation System , 1995 .

[52]  G. Hawthorne,et al.  An Australian MAU/QALY Instrument: Rationale and Preliminary Results , 1995 .

[53]  S. Saxena,et al.  The World Health Organization Quality of Life assessment (WHOQOL): position paper from the World Health Organization. , 1995, Social science & medicine.

[54]  H. Sintonen.  The 15-D Measure of Health Related Quality of Life: Reliability, Validity and Sensitivity of its Health State Descriptive System , 1994 .

[55]  N. Sartorius.  A WHO method for the assessment of health-related quality of life (WHOQOL) , 1993 .

[56]  Robert M. Kaplan,et al.  The Quality of Well-being Scale: rationale for a single quality of life index , 1993 .

[57]  Rachel M. Rosser,et al.  A health index and output measure , 1993 .

[58]  H. Sintonen,et al.  A fifteen-dimensional measure of health-related quality of life (15D) and its applications , 1993 .

[59]  J. Mcewen.  The Nottingham Health Profile , 1993 .

[60]  P. Wood,et al.  The International Classification of Impairments, Disabilities and Handicaps of the World Health Organization , 1990 .

[61]  A. Kasuya.  EuroQol--a new facility for the measurement of health-related quality of life. , 1990, Health policy.

[62]  A. Williams.  EuroQol : a new facility for the measurement of health-related quality of life , 1990 .

[63]  R L Kane,et al.  Methodology for measuring health-state preferences--I: Measurement strategies. , 1989, Journal of clinical epidemiology.

[64]  G. Loomes,et al.  The use of QALYs in health care decision making. , 1989, Social science & medicine.

[65]  A. Anastasi.  Evolving Concepts of Test Validation , 1986 .

[66]  R M Kaplan,et al.  Health status: types of validity and the index of well-being. , 1976, Health services research.

[67]  A. Anastasi.  Psychological testing, 4th ed. , 1976 .

[68]  N. Tallent.  Psychological testing. , 1960, The American journal of nursing.

[69]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.