Challenges to time trade-off utility assessment methods: when should you consider alternative approaches?

In recent years, the time trade-off (TTO) method, most commonly with a 10-year time horizon, has been the most frequently used approach for direct health state utility assessment, likely due to National Institute for Health and Care Excellence (NICE) preference for comparability with the EQ-5D, which has a utility scoring algorithm derived via this method. Although comparability to previous utility studies is important, there are situations when the TTO method may not be appropriate. The purpose of the current review is to highlight challenges to the TTO method. Five challenges to the TTO method are discussed: mild health states, small differences among health states, temporary health states, pediatric health states, and assessment of samples with particular characteristics. Some of these challenges are associated with the 10-year time horizon, while other situations may raise issues for TTO methods regardless of the time horizon. Alternative approaches for valuing health states are suggested.

[1]  G W Torrance,et al.  Incorporating Utility-Based Quality-of-Life Assessment Measures in Clinical Trials: Two Examples , 1989, Medical care.

[2]  N. Ikegami,et al.  Estimating an EQ-5D population value set: the case of Japan. , 2002, Health economics.

[3]  E. Verrips,et al.  Health-Related Quality of Life for Extremely Low Birth Weight Adolescents in Canada, Germany, and the Netherlands , 2008, Pediatrics.

[4]  M. Trommald,et al.  Roughly right or precisely wrong? Systematic review of quality-of-life weights elicited with the time trade-off method , 2004, Journal of health services research & policy.

[5]  M. Palta,et al.  Agreement about Identifying Patients Who Change over Time , 2012, Medical decision making : an international journal of the Society for Medical Decision Making.

[6]  H. Kohli Scottish Medicines Consortium. , 2005, The National medical journal of India.

[7]  Katherine Stevens,et al.  Developing a descriptive system for a new preference-based measure of health-related quality of life for children , 2009, Quality of Life Research.

[8]  N. Payakachat,et al.  Measuring health and well-being effects in family caregivers of children with craniofacial malformations , 2011, Quality of Life Research.

[9]  S. Gupta,et al.  TTO utility scores measure quality of life in patients with visual morbidity due to diabetic retinopathy or ARMD , 2004, Ophthalmic epidemiology.

[10]  J. Salomon,et al.  Preferences for health outcomes associated with Group A Streptococcal disease and vaccination , 2010, Health and quality of life outcomes.

[11]  L. Matza,et al.  Health State Utilities for Childhood Attention-Deficit/Hyperactivity Disorder Based on Parent Preferences in the United Kingdom , 2005, Medical decision making : an international journal of the Society for Medical Decision Making.

[12]  J. Levin,et al.  Racial/ethnic differences in preferences for the EQ-5D health states: results from the U.S. valuation study. , 2007, Journal of clinical epidemiology.

[13]  A. Haiderali,et al.  Utility elicitation study in the UK general public for late-stage chronic lymphocytic leukaemia , 2013, The European Journal of Health Economics.

[14]  D. Feeny Standardization and Regulatory Guidelines May Inhibit Science and Reduce the Usefulness of Analyses Based on the Application of Preference-Based Measures for Policy Decisions , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[15]  P. Dolan,et al.  To what extent can we explain time trade-off values from other information about respondents? , 2002, Social science & medicine.

[16]  P. Mohr,et al.  Public preferences for health states with schizophrenia and a mapping function to estimate utilities from positive and negative symptom scale scores , 2004, Schizophrenia Research.

[17]  A. G. Witney,et al.  The relationship of medical, demographic and psychosocial factors to direct and indirect health utility instruments in rheumatoid arthritis. , 2006, Rheumatology.

[18]  Tsuguya Fukui,et al.  Utilities Measured by Rating Scale, Time Trade-off, and Standard Gamble: Review and Reference for Health Care Professionals , 2002, Journal of epidemiology.

[19]  D. Revicki,et al.  Psychometric evaluation of the National Eye Institute Visual Function Questionnaire and Visual Function Questionnaire Utility Index in patients with non-infectious intermediate and posterior uveitis , 2013, Quality of Life Research.

[20]  J. Brazier,et al.  Health Utility Measurement , 2011 .

[21]  G. Torrance Utility measurement in healthcare: the things I never got to. , 2006, PharmacoEconomics.

[22]  Elaine L. Zanutto,et al.  A comparison of preferences for two GLP-1 products – liraglutide and exenatide – for the treatment of type 2 diabetes , 2010, Journal of medical economics.

[23]  R. Keren,et al.  Measuring Health Preferences for Use in Cost-Utility and Cost-Benefit Analyses of Interventions in Children , 2012, PharmacoEconomics.

[24]  J. Pater Quality of life and pharmacoeconomics in clinical trials , 1996 .

[25]  D K Owens,et al.  Cost-effectiveness of warfarin and aspirin for prophylaxis of stroke in patients with nonvalvular atrial fibrillation. , 1995, JAMA.

[26]  J. Kenneth Buckingham,et al.  Comparing Three Versions of the Time Tradeoff , 1996, Medical decision making : an international journal of the Society for Medical Decision Making.

[27]  S. Petrou,et al.  Measurement of health utilities in children , 2009 .

[28]  Aki Tsuchiya,et al.  A review of studies mapping (or cross walking) non-preference based measures of health to generic preference-based measures , 2010, The European Journal of Health Economics.

[29]  I. Béjia,et al.  Measuring utilities by the time trade-off method in Tunisian rheumatoid arthritis patients , 2006, Clinical Rheumatology.

[30]  S. Dursun,et al.  Impact of schizophrenia and schizophrenia treatment-related adverse events on quality of life: direct utility elicitation , 2008, Health and quality of life outcomes.

[31]  Lisa M. Schwartz,et al.  Assessing Values for Health: Numeracy Matters , 2001, Medical decision making : an international journal of the Society for Medical Decision Making.

[32]  G. Bonsel,et al.  Feasibility, reliability, and validity of the EQ-5D-Y: results from a multinational study , 2010, Quality of Life Research.

[33]  M. Jofre-Bonet,et al.  A comparison of the sensitivity of EQ-5D, SF-6D and TTO utility values to changes in vision and perceived visual function in patients with primary open-angle glaucoma , 2012, BMC Ophthalmology.

[34]  S. Dewilde,et al.  Eliciting health state utilities from the general public for severe chronic pain , 2010, The European Journal of Health Economics.

[35]  R. Edwards,et al.  EQ-5D for the assessment of health-related quality of life and resource allocation in children: a systematic methodological review. , 2011, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[36]  Michael Herdman,et al.  Development of the EQ-5D-Y: a child-friendly version of the EQ-5D , 2010, Quality of Life Research.

[37]  J. Guest,et al.  Utility values for chronic myelogenous leukemia chronic phase health states from the general public in the United Kingdom , 2012, Leukemia & lymphoma.

[38]  David O Meltzer,et al.  The impact of patient preferences on the cost-effectiveness of intensive glucose control in older patients with new-onset diabetes. , 2006, Diabetes care.

[39]  J. Brazier,et al.  Whose values in health? An empirical comparison of the application of adolescent and adult values for the CHU-9D and AQOL-6D in the Australian adolescent general population. , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[40]  R. Osborne,et al.  Quality of life related to oral versus subcutaneous iron chelation: a time trade-off study. , 2007, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[41]  J. Brazier,et al.  Does the whole equal the sum of the parts? Patient-assigned utility scores for IBS-related health states and profiles. , 2006, Health economics.

[42]  Kimberly N. Walter,et al.  Utilities and disutilities for attributes of injectable treatments for type 2 diabetes , 2011, The European Journal of Health Economics.

[43]  R. Goeree,et al.  A review of health utilities across conditions common in paediatric and adult populations , 2010, Health and quality of life outcomes.

[44]  Peter C. Smith,et al.  The Oxford Handbook of Health Economics , 2013 .

[45]  N Mittmann,et al.  Economic guidelines for oncology products: Adaptation of the Canadian Agency for Drugs and Technologies in Health (CADTH) technology assessment guidance document. , 2009, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[46]  J. Salomon,et al.  Health and Quality of Life Outcomes Health-state Valuations for Pertussis: Methods for Valuing Short-term Health States Pertussistime Trade-offwillingness-to-payshort-term Health-state , 2022 .

[47]  P. Cristoforoni,et al.  Time trade-off procedure for measuring health utilities loss with human papillomavirus-induced diseases: a multicenter, retrospective, observational pilot study in Italy. , 2011, Clinical therapeutics.

[48]  C. Carswell Measuring and Valuing Health Benefits for Economic Valuation , 2007, PharmacoEconomics.

[49]  Health state utilities for metastatic breast cancer , 2006, British Journal of Cancer.

[50]  J. Brazier,et al.  The Use of Rasch Analysis in Reducing a Large Condition-Specific Instrument for Preference Valuation , 2011, Medical decision making.

[51]  A. Caughey,et al.  A community-based study of acne-related health preferences in adolescents. , 2008, Archives of dermatology.

[52]  S. Leeder,et al.  A population based study , 1993, The Medical journal of Australia.

[53]  E. Wittenberg Valuing Children’s Health , 2012, PharmacoEconomics.

[54]  A. Stiggelbout,et al.  Evaluation of the Treatment Tradeoff Method in Rectal Cancer Patients: Is Surgery Preference Related to Outcome Utilities? , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[55]  D A Revicki,et al.  Patient-assigned health state utilities for depression-related outcomes: differences by depression severity and antidepressant medications. , 1998, Journal of affective disorders.

[56]  M. Versteegh,et al.  Time trade-off: one methodology, different methods , 2013, The European Journal of Health Economics.

[57]  Patrick M M Bossuyt,et al.  A Comparison of 3 Valuation Methods for Temporary Health States in Patients Treated with Oral Anticoagulants , 2004, Medical decision making : an international journal of the Society for Medical Decision Making.

[58]  D. Feeny,et al.  Health-Related Quality of Life in Survivors of Wilms’ Tumor and Advanced Neuroblastoma: A Cross-Sectional Study , 2000 .

[59]  Peter P. Wakker,et al.  The Utility of Health States After Stroke: A Systematic Review of the Literature , 2001, Stroke.

[60]  A. Zwinderman,et al.  Value of the time trade off method for measuring utilities in patients with rheumatoid arthritis , 2000, Annals of the rheumatic diseases.

[61]  J. Schmitt,et al.  Assessment of health state utilities of controlled and uncontrolled psoriasis and atopic eczema: a population‐based study , 2007, The British journal of dermatology.

[62]  Mark L. Greenberg,et al.  Health-related quality of life (HRQL) scores reported from parents and their children with chronic illness differed depending on utility elicitation method. , 2004, Journal of clinical epidemiology.

[63]  P. Stalmeier,et al.  The Dutch tariff: results and arguments for an effective design for national EQ-5D valuation studies. , 2006, Health economics.

[64]  W. Brouwer,et al.  The influence of subjective life expectancy on health state valuations using a 10 year TTO. , 2009, Health economics.

[65]  J. Brazier,et al.  Valuing child health utility 9D health states with a young adolescent sample , 2011, Applied health economics and health policy.

[66]  O. Norheim,et al.  Quantifying quality of life for economic analysis: time out for time trade off , 2003, Medical humanities.

[67]  Wendy J. Ungar,et al.  Challenges in Health State Valuation in Paediatric Economic Evaluation , 2011, PharmacoEconomics.

[68]  S. Kulasingam,et al.  Determination of quality of life-related utilities for health states relevant to ovarian cancer diagnosis and treatment. , 2009, Gynecologic oncology.

[69]  B. O'brien,et al.  Are health states "timeless"? The case of the standard gamble method. , 1999, Journal of clinical epidemiology.

[70]  Dennis A. Revicki,et al.  Assessment of health state utilities for attention-deficit/hyperactivity disorder in children using parent proxy report , 2003, Quality of Life Research.

[71]  L. Matza,et al.  Utilities associated with subcutaneous injections and intravenous infusions for treatment of patients with bone metastases , 2013, Patient preference and adherence.

[72]  R. Sheldon,et al.  Preferences of Patients with Diabetes Mellitus for Inhaled versus Injectable Insulin Regimens , 2012, PharmacoEconomics.

[73]  Katherine Stevens,et al.  Valuation of the Child Health Utility 9D Index , 2012, PharmacoEconomics.

[74]  G. Torrance Measurement of health state utilities for economic appraisal. , 1986, Journal of health economics.

[75]  X. Badia,et al.  Feasibility, validity and test–retest reliability of scaling methods for health states: The visual analogue scale and the time trade-off , 1999, Quality of Life Research.

[76]  Sarah A. Edwards,et al.  Characteristics and quality of pediatric cost-utility analyses , 2012, Quality of Life Research.

[77]  I. Kaitila,et al.  Quality of life in pre-adolescence: A 17-dimensional health-related measure (17D) , 1996, Quality of Life Research.

[78]  L. Matza,et al.  Utilities and disutilities for type 2 diabetes treatment-related attributes , 2007, Quality of Life Research.

[79]  P. Dolan,et al.  Modeling valuations for EuroQol health states. , 1997, Medical care.

[80]  M. Barrera,et al.  Health Status in Survivors of Cancer in Childhood and Adolescence , 2006, Quality of Life Research.

[81]  K. McPherson,et al.  Measuring the impact of menopausal symptoms on quality of life. , 1993, BMJ.

[82]  M. Trommald,et al.  Are QALYs based on time trade-off comparable?--A systematic review of TTO methodologies. , 2005, Health economics.

[83]  Wendy J. Ungar,et al.  Economic Evaluation in Child Health , 2010 .

[84]  S. Alibhai,et al.  Health-related quality of life anticipated with different management strategies for febrile neutropenia in adult cancer patients , 2012, Supportive Care in Cancer.

[85]  I. Kaitila,et al.  Quality of life in early adolescence: A sixteendimensional health-related measure (16D) , 1996, Quality of Life Research.

[86]  D. Feeny,et al.  A comprehensive multiattribute system for classifying the health status of survivors of childhood cancer. , 1992, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[87]  A. Stiggelbout,et al.  Correcting Biases in Standard Gamble and Time Tradeoff Utilities , 2004, Medical decision making : an international journal of the Society for Medical Decision Making.

[88]  M. Buxton,et al.  The time trade-off technique: how do the valuations of breast cancer patients compare to those of other groups? , 1994, Quality of Life Research.

[89]  Jackie Brown,et al.  Valuing temporary and chronic health states associated with breast screening. , 1998, Social science & medicine.

[90]  A. Culyer PHARMACEUTICAL BENEFITS ADVISORY COMMITTEE , 1958 .

[91]  Katherine Stevens,et al.  Assessing the performance of a new generic measure of health-related quality of life for children and refining it for use in health state valuation , 2011, Applied health economics and health policy.

[92]  M. Barkham,et al.  Developing and testing methods for deriving preference-based measures of health from condition-specific measures (and other patient-based measures of outcome). , 2012, Health technology assessment.

[93]  D. Feeny,et al.  The Health Utilities Index (HUI®): concepts, measurement properties and applications , 2003, Health and quality of life outcomes.

[94]  D. Meltzer,et al.  Health Utilities for Children and Adults With Type 1 Diabetes , 2011, Medical care.

[95]  N. Bressler,et al.  Rasch analysis in the development of a simplified version of the national eye institute visual-function questionnaire-25 for utility estimation , 2012, Quality of Life Research.

[96]  C Browne,et al.  Estimating quality-adjusted life years from patient-reported visual functioning , 2012, Eye.

[97]  P. Dolan,et al.  Valuing health status using VAS and TTO: what lies behind the numbers? , 1997, Social science & medicine.

[98]  Jonathan C Tosh,et al.  Utility values in National Institute for Health and Clinical Excellence (NICE) Technology Appraisals. , 2011, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[99]  M. Angermeyer,et al.  Utility Assessment in Patients with Mental Disorders , 2012, PharmacoEconomics.

[100]  Nan Luo,et al.  Valuations of EQ-5D Health States: Are the United States and United Kingdom Different? , 2005, Medical care.

[101]  J. Brazier,et al.  Outcomes of social care for adults: developing a preference-weighted measure. , 2012, Health technology assessment.

[102]  L. Matza,et al.  Health state utilities for skeletal-related events secondary to bone metastases , 2013, The European Journal of Health Economics.

[103]  B. O'brien,et al.  Holistic versus Composite Preferences for Lifetime Treatment Sequences for Type 2 Diabetes , 1999, Medical decision making : an international journal of the Society for Medical Decision Making.

[104]  J. Brazier,et al.  Developing preference-based health measures: using Rasch analysis to generate health state values , 2010, Quality of Life Research.

[105]  B. Spilker,et al.  Quality of life and pharmacoeconomics in clinical trials , 1996 .

[106]  D. Wild,et al.  Reimbursement agency requirements for health related quality-of-life data: a case study , 2009, Expert review of pharmacoeconomics & outcomes research.

[107]  R. Hornung,et al.  Health values of patients with systemic sclerosis. , 2007, Arthritis and rheumatism.

[108]  P. Dolan,et al.  The time trade-off method: results from a general population study. , 1996, Health economics.

[109]  M. Kuppermann,et al.  Can Preference Scores for Discrete States Be Used to Derive Preference Scores for an Entire Path of Events? , 1997, Medical decision making : an international journal of the Society for Medical Decision Making.

[110]  Alan Shiell,et al.  Extrinsic Goals and Time Tradeoff , 2007, Medical decision making : an international journal of the Society for Medical Decision Making.

[111]  A. Leonard,et al.  Health-related quality of life in veterans and nonveterans with HIV/AIDS , 2006, Journal of General Internal Medicine.

[112]  Martin Knapp,et al.  The Oxford Handbook of Health Economics , 2011 .

[113]  Peter P. Wakker,et al.  A Study of the Chained Procedure for the Standard Gamble and Time Tradeoff , 2008 .

[114]  M. Yi,et al.  Health values in adolescents with or without inflammatory bowel disease. , 2009, The Journal of pediatrics.

[115]  J. Brazier,et al.  Preference-based condition-specific measures of health: what happens to cross programme comparability? , 2010, Health economics.

[116]  Andrew Dalton,et al.  Health-related quality of life advantage of long-acting injectable antipsychotic treatment for schizophrenia: a time trade-off study , 2012, Health and Quality of Life Outcomes.

[117]  L. Prosser,et al.  Methods for Measuring Temporary Health States for Cost-Utility Analyses , 2012, PharmacoEconomics.

[118]  S. Saw,et al.  Utility assessment among cataract surgery patients , 2005, Journal of cataract and refractive surgery.