Handling Missing Data in Within-Trial Cost-Effectiveness Analysis: a Review with Future Guidelines

Cost-Effectiveness Analyses (CEAs) alongside randomised controlled trials (RCTs) are increasingly often designed to collect resource use and preference-based health status data for the purpose of healthcare technology assessment. However, because of the way these measures are collected, they are prone to missing data, which can ultimately affect the decision of whether an intervention is good value for money. We examine how missing cost and effect outcome data are handled in RCT-based CEAs, complementing a previous review (covering 2003-2009, 88 articles) with a new systematic review (2009-2015, 81 articles) focussing on two different perspectives. First, we review the description of the missing data, the statistical methods used to deal with them, and the quality of the judgement underpinning the choice of these methods. Second, we provide guidelines on how the information about missingness and related methods should be presented to improve the reporting and handling of missing data. Our review shows that missing data in within-RCT CEAs are still often inadequately handled and the overall level of information provided to support the chosen methods is rarely satisfactory.

[1]  Geertruida H de Bock,et al.  Cost effectiveness of laparoscopy versus laparotomy in early stage endometrial cancer: a randomised trial. , 2011, Gynecologic oncology.

[2]  John Newell,et al.  The cost-effectiveness of a structured education pulmonary rehabilitation programme for chronic obstructive pulmonary disease in primary care: the PRINCE cluster randomised trial , 2013, BMJ Open.

[3]  L. Yardley,et al.  Clinical and cost effectiveness of booklet based vestibular rehabilitation for chronic dizziness in primary care: single blind, parallel group, pragmatic, randomised controlled trial , 2012, BMJ : British Medical Journal.

[4]  M Sculpher,et al.  Cost-effectiveness of integrated collaborative care for comorbid major depression in patients with cancer☆ , 2015, Journal of psychosomatic research.

[5]  Paul Valk,et al.  (Cost‐)effectiveness of self‐treatment of exacerbations in patients with COPD: 2 years follow‐up of a RCT , 2016, Respirology.

[6]  Martin Knapp,et al.  Maintenance cognitive stimulation therapy: an economic evaluation within a randomized controlled trial. , 2015, Journal of the American Medical Directors Association.

[7]  Jonathan L Rees,et al.  Clinical effectiveness and cost-effectiveness of open and arthroscopic rotator cuff repair [the UK Rotator Cuff Surgery (UKUFF) randomised trial]. , 2015, Health technology assessment.

[8]  Ann Langius-Eklöf,et al.  Intermittent versus indwelling urinary catheterisation in hip surgery patients: a randomised controlled trial with cost-effectiveness analysis. , 2013, International journal of nursing studies.

[9]  Baptiste Leurent,et al.  Rehabilitation in advanced, progressive, recurrent cancer: a randomized controlled trial. , 2013, Journal of pain and symptom management.

[10]  Martin Henriksson,et al.  Cost and health outcome of primary percutaneous coronary intervention versus thrombolysis in acute ST-segment elevation myocardial infarction-Results of the Swedish Early Decision reperfusion Study (SWEDES) trial. , 2010, American heart journal.

[11]  Michael Doherty,et al.  Lifestyle interventions for knee pain in overweight and obese adults aged ≥45: economic evaluation of randomised controlled trial , 2009, BMJ : British Medical Journal.

[12]  Kate Rumsby,et al.  Cost effectiveness of management strategies for urinary tract infections: results from randomised controlled trial , 2010, BMJ : British Medical Journal.

[13]  Sarah E Lamb,et al.  Comprehensive geriatric care for patients with hip fractures: a prospective, randomised, controlled trial , 2015, The Lancet.

[14]  Benedetto Vitiello,et al.  Relative cost-effectiveness of treatments for adolescent depression: 36-week results from the TADS randomized trial. , 2009, Journal of the American Academy of Child and Adolescent Psychiatry.

[15]  G. Andersson,et al.  Clinical effectiveness and cost-effectiveness of Internet- vs. group-based cognitive behavior therapy for social anxiety disorder: 4-year follow-up of a randomized trial. , 2014, Behaviour research and therapy.

[16]  Anne Forster,et al.  A structured training programme for caregivers of inpatients after stroke (TRACS): a cluster randomised controlled trial and cost-effectiveness analysis , 2013, The Lancet.

[17]  Richard Grieve,et al.  Cemented, cementless, and hybrid prostheses for total hip replacement: cost effectiveness analysis , 2013, BMJ : British Medical Journal.

[18]  Aziz Sheikh,et al.  Telemonitoring-based service redesign for the management of uncontrolled hypertension (HITS): cost and cost-effectiveness analysis of a randomised controlled trial , 2013, BMJ Open.

[19]  H. Kerstjens,et al.  The effect of an outpatient care on-demand-system on health status and costs in patients with COPD. A randomized trial. , 2014, Respiratory medicine.

[20]  A. Lang,et al.  Long-term eff ectiveness of dopamine agonists and monoamine oxidase B inhibitors compared with levodopa as initial treatment for Parkinson ’ s disease ( PD MED ) : a large , open-label , pragmatic randomised trial , 2014 .

[21]  C Prefaut,et al.  Cost-saving effect of supervised exercise associated to COPD self-management education program. , 2011, Respiratory medicine.

[22]  Martin Knapp,et al.  Cost effectiveness of a manual based coping strategy programme in promoting the mental health of family carers of people with dementia (the START (STrAtegies for RelaTives) study): a pragmatic randomised controlled trial , 2013, BMJ.

[23]  Pekka Rissanen,et al.  Cost-Effectiveness of Lifestyle Counselling as Primary Prevention of Gestational Diabetes Mellitus: Findings from a Cluster-Randomised Trial , 2013, PloS one.

[24]  Anita Patel,et al.  Tumour necrosis factor inhibitors versus combination intensive therapy with conventional disease modifying anti-rheumatic drugs in established rheumatoid arthritis: TACIT non-inferiority randomised controlled trial , 2015, BMJ : British Medical Journal.

[25]  Sarah E Lamb,et al.  Group cognitive behavioural treatment for low-back pain in primary care: a randomised controlled trial and cost-effectiveness analysis , 2010, The Lancet.

[26]  James R McKay,et al.  Cost-effectiveness analysis of a continuing care intervention for cocaine-dependent adults. , 2016, Drug and alcohol dependence.

[27]  Derek P de Beurs,et al.  Training mental health professionals in suicide practice guideline adherence: Cost-effectiveness analysis alongside a randomized controlled trial. , 2015, Journal of affective disorders.

[28]  K. Choi,et al.  Pressurised irrigation versus swabbing method in cleansing wounds healed by secondary intention: a randomised controlled trial with cost-effectiveness analysis. , 2015, International journal of nursing studies.

[29]  P. Myint,et al.  Effect of intermittent pneumatic compression on disability, living circumstances, quality of life, and hospital costs after stroke: secondary analyses from CLOTS 3, a randomised trial , 2014, The Lancet Neurology.

[30]  C. Relton,et al.  Depression treated by homeopaths: a study protocol for a pragmatic cohort multiple randomised controlled trial , 2014, Homeopathy.

[31]  Lisa Esmonde,et al.  Cognitive behavioural intervention for adults with anxiety complications of asthma: prospective randomised trial. , 2012, Respiratory medicine.

[32]  Elizabeth Walter,et al.  Impact from point-of-care devices on emergency department patient processing times compared with central laboratory testing of blood samples: a randomised controlled trial and cost-effectiveness analysis , 2013, Emergency Medicine Journal.

[33]  Marc N Elliott,et al.  Cost of talking parents, healthy teens: a worksite-based intervention to promote parent-adolescent sexual health communication. , 2013, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[34]  Frank J G Backx,et al.  Preventive exercises reduced injury-related costs among adult male amateur soccer players: a cluster-randomised trial. , 2013, Journal of physiotherapy.

[35]  J Rothwell,et al.  Group therapy for adolescents with repeated self harm: randomised controlled trial with economic evaluation , 2011, BMJ : British Medical Journal.

[36]  S A Jebb,et al.  A within-trial cost-effectiveness analysis of primary care referral to a commercial provider for weight loss treatment, relative to standard care—an international randomised controlled trial , 2012, International Journal of Obesity.

[37]  Ruth Thomas,et al.  Use of drug therapy in the management of symptomatic ureteric stones in hospitalised adults: a multicentre, placebo-controlled, randomised controlled trial and cost-effectiveness analysis of a calcium channel blocker (nifedipine) and an alpha-blocker (tamsulosin) (the SUSPEND trial). , 2015, Health technology assessment.

[38]  Glyn Lewis,et al.  Eff ectiveness and cost-eff ectiveness of mindfulness-based cognitive therapy compared with maintenance antidepressant treatment in the prevention of depressive relapse or recurrence (PREVENT): a randomised controlled trial , 2015 .

[39]  Martin Knapp,et al.  Cost effectiveness of telehealth for patients with long term conditions (Whole Systems Demonstrator telehealth questionnaire study): nested economic evaluation in a pragmatic, cluster randomised controlled trial , 2013, BMJ.

[40]  Georgina Smith,et al.  Clinical and cost-effectiveness of cognitive behaviour therapy for health anxiety in medical patients: a multicentre randomised controlled trial , 2014, The Lancet.

[41]  Shelby D Reed,et al.  Cost-effectiveness of zoledronic acid for the prevention of skeletal complications in patients with prostate cancer. , 2004, The Journal of urology.

[42]  Kevin J. Anstrom,et al.  Rationale and design of the GUIDE-IT study: Guiding Evidence Based Therapy Using Biomarker Intensified Treatment in Heart Failure. , 2014, JACC. Heart failure.

[43]  Martin Knapp,et al.  Cost-effectiveness of telecare for people with social care needs: the Whole Systems Demonstrator cluster randomised trial , 2014, Age and ageing.

[44]  Abigail Matthews,et al.  Design and methodological considerations of an effectiveness trial of a computer-assisted intervention: an example from the NIDA Clinical Trials Network. , 2012, Contemporary clinical trials.

[45]  Sandra E. Ward,et al.  A randomized trial of a tailored barriers intervention for Cancer Information Service (CIS) callers in pain , 2009, PAIN®.

[46]  Juul Achten,et al.  Total hip arthroplasty versus resurfacing arthroplasty in the treatment of patients with arthritis of the hip joint: single centre, parallel group, assessor blinded, randomised controlled trial , 2012, BMJ : British Medical Journal.

[47]  F. Zitman,et al.  A randomized controlled trial of the efficacy and cost-effectiveness of a brief intensified cognitive behavioral therapy and/or pharmacotherapy for mood and anxiety disorders: design and methods. , 2012, Contemporary clinical trials.

[48]  S G Thompson,et al.  Screening men for abdominal aortic aneurysm: 10 year mortality and cost effectiveness results from the randomised Multicentre Aneurysm Screening Study , 2009, BMJ : British Medical Journal.

[49]  S. Gates,et al.  Emergency department treatments and physiotherapy for acute whiplash: a pragmatic, two-step, randomised controlled trial , 2013, The Lancet.

[50]  Diana Elbourne,et al.  Efficacy and economic assessment of conventional ventilatory support versus extracorporeal membrane oxygenation for severe adult respiratory failure (CESAR): a multicentre randomised controlled trial , 2009, The Lancet.

[51]  C. V. van Rossem,et al.  Combining intensive practice nurse counselling or brief general practitioner advice with varenicline for smoking cessation in primary care: study protocol of a pragmatic randomized controlled trial. , 2015, Contemporary clinical trials.

[52]  Geraldine Naughton,et al.  Outcomes and costs of primary care surveillance and intervention for overweight or obese children: the LEAP 2 randomised controlled trial , 2009, BMJ : British Medical Journal.

[53]  Theresa M. Marteau,et al.  Options for managing low grade cervical abnormalities detected at screening: cost effectiveness study , 2009, BMJ : British Medical Journal.

[54]  K Khunti,et al.  Delivering the diabetes education and self management for ongoing and newly diagnosed (DESMOND) programme for people with newly diagnosed type 2 diabetes: cost effectiveness analysis , 2010, BMJ : British Medical Journal.

[55]  Georgina Smith,et al.  Clinical and cost-eff ectiveness of cognitive behaviour therapy for health anxiety in medical patients : a multicentre randomised controlled trial , 2013 .

[56]  Glyn Lewis,et al.  Effectiveness and cost-effectiveness of mindfulness-based cognitive therapy compared with maintenance antidepressant treatment in the prevention of depressive relapse or recurrence (PREVENT): a randomised controlled trial , 2015, The Lancet.

[57]  L. Tarassenko,et al.  Clinical and cost effectiveness of mobile phone supported self monitoring of asthma: multicentre randomised controlled trial , 2012, BMJ : British Medical Journal.

[58]  Willem Van Mechelen,et al.  Effect of integrated care for sick listed patients with chronic low back pain: economic evaluation alongside a randomised controlled trial , 2010, BMJ : British Medical Journal.

[59]  Andrea L Cheville,et al.  Cost effectiveness of telecare management for pain and depression in patients with cancer: results from a randomized trial. , 2014, General hospital psychiatry.

[60]  Muath Bishawi,et al.  On-pump versus off-pump coronary artery bypass surgery: cost-effectiveness analysis alongside a multisite trial. , 2013, The Annals of thoracic surgery.

[61]  Duncan Young,et al.  A randomised controlled trial and cost-effectiveness analysis of high-frequency oscillatory ventilation against conventional artificial ventilation for adults with acute respiratory distress syndrome. The OSCAR (OSCillation in ARDS) study. , 2015, Health technology assessment.

[62]  Rodney R Funk,et al.  Adolescent outpatient treatment and continuing care: main findings from a randomized clinical trial. , 2010, Drug and alcohol dependence.

[63]  Robert West,et al.  A pilot randomised trial to assess the methods and procedures for evaluating the clinical effectiveness and cost-effectiveness of Exercise Assisted Reduction then Stop (EARS) among disadvantaged smokers. , 2014, Health technology assessment.

[64]  Max O Bachmann,et al.  Cost‐effectiveness of nurse‐led versus doctor‐led antiretroviral treatment in South Africa: pragmatic cluster randomised trial , 2013, Tropical medicine & international health : TM & IH.

[65]  Jane Henderson,et al.  Cost-effectiveness of therapeutic hypothermia to treat neonatal encephalopathy. , 2010, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[66]  Usha Chakravarthy,et al.  Cost-effectiveness of ranibizumab and bevacizumab for age-related macular degeneration: 2-year findings from the IVAN randomised trial , 2014, BMJ Open.

[67]  Filip Smit,et al.  Cost Effectiveness and Resource Allocation Open Access Preventing Panic Disorder: Cost-effectiveness Analysis alongside a Pragmatic Randomised Trial , 2009 .

[68]  M K Campbell,et al.  The PRaCTICaL study of nurse led, intensive care follow-up programmes for improving long term outcomes from critical illness: a pragmatic randomised controlled trial , 2009, BMJ : British Medical Journal.

[69]  Anna-Mari Aalto,et al.  Quality of life and costs of levonorgestrel-releasing intrauterine system or hysterectomy in the treatment of menorrhagia: a 10-year randomized controlled trial. , 2013, American journal of obstetrics and gynecology.

[70]  Paul McCrone,et al.  Is short-term palliative care cost-effective in multiple sclerosis? A randomized phase II trial. , 2009, Journal of pain and symptom management.

[71]  Jonathan A Cook,et al.  A cost-utility analysis of microwave endometrial ablation versus thermal balloon endometrial ablation. , 2010, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[72]  A Spencer,et al.  Exercise for depression in care home residents: a randomised controlled trial with cost-effectiveness analysis (OPERA). , 2013, Health technology assessment.

[73]  Mark J Sculpher,et al.  The cost-effectiveness of different chemotherapy strategies for patients with poor prognosis advanced colorectal cancer (MRC FOCUS). , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[74]  Lisa Saldana,et al.  Incremental Net Benefit of Early Intervention for Preschool-Aged Children with Emotional and Behavioral Problems in Foster Care. , 2014, Children and youth services review.

[75]  Silvia M. A. A. Evers,et al.  Comparative cost-effectiveness of two interventions to promote work functioning by targeting mental health complaints among nurses: pragmatic cluster randomised trial. , 2014, International journal of nursing studies.