Self-reported and routinely collected electronic healthcare resource-use data for trial-based economic evaluations: the current state of play in England and considerations for the future

BackgroundRandomised controlled trials (RCTs) are generally regarded as the “gold standard” for providing quantifiable evidence around the effectiveness and cost-effectiveness of new healthcare technologies. In order to perform the economic evaluations associated with RCTs, there is a need for accessible and good quality resource-use data; for the purpose of discussion here, data that best reflect the care received.Traditionally, researchers have developed questionnaires for resource-use data collection. However, the evolution of routinely collected electronic data within care services provides new opportunities for collecting data without burdening patients or caregivers (e.g. clinicians). This paper describes the potential strengths and limitations of each data collection method and then discusses aspects for consideration before choosing which method to use.Main textWe describe electronic data sources (large observational datasets, commissioning data, and raw data extraction) that may be suitable data sources for informing clinical trials and the current status of self-reported instruments for measuring resource-use. We assess the methodological risks and benefits, and compare the two methodologies. We focus on healthcare resource-use; however, many of the considerations have relevance to clinical questions.Patient self-report forms a pragmatic and cheap method that is largely under the control of the researcher. However, there are known issues with the validity of the data collected, loss to follow-up may be high, and questionnaires suffer from missing data. Routinely collected electronic data may be more accurate and more practical if large numbers of patients are involved. However, datasets often incur a cost and researchers are bound by the time for data approval and extraction by the data holders.ConclusionsOwing to the issues associated with electronic datasets, self-reported methods may currently be the preferred option. However, electronic hospital data are relatively more accessible, informative, standardised, and reliable. Therefore in trials where secondary care constitutes a major driver of patient care, detailed electronic data may be considered superior to self-reported methods; with the caveat of requiring data sharing agreements with third party providers and potentially time-consuming extraction periods. Self-reported methods will still be required when a ‘societal’ perspective (e.g. quantifying informal care) is desirable for the intended analysis.

[1]  Evangelos Kontopantelis,et al.  Spatial distribution of clinical computer systems in primary care in England in 2016 and implications for primary care electronic medical record databases: a cross-sectional population study , 2018, BMJ Open.

[2]  K. Bhaskaran,et al.  Data Resource Profile: Clinical Practice Research Datalink (CPRD) , 2015, International journal of epidemiology.

[3]  J. Brazier,et al.  Health, Health-Related Quality of Life, and Quality of Life: What is the Difference? , 2016, PharmacoEconomics.

[4]  Medical student access to electronic medical records in UK primary care , 2011, Education for primary care : an official publication of the Association of Course Organisers, National Association of GP Tutors, World Organisation of Family Doctors.

[5]  Ernesto Iadanza,et al.  A multi-layer monitoring system for clinical management of Congestive Heart Failure , 2015, BMC Medical Informatics and Decision Making.

[6]  Identifying patient-level health and social care costs for older adults discharged from acute medical units in England. , 2014, Age and ageing.

[7]  Colin Ridyard,et al.  Review of resource-use measures in UK economic evaluations , 2015 .

[8]  S Wordsorth,et al.  Improving the transferability of costing results in economic evaluation : an application to dialysis therapy for end-stage renal disease. , 2004 .

[9]  Kourtney J. Davis,et al.  Using an electronic medical record (EMR) to conduct clinical trials: Salford Lung Study feasibility , 2015, BMC Medical Informatics and Decision Making.

[10]  Patrick Hamilton,et al.  The economic burden of cancer in the UK: a study of survivors treated with curative intent , 2016, Psycho-oncology.

[11]  Gustav Kjellsson,et al.  Forgetting to remember or remembering to forget: a study of the recall period length in health care survey questions. , 2014, Journal of health economics.

[12]  A. Akobeng Understanding randomised controlled trials , 2005, Archives of Disease in Childhood.

[13]  M. Johnson,et al.  Circulating microRNAs in Sera Correlate with Soluble Biomarkers of Immune Activation but Do Not Predict Mortality in ART Treated Individuals with HIV-1 Infection: A Case Control Study , 2015, PloS one.

[14]  Franziska Wulf,et al.  Methods For The Economic Evaluation Of Health Care Programmes , 2016 .

[15]  S. Wilson Methods for the economic evaluation of health care programmes , 1987 .

[16]  Martin Knapp,et al.  Costing psychiatric interventions. , 1992 .

[17]  Mike Pringle,et al.  Using MIQUEST in General Practice , 1998 .

[18]  E McColl,et al.  Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. , 2001, Health technology assessment.

[19]  S. Walker,et al.  Using Linked Electronic Health Records to Estimate Healthcare Costs: Key Challenges and Opportunities , 2016, PharmacoEconomics.

[20]  J. Gladman,et al.  Cost-effectiveness of a day hospital falls prevention programme for screened community-dwelling older people at high risk of falls , 2010, Age and ageing.

[21]  J. Edmans,et al.  Cost-Effectiveness of a Specialist Geriatric Medical Intervention for Frail Older People Discharged from Acute Medical Units: Economic Evaluation in a Two-Centre Randomised Controlled Trial (AMIGOS) , 2015, PloS one.

[22]  R. Brooks EuroQol: the current state of play. , 1996, Health policy.

[23]  Peter Tyrer,et al.  Comparison of alternative methods of collection of service use data for the economic evaluation of health care interventions. , 2007, Health economics.

[24]  S. Noble,et al.  Missing data in trial-based cost-effectiveness analysis: the current state of play. , 2012, Health economics.

[25]  Dyfrig A Hughes,et al.  Methods for the collection of resource use data within clinical trials: a systematic review of studies funded by the UK Health Technology Assessment program. , 2010, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[26]  A. Hassey The National Programme for IT in the NHS. , 2005, The British journal of general practice : the journal of the Royal College of General Practitioners.

[27]  S. Noble,et al.  Core Items for a Standardized Resource Use Measure: Expert Delphi Consensus Survey , 2017, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[28]  L. Smeeth,et al.  Pragmatic randomised trials using routine electronic health records: putting them to the test , 2012, BMJ : British Medical Journal.

[29]  Jan Kottner,et al.  The exchangeability of self-reports and administrative health care resource use measurements: assessement of the methodological reporting quality. , 2016, Journal of clinical epidemiology.

[30]  J. Gladman,et al.  Economic Evaluation of a General Hospital Unit for Older People with Delirium and Dementia (TEAM Randomised Controlled Trial) , 2011, Trials.

[31]  K. Hirji,et al.  No short-cut in assessing trial quality: a case study , 2009, Trials.

[32]  S. Julious,et al.  Preventing and Lessening Exacerbations of Asthma in School-aged children Associated with a New Term (PLEASANT): Recruiting Primary Care Research Sites–the PLEASANT experience , 2015, npj Primary Care Respiratory Medicine.

[33]  B. Winblad,et al.  Application of Resource Utilization in Dementia (RUD) instrument in a global setting , 2013, Alzheimer's & Dementia.

[34]  Martin Knapp,et al.  Resource-Use Measurement Based on Patient Recall: Issues and Challenges for Economic Evaluation , 2013, Applied Health Economics and Health Policy.

[35]  R. Melis,et al.  Cost-effectiveness of a multidisciplinary intervention model for community-dwelling frail older people. , 2008, The journals of gerontology. Series A, Biological sciences and medical sciences.

[36]  Spiros C. Denaxas,et al.  Completeness and diagnostic validity of recording acute myocardial infarction events in primary care, hospital care, disease registry, and national mortality records: cohort study , 2013, BMJ.

[37]  I. Autti-Rämö,et al.  Economic evaluation of a geriatric rehabilitation programme: a randomized controlled trial. , 2010, Journal of rehabilitation medicine.

[38]  T. Wagner,et al.  Self-Reported Utilization of Health Care Services: Improving Measurement and Accuracy , 2006, Medical care research and review : MCRR.

[39]  C. Dirksen,et al.  Consensus-based cross-European recommendations for the identification, measurement and valuation of costs in health economic evaluations: a European Delphi study , 2017, The European Journal of Health Economics.

[40]  A. Sheikh,et al.  Correction: Protocol for the PINCER trial: a cluster randomised trial comparing the effectiveness of a pharmacist-led IT-based intervention with simple feedback in reducing rates of clinically important errors in medicines management in general practices , 2010, Trials.

[41]  Marc A. Koopmanschap,et al.  Handleiding iMTA Medical Cost Questionnaire (iMCQ) , 2013 .

[42]  M. Franklin,et al.  Economic Evaluations Alongside Efficient Study Designs Using Large Observational Datasets: the PLEASANT Trial Case Study , 2017, PharmacoEconomics.

[43]  C. Dirksen,et al.  How to Deal with Cost Differences at Baseline , 2012, PharmacoEconomics.

[44]  M. Davies,et al.  Hospital episode statistics: improving the quality and value of hospital data: a national internet e-survey of hospital consultants , 2012, BMJ Open.

[45]  R. Willke,et al.  Cost-effectiveness analysis alongside clinical trials II-An ISPOR Good Research Practices Task Force report. , 2015, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[46]  F. Hamdy,et al.  Validation of the Hospital Episode Statistics Outpatient Dataset in England , 2016, PharmacoEconomics.

[47]  R. Edwards,et al.  Hip fracture in the elderly multidisciplinary rehabilitation (FEMuR) feasibility study: testing the use of routinely collected data for future health economic evaluations , 2018, Pilot and Feasibility Studies.

[48]  William Hollingworth,et al.  Meeting abstracts from the 4th International Clinical Trials Methodology Conference (ICTMC) and the 38th Annual Meeting of the Society for Clinical Trials , 2017, Trials.

[49]  David Gerrett,et al.  A survey of validity and utility of electronic patient records in a general practice , 2001, BMJ : British Medical Journal.

[50]  Maria Spiropulu,et al.  The future of the , 2013 .

[51]  D. Kendrick,et al.  Identification of incident poisoning, fracture and burn events using linked primary care, secondary care and mortality data from England: implications for research and surveillance , 2015, Injury Prevention.

[52]  K. Hood,et al.  Challenges in accessing routinely collected data from multiple providers in the UK for primary studies: Managing the morass. , 2018, International journal of population data science.