Studies using English administrative data (Hospital Episode Statistics) to assess health-care outcomes--systematic review and recommendations for reporting.

BACKGROUND Studies using English administrative data from the Hospital Episode Statistics (HES) are increasingly used for the assessment of health-care quality. This study aims to catalogue the published body of studies using HES data to assess health-care outcomes, to assess their methodological qualities and to determine if reporting recommendations can be formulated. METHODS Systematic searches of the EMBASE, Medline and Cochrane databases were performed using defined search terms. Included studies were those that described the use of HES data extracts to assess health-care outcomes. RESULTS A total of 148 studies were included. The majority of published studies were on surgical specialties (60.8%), and the most common analytic theme was of inequalities and variations in treatment or outcome (27%). The volume of published studies has increased with time (r = 0.82, P < 0.0001), as has the length of study period (r = 0.76, P < 0.001) and the number of outcomes assessed per study (r = 0.72, P = 0.0023). Age (80%) and gender (57.4%) were the most commonly used factors in risk adjustment, and regression modelling was used most commonly (65.2%) to adjust for confounders. Generic methodologic data were better reported than those specific to HES data extraction. For the majority of parameters, there were no improvements with time. CONCLUSIONS Studies published using HES data to report health-care outcomes have increased in volume, scope and complexity with time. However, persisting deficiencies related to both generic and context-specific reporting have been identified. Recommendations have been made to improve these aspects as it is likely that the role of these studies in assessing health care, benchmarking practice and planning service delivery will continue to increase.

[1]  M. Grocott,et al.  Quality of reporting in randomized trials published in high-quality surgical journals. , 2009, Journal of the American College of Surgeons.

[2]  W. Holland Healthcare for London. , 2008, Clinical medicine.

[3]  N. Vickers,et al.  Reducing DCO registrations through electronic matching of cancer registry data and routine hospital data , 2000, British Journal of Cancer.

[4]  L. Iezzoni Assessing Quality Using Administrative Data , 1997, Annals of Internal Medicine.

[5]  M. Egger,et al.  The hazards of scoring the quality of clinical trials for meta-analysis. , 1999, JAMA.

[6]  B. Rachet,et al.  Creative use of existing clinical and health outcomes data to assess NHS performance in England: Part 1—performance indicators closely linked to clinical care , 2005, BMJ : British Medical Journal.

[7]  J. Ioannidis,et al.  The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration , 2009, Annals of Internal Medicine [serial online].

[8]  W. Henderson,et al.  Risk-adjusted surgical outcomes. , 2001, Annual review of medicine.

[9]  R. Saracci,et al.  Commentary: Can we facilitate the ethical approval of international observational studies? , 2009, International journal of epidemiology.

[10]  Kenneth D. Mandl,et al.  Outcome Reporting Among Drug Trials Registered in ClinicalTrials.gov , 2010, Annals of Internal Medicine.

[11]  P. Aylin,et al.  Descriptive study comparing routine hospital administrative data with the Vascular Society of Great Britain and Ireland's National Vascular Database. , 2007, European journal of vascular and endovascular surgery : the official journal of the European Society for Vascular Surgery.

[12]  R. McNamee,et al.  Regression modelling and other methods to control confounding , 2005, Occupational and Environmental Medicine.

[13]  G. Hughes Hospital Episode Statistics: are they anything to write home about? , 2009, Emergency Medicine Journal.

[14]  Azeem Majeed,et al.  Use of administrative data or clinical databases as predictors of risk of death in hospital: comparison of models , 2007, BMJ : British Medical Journal.

[15]  J. Ioannidis,et al.  The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration , 2009, BMJ : British Medical Journal.

[16]  N. Black Why we need observational studies to evaluate the effectiveness of health care , 1996, BMJ.

[17]  J. Birkmeyer,et al.  Hospital Volume and Surgical Mortality in the United States , 2002 .

[18]  C. Gross,et al.  Scope and impact of financial conflicts of interest in biomedical research: a systematic review. , 2003, JAMA.

[19]  Alex Bottle,et al.  Hospital episode statistics: time for clinicians to get involved? , 2002, Clinical medicine.

[20]  J. Deeks,et al.  Evidence of methodological bias in hospital standardised mortality ratios: retrospective database study of English hospitals , 2009, BMJ : British Medical Journal.

[21]  J. Higgins,et al.  Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: a systematic review and annotated bibliography. , 2007, International journal of epidemiology.

[22]  D. Altman,et al.  Assessing Risk of Bias in Included Studies , 2008 .

[23]  Teresa To,et al.  Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data. , 2011, Journal of clinical epidemiology.

[24]  D. Altman,et al.  Chapter 8: Assessing risk of bias in included studies , 2008 .

[25]  A. Hansell,et al.  Accessing and using hospital activity data. , 2001, Journal of public health medicine.

[26]  A. Scott,et al.  Has payment by results affected the way that English hospitals provide care? Difference-in-differences analysis , 2009, BMJ : British Medical Journal.

[27]  P. Aylin,et al.  Comparison of administrative data with the Association of Coloproctology of Great Britain and Ireland (ACPGBI) colorectal cancer database , 2008, International Journal of Colorectal Disease.

[28]  N. Scott,et al.  HESteria or hype? , 2011, BMJ : British Medical Journal.

[29]  A. Walker,et al.  A systematic review of discharge coding accuracy. , 2001, Journal of public health medicine.

[30]  Matthew J. Thompson,et al.  Multicentre study of the quality of a large administrative data set and implications for comparing death rates , 2012, The British journal of surgery.

[31]  J. Ayanian Using administrative data to assess health care outcomes. , 1999, European heart journal.

[32]  B. Starnes Re-interventions, Readmissions and Discharge Destination: Modern Metrics for the Assessment of the Quality of Care , 2010 .

[33]  Creating a national register of childhood type 1 diabetes using routinely collected hospital data , 2012, Pediatric diabetes.