Development of Measures of the Quality of Emergency Department Care for Children Using a Structured Panel Process

BACKGROUND. Performance measures are essential components of public reporting and quality improvement. To date, few such measures exist to provide a comprehensive assessment of the quality of emergency department services for children. OBJECTIVES. Our goal was to use a systematic process to develop measures of emergency department care for children (0–19 years) that are (1) based on research evidence and expert opinion, (2) representative of a range of conditions treated in most emergency departments, (3) related to links between processes and outcomes, and (4) feasible to measure. METHODS. We presented a panel of providers and managers data from emergency department use to identify common conditions across levels of patient acuity, which could be targets for quality improvement. We used a structured panel process informed by a literature review to (1) identify condition-specific links between processes of care and defined outcomes and (2) select indicators to assess these process-outcome links. We determined the feasibility of calculating these indicators using an administrative data set of emergency department visits for Ontario, Canada. RESULTS. The panel identified 18 clinical conditions for indicator development and 61 condition-specific links between processes of care and outcomes. After 2 rounds of ratings, the panel defined 68 specific clinical indicators for the following conditions: adolescent mental health problems, ankle injury, asthma, bronchiolitis, croup, diabetes, fever, gastroenteritis, minor head injury, neonatal jaundice, seizures, and urinary tract infections. Visits for these conditions account for 23% of all pediatric emergency department use. Using an administrative data set, we were able to calculate 19 indicators, covering 9 conditions, representing 20% of all emergency department visits by children. CONCLUSIONS. Using a structured panel process, data on emergency department use, and literature review, it was possible to define indicators of emergency department care for children. The feasibility of these indicators will depend on the availability of high-quality data.

[1]  B J McNeil,et al.  Rating the appropriateness of coronary angiography--do practicing physicians agree with an expert panel and with each other? , 1998, The New England journal of medicine.

[2]  J P Kahan,et al.  The reproducibility of a method to identify the overuse and underuse of medical procedures. , 1998, The New England journal of medicine.

[3]  P. Barnes,et al.  Evaluation and management of children younger than two years old with apparently minor head trauma: proposed guidelines. , 2001, Pediatrics.

[4]  A. Hutchinson,et al.  Research methods used in developing and applying quality indicators in primary care , 2002, BMJ : British Medical Journal.

[5]  Adalsteinn D. Brown,et al.  Appropriateness ratings: overuse, underuse, or misuse? , 2001, The Lancet.

[6]  I. Stiell,et al.  Validation of the Ottawa Ankle Rules in children with ankle injuries. , 1999, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[7]  H. Bauchner,et al.  Pediatricians' Attitudes, Beliefs, and Practices Regarding Clinical Practice Guidelines: A National Survey , 2000, Pediatrics.

[8]  L. McCaig,et al.  National Hospital Ambulatory Medical Care Survey: 2001 emergency department summary. , 2003 .

[9]  C. Naylor.  What is appropriate care? , 1998, The New England journal of medicine.

[10]  W. Bordley.  Outcomes research and emergency medical services for children: domains, challenges, and opportunities. , 2002, Ambulatory pediatrics : the official journal of the Ambulatory Pediatric Association.

[11]  K. Kahn,et al.  Physician ratings of appropriate indications for six medical and surgical procedures. , 1986, American journal of public health.

[12]  R. Valori.  Coeliac disease in patients with irritable-bowel syndrome , 2001, The Lancet.

[13]  S. Tanner,et al.  Evaluation of the Ottawa Ankle Rules in children , 2003, Pediatric emergency care.

[14]  B. Alman,et al.  Sensitivity of a clinical examination to predict need for radiography in children with ankle injuries: a prospective study , 2001, The Lancet.

[15]  B. Rowe,et al.  Early emergency department treatment of acute asthma with systemic corticosteroids. , 2001, The Cochrane database of systematic reviews.

[16]  M. Gorelick,et al.  Pediatric emergency department directors' benchmarking survey: Fiscal year 2001 , 2003, Pediatric emergency care.

[17]  A. Zaritsky,et al.  Priorities for research in emergency medical services for children: results of a consensus conference. , 1999, Annals of emergency medicine.

[18]  Michael Schull,et al.  The development of indicators to measure the quality of clinical care in emergency departments following a modified-delphi approach. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[19]  J. Shook,et al.  Practice guidelines and performance measures in emergency medical services for children. , 2002, Annals of emergency medicine.

[20]  R H Brook,et al.  A Method for the Detailed Assessment of the Appropriateness of Medical Technologies , 1986, International Journal of Technology Assessment in Health Care.

[21]  C. Clancy,et al.  The importance of outcomes research in pediatric emergency medicine. , 2002, Ambulatory pediatrics : the official journal of the Ambulatory Pediatric Association.

[22]  A. Zaritsky,et al.  Priorities for research in Emergency Medical Services for Children: results of a consensus conference. EMSC Research Agenda Consensus Committee, National EMSC Resource Alliance. , 1999, Journal of emergency nursing: JEN : official publication of the Emergency Department Nurses Association.