Selection of quality indicators for hospital-based emergency care in Denmark, informed by a modified-Delphi process

BackgroundIn 2013, Danish policy-makers on a nationwide level decided to set up a national quality of care database for hospital-based emergency care in Denmark including the selection of quality indicators. The aim of the study was to describe the Delphi process that contributed to the selection of quality indicators for a new national database of hospital-based emergency care in Denmark.MethodsThe process comprised a literature review followed by a modified-Delphi survey process, involving a panel of 54 experts (senior clinicians, researchers and administrators from the emergency area and collaborating specialties). Based on the literature review, we identified 43 potential indicators, of which eight were time-critical conditions. We then consulted the Expert panel in two consecutive rounds. The Expert panel was asked to what extent each indicator would be a good measure of hospital-based emergency care in Denmark. In each round, the Expert panel participants scored each indicator on a Likert scale ranging from one (=disagree completely) through to six (=agree completely). Consensus for a quality indicator was reached if the median was greater than or equal to five (=agree). The Delphi process was followed by final selection by the steering group for the new database.ResultsFollowing round two of the Expert panel, consensus was reached on 32 quality indicators, including three time-critical conditions. Subsequently, the database steering group chose a set of nine quality indicators for the initial version of the national database for hospital-based emergency care.ConclusionsThe two-round modified Delphi process contributed to the selection of an initial set of nine quality indicators for a new a national database for hospital-based emergency care in Denmark. Final selection was made by the database steering group informed by the Delphi process.

[1]  O. Sibony,et al.  Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review , 2011, PloS one.

[2]  A. Jha,et al.  Putting quality on the global health agenda. , 2014, The New England journal of medicine.

[3]  Brian H Rowe,et al.  Prioritizing performance measurement for emergency department care: consensus on evidence-based quality of care indicators. , 2011, CJEM.

[4]  A. B. Cobb Quality indicators. , 1999, Journal of the Mississippi State Medical Association.

[5]  Olaf Helmer,et al.  ANALYSIS OF THE FUTURE: THE DELPHI METHOD , 1967 .

[6]  Peter Jacobsen,et al.  Evaluation of emergency department performance – a systematic review on recommended performance and quality-in-care measures , 2013, Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine.

[7]  Alastair Baker,et al.  Crossing the Quality Chasm: A New Health System for the 21st Century , 2001, BMJ : British Medical Journal.

[8]  A. Donabedian,et al.  The quality of care. How can it be assessed? , 1988, JAMA.

[9]  P. Cameron,et al.  The efficacy and value of emergency medicine: a supportive literature review , 2011, International journal of emergency medicine.

[10]  Cathal Walsh,et al.  Development of key performance indicators for emergency departments in Ireland using an electronic modified-Delphi consensus approach , 2013, European journal of emergency medicine : official journal of the European Society for Emergency Medicine.

[11]  Jon Nicholl,et al.  Consensus Methods to Identify a Set of Potential Performance Indicators for Systems of Emergency and Urgent Care , 2010, Journal of health services research & policy.

[12]  Maaret Castrén,et al.  The level of evidence for emergency department performance indicators: systematic review , 2015, European journal of emergency medicine : official journal of the European Society for Emergency Medicine.

[13]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[14]  L. Wallis,et al.  Identification of performance indicators for emergency centres in South Africa: results of a Delphi study , 2010, International journal of emergency medicine.