Use of the Delphi method to generate guidance in emergency nursing practice: A systematic review.

AIM To examine the application and methodological quality of the Delphi method used in developing guidance for emergency nursing practice. BACKGROUND Emergency nursing scope of practice has rapidly expanded in response to increasing patient acuity, complexity and technological innovation. Determining best practice is crucial for delivering high quality, safe and effective emergency nursing care. The Delphi method has been used to identify, prioritise complex issues and develop evidence-driven guidance in emergency nursing practice. The use and quality of the Delphi method in emergency nursing practice has not been examined. DESIGN Systematic literature review. DATABASES AND DATA TREATMENT A systematic literature search was conducted using the following databases: SCOPUS, EMBASE, Medline and ProQuest from date of inception to August 2019. The database search was limited to scholarly articles or peer-reviewed journals. No language restrictions were applied. The Cochrane Collaboration method and PRISMA checks were utilized to conduct the review. RESULTS Of 246 records identified 22 (8.9%) studies met the inclusion criteria. A modified Delphi method was commonly used (n = 15; 68.2%) and often conducted online (n = 11; 50.0%). Eight practice guidance themes were identified. Overall study quality was high (score 12/14; range 4-13), transparency of reporting varied. CONCLUSION Based on this review, the Delphi method is an appropriate method for exploring emergency nursing practice. The studies reviewed demonstrated that knowledge, skills and clinical expertise has progressively expanded in the specialty of emergency nursing. Variation in the application, conduct and transparency of reporting in Delphi studies developing guidance for emergency nursing practice is discussed.

[1]  O. Sibony,et al.  Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review , 2011, PloS one.

[2]  J. Kottner,et al.  Delphi procedure in core outcome set development: rating scale and consensus criteria determined outcome selection. , 2019, Journal of clinical epidemiology.

[3]  L. Radbruch,et al.  Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: Recommendations based on a methodological systematic review , 2017, Palliative medicine.

[4]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[5]  Zur Shapira,et al.  Response to Rating Scales: A Theoretical Model and Its Application to the Number of Categories Problem , 1984 .

[6]  Dimitra Dodou,et al.  Five-Point Likert Items: t test versus Mann-Whitney-Wilcoxon , 2010 .

[7]  Aaron J. Bois,et al.  Using the modified Delphi method to establish clinical consensus for the diagnosis and treatment of patients with rotator cuff pathology , 2016, BMC Medical Research Methodology.

[8]  Debra Jackson,et al.  Development of a violence tool in the emergency hospital setting. , 2010, Nurse researcher.

[9]  Jane Noyes,et al.  A methodological systematic review of what’s wrong with meta-ethnography reporting , 2014, BMC Medical Research Methodology.

[10]  I. C. Cunha,et al.  Assessment of professional competence of nurses in emergencies: created and validated instrument. , 2018, Revista brasileira de enfermagem.

[11]  M. D. de Villiers,et al.  The Delphi technique in health sciences education research , 2005, Medical teacher.

[12]  N. Crigger.  Towards understanding the nature of conflict of interest and its application to the discipline of nursing. , 2009, Nursing philosophy : an international journal for healthcare professionals.

[13]  K. White,et al.  Describing the role of the breast nurse in Australia , 1998 .

[14]  P. Mullen.  Delphi: myths and reality. , 2003, Journal of health organization and management.

[15]  Development of clinical competencies for emergency nurse practitioners: a pilot study. , 2012, Australasian emergency nursing journal : AENJ.

[16]  Matthew R. Hallowell.  Techniques to Minimize Bias When Using the Delphi Method to Quantify Construction Safety and Health Risks , 2009 .

[17]  Jeanne Lenzer,et al.  Why we can’t trust clinical guidelines , 2013, BMJ.

[18]  C. Naylor,et al.  Placing patients in the queue for coronary revascularization: evidence for practice variations from an expert panel process. , 1990, American journal of public health.

[19]  M. Adler,et al.  Gazing into the oracle : the Delphi method and its application to social policy and public health , 1996 .

[20]  R. Shaban,et al.  Consensus-based clinical research priorities for emergency nursing in Australia. , 2018, Australasian emergency care.

[21]  T. Sumsion,et al.  The Delphi Technique: An Adaptive Research Tool , 1998 .

[22]  Susan Strasser,et al.  Developing a competence framework and evaluation tool for primary care nursing in South Africa. , 2005, Education for health.

[23]  Fabio Hirschhorn,et al.  Reflections on the application of the Delphi method: lessons from a case in public transport research , 2018, International Journal of Social Research Methodology.

[24]  C Duffield,et al.  The Delphi technique. , 1988, The Australian journal of advanced nursing : a quarterly publication of the Royal Australian Nursing Federation.

[25]  Gene Rowe,et al.  The Delphi technique: Past, present, and future prospects — Introduction to the special issue☆ , 2011 .

[26]  R. Fitzpatrick,et al.  Issues in methodological research: perspectives from researchers and commissioners. , 2001, Health technology assessment.

[27]  V. Plummer,et al.  At the crossroads of violence and aggression in the emergency department: perspectives of Australian emergency nurses. , 2014, Australian health review : a publication of the Australian Hospital Association.

[28]  Hugh Barr,et al.  Consensus statements for management of Barrett's dysplasia and early-stage esophageal adenocarcinoma, based on a Delphi process. , 2012, Gastroenterology.

[29]  Robert J. Vokurka,et al.  Mapping the future of supply chain management: a Delphi study , 2009 .

[30]  Wendy O Baird,et al.  Delphi research: issues raised by a pilot study. , 2012, Nurse researcher.

[31]  J. Jackson Barnette,et al.  Delphi Methodology: An Empirical Investigation. , 1978 .

[32]  Wayne K. Talley,et al.  Stability and agreement criteria for the termination of Delphi studies , 1979 .

[33]  S. Xi,et al.  Core competence evaluation standards for emergency nurse specialist: Developing and testing psychometric properties , 2016 .

[34]  Anna Maria Valdez,et al.  So Much to Learn, So Little Time: Educational Priorities for the Future of Emergency Nursing , 2009, Advanced emergency nursing journal.

[35]  Susan Humphrey-Murto,et al.  The use of Delphi and Nominal Group Technique in nursing education: A review. , 2016, International journal of nursing studies.

[36]  M. Fry,et al.  Using the Delphi technique to design a self-reporting triage survey tool. , 2001, Accident and emergency nursing.

[37]  C. Marco,et al.  Conflicts of Interest in Emergency Medicine , 2017, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[38]  André L. Delbecq,et al.  A Group Process Model for Problem Identification and Program Planning , 1971 .

[39]  D. Chadwick,et al.  Exploring the acceptability of a ‘limited patient consent procedure’ for a proposed blood-borne virus screening programme: a Delphi consensus building technique , 2017, BMJ Open.

[40]  J. Zarocostas.  Non-communicable diseases must have greater priority, says WHO , 2009, BMJ : British Medical Journal.

[41]  E. Dove,et al.  Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation , 2015, PloS one.

[42]  Paula R. Williamson,et al.  Higher number of items associated with significantly lower response rates in COS Delphi surveys , 2019, Journal of clinical epidemiology.

[43]  M. Clarke,et al.  Increasing response rates to postal questionnaires: systematic review , 2002, BMJ : British Medical Journal.

[44]  Jay R. Avella,et al.  Delphi Panels: Research Design, Procedures, Advantages, and Challenges , 2016 .

[45]  George Argyrous,et al.  Statistics for Research with a Guide to SPSS Statistics for Research with a Guide to SPSS George Argyrous Sage Publications £29.99 608pp isbn: 9781849205955 1849205957 [Formula: see text]. , 2011, Nurse researcher.

[46]  Wesley Vernon,et al.  The Delphi technique: A review , 2009 .

[47]  N. Dalkey,et al.  An Experimental Application of the Delphi Method to the Use of Experts , 1963 .

[48]  J. Gacki-Smith,et al.  Nurse Practitioner Delphi Study: competencies for practice in emergency care. , 2010, Journal of emergency nursing: JEN : official publication of the Emergency Department Nurses Association.

[49]  A. Mazzo,et al.  Construction and validation of competency frameworks for the training of nurses in emergencies* , 2018, Revista latino-americana de enfermagem.

[50]  James Carifio,et al.  Resolving the 50‐year debate around using and misusing Likert scales , 2008, Medical education.

[51]  Raj Nair,et al.  Methods of formal consensus in classification/diagnostic criteria and guideline development. , 2011, Seminars in arthritis and rheumatism.

[52]  N Jairath,et al.  The Delphi methodology (Part one): A useful administrative approach. , 1994, Canadian journal of nursing administration.

[53]  Rong-Ya Shao,et al.  Development of evidence‐based nursing‐sensitive quality indicators for emergency nursing: A Delphi study , 2018, Journal of clinical nursing.

[54]  Cheryl Tatano Beck,et al.  Essentials of Nursing Research: Appraising Evidence for Nursing Practice , 2001 .

[55]  L. Kristjanson,et al.  A Delphi study on research priorities for emergency nurses in Western Australia. , 2004, Journal of emergency nursing: JEN : official publication of the Emergency Department Nurses Association.

[56]  M. Sandelowski,et al.  Devices and Desires: Gender, Technology and American Nursing , 2002, Nursing History Review.

[57]  K. Mackway-Jones,et al.  A Delphi study to identify performance indicators for emergency medicine , 2004, Emergency Medicine Journal.

[58]  Mohsen Ebrahimi,et al.  The Role Descriptions of Triage Nurse in Emergency Department: A Delphi Study , 2016, Scientifica.

[59]  Kerstin Cuhls,et al.  Real-Time Delphi in practice — A comparative analysis of existing software-based tools , 2017 .

[60]  B. Feldman,et al.  Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. , 2014, Journal of clinical epidemiology.

[61]  Anne Gardner,et al.  Consensus on an Australian Nurse practitioner specialty framework using Delphi methodology: results from the CLLEVER 2 study , 2017, Journal of advanced nursing.

[62]  T. J. Shields,et al.  Methodological problems associated with the Use of the Delphi technique , 1987 .

[63]  S. Read,et al.  Clinical role clarification: using the Delphi method to establish similarities and differences between nurse practitioners and clinical nurse specialists. , 2001, Journal of clinical nursing.

[64]  Timothy J. Wood,et al.  Using consensus group methods such as Delphi and Nominal Group in medical education research* , 2017, Medical teacher.

[65]  A. Marshall,et al.  Extending the nursing role in Emergency Departments: Challenges for Australia , 2008 .

[66]  Willem E. Saris,et al.  Choosing the Number of Categories in Agree–Disagree Scales , 2014 .

[67]  F. Hasson,et al.  The Delphi Technique in Nursing and Health Research , 2011 .

[68]  S. Mackintosh,et al.  Qualitative studies using in-depth interviews with older people from multiple language groups: methodological systematic review. , 2012, Journal of advanced nursing.

[69]  A. Berry,et al.  Using a Delphi approach to develop a strategy for A&E in defence nursing. , 2007, British journal of nursing.

[70]  S. Bassendowski,et al.  The History of Evidence-Based Practice in Nursing Education and Practice. , 2017, Journal of professional nursing : official journal of the American Association of Colleges of Nursing.

[71]  M. Mcmahon,et al.  ENA's Delphi study on national research priorities for emergency nurses in the United States. , 2004, Journal of emergency nursing: JEN : official publication of the Emergency Department Nurses Association.

[72]  E. Halcomb,et al.  Measuring the outcomes of nursing practice: A Delphi study , 2018, Journal of clinical nursing.

[73]  Manacés dos Santos Bezerril,et al.  Validação de protocolos gráficos para avaliação da segurança do paciente politraumatizado , 2018 .

[74]  Hsiu-Hung Wang,et al.  Clinical competencies of emergency nurses toward violence against women: a delphi study. , 2015, Journal of continuing education in nursing.

[75]  Cadeyrn J Gaskin,et al.  Practical application of the Delphi technique in a bicultural mental health nursing study in New Zealand. , 2004, Journal of advanced nursing.

[76]  L. Moseley,et al.  Considerations in using the Delphi approach: design, questions and answers , 2001 .

[77]  F. Hasson,et al.  Research guidelines for the Delphi survey technique. , 2000, Journal of advanced nursing.

[78]  T. Koch,et al.  A Delphi study of district nursing research priorities in Australia. , 2005, Applied nursing research : ANR.

[79]  L. Kurland,et al.  Emergency department registered nurses’ disaster medicine competencies. An exploratory study utilizing a modified Delphi technique , 2018, International Emergency Nursing.

[80]  Sara McPherson,et al.  Methodology Update: Delphi Studies , 2018, Nursing research.

[81]  H. McKenna.  The Delphi technique: a worthwhile research approach for nursing? , 1994, Journal of advanced nursing.

[82]  B. Weijters,et al.  The effect of rating scale format on response styles: the number of response categories and response catgory labels , 2010 .