Useful but no Oracle: reflections on the use of a Delphi Group in a multi-methods policy research study

Delphi Groups are an increasingly popular method, not least because electronic communications have made it easier to assemble a ‘virtual’ expert panel, but there have been a number of review articles which have pointed to a lack of rigour. Using an extended case study of a Delphi Group designed to establish agreed policy recommendations and deriving from a project using observational and semi-structured interview methods, this article examines the value of Delphi Groups as part of a mixed method research design. The article includes a narrative of the sequence of events in the Delphi Group’s deliberations, a detailed examination of how the group process led to the modification of one draft policy recommendation, a further examination of a contested additional policy recommendation, and a list of pragmatic recommendations on the conduct of Delphi Groups in respect of size, composition, recruitment, contestation, timing, closure and scope.

[1]  M. Burawoy.  For Public Sociology , 2005 .

[2]  J. Brannen.  Mixing Methods: qualitative and quantitative research , 2017 .

[3]  F. Al-Shamali,et al.  Author Biographies. , 2015, Journal of social work in disability & rehabilitation.

[4]  Philip James,et al.  Room for Manoeuvre? Regulatory Compliance in the Global Shipping Industry , 2013 .

[5]  Helen Sampson,et al.  Effectiveness of international regulation of pollution controls: the case of the governance of ship emissions - Interim Report , 2012 .

[6]  F. Hasson,et al.  The Delphi Technique in Nursing and Health Research , 2011 .

[7]  M. Bloor.  Addressing social problems through qualitative research , 2011 .

[8]  I. Bourgeault,et al.  The SAGE Handbook of Qualitative Methods in Health Research , 2010 .

[9]  A. O’Cathain.  Mixed Methods Involving Qualitative Research , 2010 .

[10]  J J Corbett,et al.  Mitigating the health impacts of pollution from oceangoing shipping: an assessment of low-sulfur fuel mandates. , 2009, Environmental science & technology.

[11]  Margaret Volante.  Qualitative research. , 2008, Nurse researcher.

[12]  Tom Horlick-Jones,et al.  Unicorn among the Cedars: On the Possibility of Effective ‘Smart Regulation’ of the Globalized Shipping Industry , 2006 .

[13]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .

[14]  A. Bryman.  Integrating quantitative and qualitative research: how is it done? , 2006 .

[15]  Janice M Morse.  Evolving Trends in Qualitative Research: Advances in Mixed-Method Design , 2005, Qualitative health research.

[16]  Alan Fyall,et al.  Revisiting Delphi: the Delphi technique in tourism research. , 2005 .

[17]  A. Onwuegbuzie,et al.  Mixed Methods Research: A Research Paradigm Whose Time Has Come , 2004 .

[18]  D. Silverman.  Qualitative research : theory, method and practice , 2004 .

[19]  George R. Franke,et al.  HANDBOOK OF MIXED METHODS IN SOCIAL & BEHAVIORAL RESEARCH (Book) , 2004 .

[20]  C. Teddlie,et al.  SAGE Handbook of Mixed Methods in Social & Behavioral Research , 2010 .

[21]  M. Bloor,et al.  Process evaluation of health promotion interventions , 2003 .

[22]  George Wright,et al.  The Delphi technique as a forecasting tool: issues and analysis , 1999 .

[23]  Rosaline S. Barbour,et al.  The Case for Combining Qualitative and Quantitative Approaches in Health Services Research , 1999, Journal of health services research & policy.

[24]  C. Seale,et al.  Quality in Qualitative Research , 1999 .

[25]  P. Glasner,et al.  Empowering the public? Citizens' juries and the new genetic technologies , 1998 .

[26]  Nicholas Rescher,et al.  Predicting the future : an introduction to the theory of forecasting , 1998 .

[27]  M. Bloor.  Techniques of Validation in Qualitative Research: a Critical Commentary , 1997 .

[28]  M. Adler,et al.  Gazing into the oracle : the Delphi method and its application to social policy and public health , 1996 .

[29]  P. Bonnefille,et al.  [Going out]. , 1993, Soins; la revue de reference infirmiere.

[30]  R. Emerson,et al.  On the Uses of Members' Responses to Researchers' Accounts , 1988 .

[31]  M. Bloor,et al.  On the Analysis of Observational Data: A Discussion of the Worth and Uses of Inductive Techniques and Respondent Validation , 1978 .

[32]  Harold Sackman,et al.  Delphi critique : expert opinion, forecasting, and group process , 1975 .

[33]  N. Denzin,et al.  The Research Act in Sociology. , 1973 .

[34]  Howard S. Becker,et al.  Whose Side are we on , 1967 .

[35]  D. Cressey.  Other people's money : a study in the social psychology of embezzlement , 1954 .

[36]  D. Cressey,et al.  Other People's Money: A Study in the Social Psychology of Embezzlement. , 1954 .