MANAGING DELPHI SURVEYS USING NONPARAMETRIC STATISTICAL TECHNIQUES

Information systems researchers have often turned to a variant of the Delphi survey technique to support their research of key issues in their field. Two particular weaknesses of past studies using this approach have been a lack of a definitive method for conducting the research and a lack of statistical support for the conclusions drawn by the researchers. In this paper, the author presents a method, based on nonparametric statistical techniques, to conduct ranking-type Delphi surveys, perform analysis, and report results. The author takes this one step further by illustrating an actual analysis of a Delphi survey. The analysis is compared to results that were presented without the benefit of the author's approach. This paper shows that use of the advocated approach can streamline and strengthen studies, improve the validity of results, and thus better serve the consumers of the research findings. Since the ranking-type Delphi is so popular among information systems researchers, a consistent method is needed to apply to their data collection, analysis, and reporting of results. This paper provides such a method in concise form and illustrates the use of the method in a manner affording comparison between it and previous practice.

[1]  R. Wolff,et al.  Note-On the Aggregation of Individual Probability Estimates , 1981 .

[2]  Alan L. Porter,et al.  EFTE: An interactive Delphi method , 1985 .

[3]  Ching-Lai Hwang,et al.  Group decision making under multiple criteria , 1987 .

[4]  L. Seiford,et al.  Priority Ranking and Consensus Formation , 1978 .

[5]  James C. Wetherbe,et al.  Key issues in information systems management , 1987 .

[6]  Paul Gray,et al.  Evaluating a Delphi forecast on personal computers , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[7]  J. D. Couger.  Key human resource issues in IS in the 1990s , 1988, Proceedings of the Twenty-First Annual Hawaii International Conference on System Sciences, 1988. Vol.IV. Applications Track.

[8]  J. Daniel Couger.  Key human resource issues in IS in the 1990s: Views of IS executives versus human resource executives , 1988, Inf. Manag..

[9]  Richard T. Watson,et al.  Key issues in information systems management: An international perspective , 1991, Inf. Manag..

[10]  N. Dalkey,et al.  An Experimental Application of the Delphi Method to the Use of Experts , 1963 .

[11]  M. Raskin.  The Delphi Study in Field Instruction Revisited: Expert Consensus on Issues and Research Priorities , 1994 .

[12]  John F. Preble,et al.  Public sector use of the Delphi technique , 1983 .

[13]  Jay F. Nunamaker,et al.  Electronic Meeting Support: The GroupSystems Concept , 1991, Int. J. Man Mach. Stud..

[14]  Varun Grover,et al.  Important Strategic and Tactical Manufacturing Issues in the 1990s , 1994 .