Software Effort Estimation: unstructured group discussion as a method to reduce individual biasis

The effort of software projects is often estimated, completely or partially, using expert judgement. This estimation process is subject to biases of the expert responsible. Generally, this bias seems to be towards too optimistic estimates regarding the effort needed to complete the project. The degree of bias varies depending on the expert involved, and seems to be connected to both conscious and unconscious decisions. One possible way to reduce this bias towards over-optimism is to combine the judgments of several experts. This paper describes an experiment where experts with different backgrounds combined their estimates through group discussion. Twenty software professionals were asked to provide individual effort estimates of a software development project. Subsequently, they formed five estimation groups, each consisting of four experts. Each of these groups agreed on a project effort estimate through discussion and combination of knowledge. We found that the groups were less optimistic in their estimates than the individual experts. Interestingly, the group discussion-based estimates were closer to the effort used by the actual project than the average individual expert, i.e., the group discussions led to better estimates than a mechanical combination of the individual estimates. The groups’ ability to identify more project activities is among the possible explanations for this

[1]  S. Fiske,et al.  Social Psychology , 2019, Encyclopedia of Personality and Individual Differences.

[2]  Magne Jørgensen,et al.  A review of studies on expert estimation of software development effort , 2004, J. Syst. Softw..

[3]  Albert L. Lederer,et al.  Information systems software cost estimating: a current assessment , 1993, J. Inf. Technol..

[4]  R. L. Atkinson,et al.  Hilgard's Introduction to Psychology , 1999 .

[5]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[6]  Paul Rook,et al.  Controlling software projects , 1986, Softw. Eng. J..

[7]  Donald J. Reifer,et al.  Web Development: Estimating Quick-to-Market Software , 2000, IEEE Softw..

[8]  J. Stoner A comparison of individual and group decisions involving risk , 1961 .

[9]  Jairus Hihn,et al.  Cost estimation of software intensive projects: a survey of current practices , 1991, [1991 Proceedings] 13th International Conference on Software Engineering.

[10]  Barbara A. Kitchenham,et al.  Effort estimation using analogy , 1996, Proceedings of IEEE 18th International Conference on Software Engineering.

[11]  Robert T. Hughes,et al.  Expert judgement as an estimating method , 1996, Inf. Softw. Technol..

[12]  Barbara Kitchenham,et al.  Software Metrics: Measurement for Software Process Improvement , 1996 .

[13]  Fj Fred Heemstra,et al.  Function point analysis: evaluation of a software cost estimation model , 1991 .

[14]  James W. Borchering,et al.  Estimeetings: Development Estimates and a Front-End Process For a Large Project , 1991, IEEE Trans. Software Eng..

[15]  Magne Jørgensen,et al.  Combination of software development effort prediction intervals: why, when and how? , 2002, SEKE '02.

[16]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[17]  Stephen G. MacDonell,et al.  Factors systematically associated with errors in subjective estimates of software development effort: the stability of expert judgment , 1999, Proceedings Sixth International Software Metrics Symposium (Cat. No.PR00403).

[18]  D. Bem,et al.  GROUP DECISION MAKING UNDER RISK OF AVERSIVE CONSEQUENCES. , 1965, Journal of personality and social psychology.

[19]  Claes Wohlin,et al.  An experimental study of individual subjective effort estimations and combinations of the estimates , 1998, Proceedings of the 20th International Conference on Software Engineering.

[20]  H. Rutenberg Group processes. , 1974, Hospital progress.

[21]  J. Paynter,et al.  Project estimation using Screenflow Engineering , 1996, Proceedings 1996 International Conference Software Engineering: Education and Practice.

[22]  Johannes A. Zuber,et al.  Choice shift and group polarization : an analysis of the status of arguments and social decision schemes , 1992 .

[23]  Richard E. Fairley Making Accurate Estimates , 2002, IEEE Softw..

[24]  Pc,et al.  An Introduction to Social Psychology , 1920, Nature.

[25]  R. A. Cooke,et al.  Teamwork in planning innovative projects: improving group performance by rational and interpersonal interventions in group process , 1990 .

[26]  John Moses Learning how to improve effort estimation in small software development companies , 2000, Proceedings 24th Annual International Computer Software and Applications Conference. COMPSAC2000.

[27]  Shari Lawrence Pfleeger,et al.  Preliminary Guidelines for Empirical Research in Software Engineering , 2002, IEEE Trans. Software Eng..

[28]  J. Gillon,et al.  Group dynamics , 1996 .

[29]  Timothy M. Franz,et al.  Management of Poor Performance: A Comparison of Manager, Group Member, and Group Disciplinary Decisions , 1999 .

[30]  G. W. Fischer When oracles fail—A comparison of four procedures for aggregating subjective probability forecasts , 1981 .

[31]  Tian Peng,et al.  On Social Technology , 2005 .

[32]  Ellis Horowitz,et al.  Software Cost Estimation with COCOMO II , 2000 .

[33]  D. Bem,et al.  DIFFUSION OF RESPONSIBILITY AND LEVEL OF RISK TAKING IN GROUPS. , 1963, Journal of abnormal psychology.

[34]  Robert L. Winkler,et al.  Combining forecasts: A philosophical basis and some current issues , 1989 .

[35]  Watts S. Humphrey,et al.  Managing the software process , 1989, The SEI series in software engineering.

[36]  Lyn C. Thomas,et al.  Experts' estimates of task durations in software development projects , 2000 .

[37]  Andrew McDonald Web Engineering in Practice , 2001 .

[38]  Paul F. Cromwell,et al.  Group Effects on Decision-Making by Burglars , 1991 .