Increasing Software Effort Estimation Accuracy Using Experience Data, Estimation Models and Checklists

It is frequently suggested that using experience data, estimation models and checklists can increase software effort estimation accuracy. However, there has been limited empirical research on the subject. We conducted a study of eighteen of the latest projects of a software contractor. Quantitative and qualitative data was collected on several issues related to estimates, key project properties, and project outcome. It was found that in projects where experience data was utilized in the estimation process, they experienced a lesser magnitude of effort overruns. The use of a checklist also appeared to increase estimation accuracy. However, the utilization of an estimation model did not appear to have a substantial impact.

[1]  Martin J. Shepperd,et al.  An experiment on software project size and effort estimation , 2003, 2003 International Symposium on Empirical Software Engineering, 2003. ISESE 2003. Proceedings..

[2]  Barbara A. Kitchenham,et al.  Effort estimation using analogy , 1996, Proceedings of IEEE 18th International Conference on Software Engineering.

[3]  Magne Jørgensen,et al.  A framework for the analysis of software cost estimation accuracy , 2006, ISESE '06.

[4]  F. J. Heemstra,et al.  Software cost estimation , 1992, Inf. Softw. Technol..

[5]  Magne Jørgensen,et al.  Software effort estimation by analogy and "regression toward the mean" , 2003, J. Syst. Softw..

[6]  Magne Jørgensen,et al.  Over-optimism in software development projects: "the winner's curse" , 2005, 15th International Conference on Electronics, Communications and Computers (CONIELECOMP'05).

[7]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[8]  Albert L. Lederer,et al.  A Causal Model for Software Cost Estimating Error , 1998, IEEE Trans. Software Eng..

[9]  Magne Jørgensen,et al.  A preliminary checklist for software cost management , 2003, Third International Conference on Quality Software, 2003. Proceedings..

[10]  Magne Jørgensen,et al.  Forecasting of software development work effort: Evidence on expert judgement and formal models , 2007 .

[11]  Thomas H. Wonnacott,et al.  Introductory Statistics , 2007, Technometrics.

[12]  Claes Wohlin,et al.  A project effort estimation study , 1998, Inf. Softw. Technol..

[13]  Magne Jørgensen,et al.  A comparison of software project overruns - flexible versus sequential development models , 2005, IEEE Transactions on Software Engineering.

[14]  Kjetil Molkken,et al.  A Review of Surveys on Software Effort Estimation , 2003 .

[15]  Susanne Strahringer,et al.  Estimating Software Project Effort Based on the Development Process Model , 2002, Softwaretechnik-Trends.

[16]  P. Cozby,et al.  Methods in behavioral research, 5th ed. , 1993 .

[17]  E A Nelson,et al.  MANAGEMENT HANDBOOK FOR THE ESTIMATION OF COMPUTER PROGRAMMING COSTS , 1967 .

[18]  W. Kruskal,et al.  Use of Ranks in One-Criterion Variance Analysis , 1952 .

[19]  Magne Jørgensen,et al.  Reasons for software effort estimation error: impact of respondent role, information collection approach, and data analysis method , 2004, IEEE Transactions on Software Engineering.

[20]  D. Ross Jeffery,et al.  An Empirical Study of Analogy-based Software Effort Estimation , 1999, Empirical Software Engineering.

[21]  Lionel C. Briand,et al.  An assessment and comparison of common software cost estimation modeling techniques , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).