A survey on software estimation in the Norwegian industry

We provide an overview of the estimation methods that software companies apply to estimate their projects, why those methods are chosen, and how accurate they are. In order to improve estimation accuracy, such knowledge is essential. We conducted an in-depth survey, where information was collected through structured interviews with senior managers from 18 different companies and project managers of 52 different projects. We analyzed information about estimation approach, effort estimation accuracy and bias, schedule estimation accuracy and bias, delivered functionality and other estimation related information. Our results suggest, for example, that average effort overruns are 41%, that the estimation performance has not changed much the last 10-20 years, that expert estimation is the dominating estimation method, that estimation accuracy is not much impacted by use of formal estimation models, and that software managers tend to believe that the estimation accuracy of their company is better than it actually is.

[1]  Magne Jørgensen,et al.  A review of studies on expert estimation of software development effort , 2004, J. Syst. Softw..

[2]  Kjetil Moløkken-Østvold,et al.  A review of software surveys on software effort estimation , 2003, 2003 International Symposium on Empirical Software Engineering, 2003. ISESE 2003. Proceedings..

[3]  N. Nakagawa,et al.  Method to estimate parameter values in software prediction models , 1991 .

[4]  Bente Anda,et al.  Improving Estimation Practices by Applying Use Case Models , 2002, PROFES.

[5]  Bente Anda.  Comparing Effort Estimates Based on Use Case Points with Expert Estimates , 2002 .

[6]  Robert P. Leone,et al.  Uncertainty, Experience and the Winner's Curse in OCS Lease Bidding , 1986 .

[7]  Albert L. Lederer,et al.  Information systems software cost estimating: a current assessment , 1993, J. Inf. Technol..

[8]  J. Paynter,et al.  Project estimation using Screenflow Engineering , 1996, Proceedings 1996 International Conference Software Engineering: Education and Practice.

[9]  Justus D. Naumann,et al.  Empirical investigation of systems development practices and results , 1984, Inf. Manag..

[10]  Shari Lawrence Pfleeger,et al.  An empirical study of maintenance and development estimation accuracy , 2002, J. Syst. Softw..

[11]  H. E. Dunsmore,et al.  Software engineering metrics and models , 1986 .

[12]  Dag I. K. Sjøberg,et al.  The impact of customer expectation on software development effort estimates , 2004 .

[13]  F. J. Heemstra,et al.  Software cost estimation , 1992, Inf. Softw. Technol..

[14]  Trevor T. Moores,et al.  A conflict between the use of estimating and planning tools in the management of information systems , 1994 .

[15]  P. Cozby,et al.  Methods in behavioral research , 1977 .

[16]  Albert L. Lederer,et al.  Information system cost estimating: a management perspective , 1990 .

[17]  Magne Jørgensen,et al.  Estimating Software Development Effort Based on Use Cases-Experiences from Industry , 2001, UML.

[18]  Magne Jørgensen,et al.  An effort prediction interval approach based on the empirical distribution of previous estimation accuracy , 2003, Inf. Softw. Technol..

[19]  Dien D. Phan,et al.  Information systems project management: An integrated resource planning perspective model. , 1990 .

[20]  Claes Wohlin,et al.  An experimental study of individual subjective effort estimations and combinations of the estimates , 1998, Proceedings of the 20th International Conference on Software Engineering.

[21]  Barbara A. Kitchenham,et al.  An empirical validation of the relationship between the magnitude of relative error and project size , 2002, Proceedings Eighth IEEE Symposium on Software Metrics.

[22]  Magne Jørgensen,et al.  How much does a vacation cost?: or what is a software cost estimate? , 2003, SOEN.

[23]  Kjetil Molkken,et al.  A Review of Surveys on Software Effort Estimation , 2003 .

[24]  Albert L. Lederer,et al.  Nine management guidelines for better cost estimating , 1992, CACM.

[25]  T. Addison,et al.  Controlling software project risks: an empirical study of methods used by experienced project managers , 2002 .

[26]  Albert L. Lederer,et al.  Causes of inaccurate software development cost estimates , 1995, J. Syst. Softw..

[27]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[28]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[29]  François Bergeron,et al.  Estimation of information systems development efforts: A pilot study , 1992, Inf. Manag..

[30]  Trevor T. Moores,et al.  Could large UK corporations and computing companies use software cost estimating tools? – a survey , 1992 .