Performance Evaluation of General and Company Specific Models in Software Development Effort Estimation

In this paper we present the results of our effort estimation analysis of a European Space Agency database consisting of 108 software development projects. We develop and evaluate simple empirical effort estimation models that include only those productivity factors found to be significant for these projects and determine if models based on a multicompany database can be successfully used to make effort estimations within a specific company. This was accomplished by developing company specific effort estimation models based on the significant productivity factors of a particular company and by comparing the results with those from general ESA models on a holdout sample of the company. To our knowledge, no other published research has yet developed and analysed software development effort estimation models in this way. Effort predictions made on a holdout sample of the individual company's projects using general models were less accurate than the company specific model. However, it is likely that in the absence of enough resources and data for a company to develop its own model, the application of general models may be more accurate than the use of guessing and intuition.

[1]  Michael A. Cusumano,et al.  A quantitative analysis of U.S. and Japanese practice and performance in software development , 1990 .

[2]  Barry W. Boehm,et al.  Improving Software Productivity , 1987, Computer.

[3]  John E. Gaffney,et al.  Software Function, Source Lines of Code, and Development Effort Prediction: A Software Science Validation , 1983, IEEE Transactions on Software Engineering.

[4]  Chris F. Kemerer,et al.  An empirical validation of software cost estimation models , 1987, CACM.

[5]  Bill Curtis,et al.  Productivity factors and programming environments , 1984, ICSE '84.

[6]  Albert L. Lederer,et al.  Nine management guidelines for better cost estimating , 1992, CACM.

[7]  Joseph M. Mellichamp,et al.  Software Development Cost Estimation Using Function Points , 1994, IEEE Trans. Software Eng..

[8]  Claude E. Walston,et al.  A Method of Programming Measurement and Estimation , 1977, IBM Syst. J..

[9]  Soumitra Dutta,et al.  Software Development Productivity of European Space, Military, and Industrial Applications , 1996, IEEE Trans. Software Eng..

[10]  Norman E. Fenton,et al.  Software Metrics: A Rigorous Approach , 1991 .

[11]  Rajiv D. Banker,et al.  A model to evaluate variables impacting the productivity of software maintenance projects , 1991 .

[12]  Victor R. Basili,et al.  Programming measurement and estimation in the software engineering laboratory , 1981, J. Syst. Softw..

[13]  John J. Marciniak,et al.  Encyclopedia of Software Engineering , 1994, Encyclopedia of Software Engineering.

[14]  Victor R. Basili,et al.  A meta-model for software development resource expenditures , 1981, ICSE '81.

[15]  F. J. Heemstra,et al.  Software cost estimation , 1992, Inf. Softw. Technol..

[16]  Martin J. Shepperd,et al.  Estimating Software Project Effort Using Analogies , 1997, IEEE Trans. Software Eng..

[17]  Barbara A. Kitchenham,et al.  Empirical studies of assumptions that underlie software cost-estimation models , 1992, Inf. Softw. Technol..

[18]  W. Wayt Gibbs,et al.  Software's Chronic Crisis , 1994 .

[19]  Michael J. Prietula,et al.  Examining the Feasibility of a Case-Based Reasoning Model for Software Effort Estimation , 1992, MIS Q..

[20]  Tom DeMarco,et al.  Controlling Software Projects , 1982 .

[21]  H. E. Dunsmore,et al.  Software engineering metrics and models , 1986 .

[22]  Lawrence H. Putnam,et al.  A General Empirical Solution to the Macro Software Sizing and Estimating Problem , 1978, IEEE Transactions on Software Engineering.

[23]  Derek Coleman,et al.  Introducing Objectcharts or how to use Statecharts in object-oriented design , 1992 .

[24]  Siba N. Mohanty,et al.  Software cost estimation: Present and future , 1981, Softw. Pract. Exp..