A Systematic Review of Software Development Cost Estimation Studies

This paper aims to provide a basis for the improvement of software-estimation research through a systematic review of previous work. The review identifies 304 software cost estimation papers in 76 journals and classifies the papers according to research topic, estimation approach, research approach, study context and data set. A Web-based library of these cost estimation papers is provided to ease the identification of relevant estimation research results. The review results combined with other knowledge provide support for recommendations for future software cost estimation research, including: 1) increase the breadth of the search for relevant studies, 2) search manually for relevant papers within a carefully selected set of journals when completeness is essential, 3) conduct more studies on estimation methods commonly used by the software industry, and 4) increase the awareness of how properties of the data sets impact the results when evaluating estimation methods

[1]  Barbara A. Kitchenham,et al.  A Further Empirical Investigation of the Relationship Between MRE and Project Size , 2003, Empirical Software Engineering.

[2]  Colin J Burgess,et al.  Can genetic programming improve software effort estimation? A comparative evaluation , 2001, Inf. Softw. Technol..

[3]  D. Ross Jeffery,et al.  Function Points and their Use , 1997, Aust. Comput. J..

[4]  Claes Wohlin,et al.  A subjective effort estimation experiment , 1997, Inf. Softw. Technol..

[5]  Hoang Pham,et al.  A Software Cost Model with Warranty and Risk Costs , 1999, IEEE Trans. Computers.

[6]  Dag I. K. Sjøberg,et al.  Software Process Improvement and Human Judgement Heuristics , 2001, Scand. J. Inf. Syst..

[7]  Erik Stensrud,et al.  Alternative approaches to effort prediction of ERP projects , 2001, Inf. Softw. Technol..

[8]  Luigi Lavazza,et al.  Requirements-Based Estimation of Change Costs , 2000, Empirical Software Engineering.

[9]  I. M. Marshall,et al.  Predicting the development effort of multimedia courseware , 1994, Inf. Softw. Technol..

[10]  Audris Mockus,et al.  Identifying Productivity Drivers by Modeling Work Units Using Partial Data , 2001, Technometrics.

[11]  Lawrence H. Putnam,et al.  A General Empirical Solution to the Macro Software Sizing and Estimating Problem , 1978, IEEE Transactions on Software Engineering.

[12]  Suku Nair,et al.  A Model for Software Development Effort and Cost Estimation , 1997, IEEE Trans. Software Eng..

[13]  Earl Chrysler,et al.  Some basic determinants of computer programming productivity , 1978, CACM.

[14]  Magne Jørgensen,et al.  Software effort estimation by analogy and "regression toward the mean" , 2003, J. Syst. Softw..

[15]  June M. Verner,et al.  A model for software sizing , 1987, J. Syst. Softw..

[16]  Emilia Mendes,et al.  Web Metrics-Estimating Design and Authoring Effort , 2001, IEEE Multim..

[17]  Donald J. Reifer Asset-R: A function point sizing tool for scientific and real-time systems , 1990, J. Syst. Softw..

[18]  S. Vijayakumar Use of historical data In software cost estimation , 1997 .

[19]  Siba N. Mohanty,et al.  Software cost estimation: Present and future , 1981, Softw. Pract. Exp..

[20]  D. Ross Jeffery,et al.  A Comparison of Function Point Counting Techniques , 1993, IEEE Trans. Software Eng..

[21]  Stephen G. MacDonell,et al.  Software Metrics Data Analysis—Exploring the Relative Performance of Some Commonly Used Modeling Techniques , 1999, Empirical Software Engineering.

[22]  Alain Abran,et al.  Investigating soft computing in case-based reasoning for software cost estimation , 2002 .

[23]  Qing Hu,et al.  Software Cost Estimation Using Economic Production Models , 1998, J. Manag. Inf. Syst..

[24]  Siu Leung Chung,et al.  An Economic Model to Estimate Software Rewriting and Replacement Times , 1996, IEEE Trans. Software Eng..

[25]  David N. Card,et al.  Resolving the software science anomaly , 1987, J. Syst. Softw..

[26]  Mark Keil,et al.  An investigation of risk perception and risk propensity on the decision to continue a software development project , 2000, J. Syst. Softw..

[27]  Robert T. Hughes,et al.  Expert judgement as an estimating method , 1996, Inf. Softw. Technol..

[28]  Lyn C. Thomas,et al.  Experts' estimates of task durations in software development projects , 2000 .

[29]  Albert L. Lederer,et al.  Causes of inaccurate software development cost estimates , 1995, J. Syst. Softw..

[30]  Caroline S. Langensiepen,et al.  Estimation support by lexical analysis of requirements documents , 2000, J. Syst. Softw..

[31]  Rajkumar Roy,et al.  Expert Judgement in Cost Estimating: Modelling the Reasoning Process , 2001, Concurr. Eng. Res. Appl..

[32]  Soumitra Dutta,et al.  Benchmarking European software management practices , 1998, CACM.

[33]  Joseph M. Mellichamp,et al.  Software Development Cost Estimation Using Function Points , 1994, IEEE Trans. Software Eng..

[34]  Shinji Kusumoto,et al.  Software Project Simulator for Eectiv e Process Improvement , 2001 .

[35]  Ioannis Stamelos,et al.  On the use of Bayesian belief networks for the prediction of software productivity , 2003, Inf. Softw. Technol..

[36]  David S. Christensen,et al.  Calibrating Software Cost Models to Department of Defense DatabasesA Review of Ten Studies , 1998 .

[37]  Victor Schneider,et al.  Prediction of software effort and project duration: four new formulas , 1978, SIGP.

[38]  Kalle Lyytinen,et al.  Simulation and Comparison of Albrecht's Function Point and DeMarco's Function Bang Metrics in a CASE Environment , 1993, IEEE Trans. Software Eng..

[39]  Emilia Mendes,et al.  A Comparative Study of Cost Estimation Models for Web Hypermedia Applications , 2003, Empirical Software Engineering.

[40]  Yacov Y. Haimes,et al.  Dynamic multistage software estimation , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[41]  D. Ross Jeffery,et al.  A comparative study of two software development cost modeling techniques using multi-organizational and company-specific data , 2000, Inf. Softw. Technol..

[42]  Warren Harrison,et al.  The Role of Programming Language in Estimating Software Development Costs , 1987, J. Manag. Inf. Syst..

[43]  Barry W. Boehm,et al.  Bayesian Analysis of Empirical Software Engineering Cost Models , 1999, IEEE Trans. Software Eng..

[44]  Shinji Kusumoto,et al.  Function-point analysis using design specifications based on the Unified Modelling Language , 2001, J. Softw. Maintenance Res. Pract..

[45]  Girish H. Subramanian,et al.  An empirical analysis of software effort estimate alterations , 1995, J. Syst. Softw..

[46]  Joseph M. Mellichamp,et al.  An object‐oriented tool for function point analysis , 1993 .

[47]  T. Capers Jones,et al.  Estimating software costs , 1998 .

[48]  José Javier Dolado,et al.  On the problem of the software cost function , 2001, Inf. Softw. Technol..

[49]  Martin J. Shepperd,et al.  Comparing Software Prediction Techniques Using Simulation , 2001, IEEE Trans. Software Eng..

[50]  Peter A. Bloniarz,et al.  A cost and performance model for Web service investment , 2000, CACM.

[51]  Lionel C. Briand,et al.  Modeling Development Effort in Object-Oriented Systems Using Design Properties , 2001, IEEE Trans. Software Eng..

[52]  Bernard Londeix,et al.  Deploying realistic estimation (field situation analysis) , 1995, Inf. Softw. Technol..

[53]  Ingunn Myrtveit,et al.  Analyzing Data Sets with Missing Data: An Empirical Evaluation of Imputation Methods and Likelihood-Based Methods , 2001, IEEE Trans. Software Eng..

[54]  Chris F. Kemerer,et al.  Improving the Reliability of Function Point Measurement: An Empirical Study , 1992, IEEE Trans. Software Eng..

[55]  Jean-Marc Desharnais,et al.  Reassessing Function Points , 1997, Australas. J. Inf. Syst..

[56]  Bryan Ratcliff,et al.  Adapting function point analysis to Jackson system development , 1990, Softw. Eng. J..

[57]  June M. Verner,et al.  In the 25 years since The Mythical Man-Month what have we learned about project management? , 1999, Inf. Softw. Technol..

[58]  Genny Tortora,et al.  A Metric for the Size Estimation of Object-Oriented Graphical User Interfaces , 2000, Int. J. Softw. Eng. Knowl. Eng..

[59]  Claes Wohlin,et al.  A project effort estimation study , 1998, Inf. Softw. Technol..

[60]  Ronald Gulezian Reformulating and calibrating COCOMO , 1991, J. Syst. Softw..

[61]  Stephen G. MacDonell Comparative review of functional complexity assessment methods for effort estimation , 1994, Softw. Eng. J..

[62]  I. M. Marshall,et al.  Code-based analysis of the development effort of a large scale courseware project , 1997, Inf. Softw. Technol..

[63]  F. J. Heemstra,et al.  Software cost estimation , 1992, Inf. Softw. Technol..

[64]  Erran Carmel,et al.  Time-to-completion factors in packaged software development , 1995, Inf. Softw. Technol..

[65]  D. Ross Jeffery Time-Sensitive Cost Models in the Commercial MIS Environment , 1987, IEEE Transactions on Software Engineering.

[66]  Trevor T. Moores,et al.  A conflict between the use of estimating and planning tools in the management of information systems , 1994 .

[67]  Magne Jørgensen Realism in assessment of effort estimation uncertainty: it matters how you ask , 2004, IEEE Transactions on Software Engineering.

[68]  Chetan S. Sankar,et al.  Issues in estimating real-time data communications software projects , 1997, Inf. Softw. Technol..

[69]  Michiel van Genuchten,et al.  On the use of software cost models , 1991, Inf. Manag..

[70]  H. Pham,et al.  A software cost model with warranty cost, error removal times and risk costs , 1998 .

[71]  Chuk Yau,et al.  Comparing the top-down and bottom-up approaches of function point analysis: a case study , 1995, Software Quality Journal.

[72]  Ioannis Stamelos,et al.  Managing uncertainty in project portfolio cost estimation , 2001, Inf. Softw. Technol..

[73]  Barbara A. Kitchenham,et al.  The question of scale economies in software - why cannot researchers agree? , 2002, Inf. Softw. Technol..

[74]  Albert L. Lederer,et al.  Perceptual Congruence and Systems Development Cost Estimation , 1995 .

[75]  P. A. Goodman,et al.  Application of cost-estimation techniques: industrial perspective , 1992, Inf. Softw. Technol..

[76]  Barbara A. Kitchenham,et al.  Using simulated data sets to compare data analysis techniques used for software cost modelling , 2001, IEE Proc. Softw..

[77]  Daniel V. Ferens Software Support Cost Models: Quo Vadis? , 1984 .

[78]  Nader B. Ebrahimi,et al.  How to Improve the Calibration of Cost Models , 1999, IEEE Trans. Software Eng..

[79]  J. Rutherford software estimating and metrics: a pragmatic approach , 1995 .

[80]  Raymond J. Madachy,et al.  Heuristic Risk Assessment Using Cost Factors , 1997, IEEE Softw..

[81]  Fj Fred Heemstra,et al.  Function point analysis: evaluation of a software cost estimation model , 1991 .

[82]  Christopher J. Lokan,et al.  Size Prediction for Pascal Programs , 2007 .

[83]  Yasunari Takagi,et al.  Statistical analysis of deviation of actual cost from estimated cost using actual project data , 2000, Inf. Softw. Technol..

[84]  Stephen G. MacDonell,et al.  What accuracy statistics really measure , 2001, IEE Proc. Softw..

[85]  Stephen G. MacDonell Establishing relationships between specification size and software process effort in CASE environments , 1997, Inf. Softw. Technol..

[86]  Magne Jørgensen,et al.  An effort prediction interval approach based on the empirical distribution of previous estimation accuracy , 2003, Inf. Softw. Technol..

[87]  Ross Jeffery,et al.  Function point sizing: Structure, validity and applicability , 2004, Empirical Software Engineering.

[88]  Ming Zhao,et al.  Planning Models for Software Reliability and Cost , 1998, IEEE Trans. Software Eng..

[89]  John Shepherd,et al.  A critical examination of software science , 1981, J. Syst. Softw..

[90]  Sunder Kekre,et al.  Software Effort Models for Early Estimation of Process Control Applications , 1992, IEEE Trans. Software Eng..

[91]  Tao Zhang,et al.  Genetic Algorithms for Project Management , 2001, Ann. Softw. Eng..

[92]  Anthony Pengelly Performance of effort estimating techniques in current development environments , 1995, Softw. Eng. J..

[93]  Sun-Jen Huang Early project estimation in the formal communication protocol development , 2001, Inf. Manag..

[94]  Christopher J. Lokan Early Size Prediction for C and Pascal Programs , 1996, J. Syst. Softw..

[95]  Stephen R. Schach,et al.  A software metric for cost estimation and efficiency measurement in data processing system development , 1983, J. Syst. Softw..

[96]  Magne Jørgensen,et al.  How much does a vacation cost?: or what is a software cost estimate? , 2003, SOEN.

[97]  Chiara Francalanci,et al.  Predicting the implementation effort of ERP projects: empirical evidence on SAP/R3 , 2001, J. Inf. Technol..

[98]  Magne Jørgensen,et al.  Impact of effort estimates on software project work , 2001, Inf. Softw. Technol..

[99]  Xiangzhu Gao,et al.  Assessing Software Cost Estimation Models: criteria for accuracy, consistency and regression , 1997, Australas. J. Inf. Syst..

[100]  Victor R. Basili,et al.  A Pattern Recognition Approach for Software Engineering Data Analysis , 1992, IEEE Trans. Software Eng..

[101]  Jainendra K. Navlakha Choosing a software cost estimation model for your organization: A case study , 1990, Inf. Manag..

[102]  Michael G. Gonzales,et al.  Correction of the Software Science Length Estimator Skewness for `C' Language Programs , 2000, Empirical Software Engineering.

[103]  Charles R. Symons,et al.  Function Point Analysis: Difficulties and Improvements , 1988, IEEE Trans. Software Eng..

[104]  Hoang Pham,et al.  A software cost model with error removal times and risk costs , 1998, Int. J. Syst. Sci..

[105]  Girish H. Subramanian,et al.  Dimensionality reduction in software development effort estimation , 1993, J. Syst. Softw..

[106]  Nafisseh Heiat,et al.  A model for estimating efforts required for developing small-scale business applications , 1997, J. Syst. Softw..

[107]  Ashok Subramanian,et al.  Determinants of Variability in Function Point Estimates , 1997 .

[108]  D. V. Ferens The conundrum of software estimation models , 1999 .

[109]  S. J. O'Brien,et al.  Function points in SSADM , 2004, Software Quality Journal.

[110]  Stephen G. MacDonell,et al.  Combining techniques to optimize effort predictions in software project management , 2003, J. Syst. Softw..

[111]  Kari Känsälä,et al.  Integrating Risk Assessment with Cost Estimation , 1997, IEEE Softw..

[112]  SohChristina,et al.  Developing an activity-based costing approach for system development and implementation , 2003 .

[113]  Ali Mili,et al.  Economics of software project management in Tunisia: basic TUCOMO , 1989 .

[114]  Gerald M. Weinberg,et al.  Goals and Performance in Computer Programming , 1974 .

[115]  Robert T. Hughes,et al.  Evaluating software development effort model-building techniques for application in a real-time telecommunications environment , 1998, IEE Proc. Softw..

[116]  D. Ross Jeffery,et al.  Calibrating estimation tools for software development , 1990, Softw. Eng. J..

[117]  Peretz Shoval,et al.  A combination of the Mk-II function points software estimation method with the ADISSA methodology for systems analysis and design , 1997, Inf. Softw. Technol..

[118]  Allen S. Parrish,et al.  An Empirical Study Using Task Assignment Patterns to Improve the Accuracy of Software Effort Estimation , 2001, IEEE Trans. Software Eng..

[119]  Martin J. Shepperd,et al.  Estimating Software Project Effort Using Analogies , 1997, IEEE Trans. Software Eng..

[120]  Ingunn Myrtveit,et al.  A Controlled Experiment to Assess the Benefits of Estimating with Analogy and Regression Models , 1999, IEEE Trans. Software Eng..

[121]  Barbara A. Kitchenham,et al.  Empirical studies of assumptions that underlie software cost-estimation models , 1992, Inf. Softw. Technol..

[122]  Albert L. Lederer,et al.  Information system cost estimating: a management perspective , 1990 .

[123]  A. S. M. Sajeev,et al.  A Vector-Based Approach to Software Size Measurement and Effort Estimation , 2001, IEEE Trans. Software Eng..

[124]  Will Hayes,et al.  An Experience Report on the Personal Software Process , 2000, IEEE Softw..

[125]  Maurice H. Halstead,et al.  Advances in Software Science , 1979, Adv. Comput..

[126]  Raymond J. Madachy Knowledge-based risk assessment and cost estimation , 1995, Automated Software Engineering.

[127]  Mary R. Lind,et al.  Undersizing software systems: third versus fourth generation software development , 1998 .

[128]  Emilia Mendes,et al.  Web hypermedia cost estimation: further assessment and comparison off cost estimation modelling techniques , 2002, New Rev. Hypermedia Multim..

[129]  Leon A. Kappelman,et al.  Calculating the cost of year-2000 compliance , 1998, CACM.

[130]  M. van Genuchten,et al.  Calibrating a software cost estimation model: why and how , 1987 .

[131]  Albert L. Lederer,et al.  Nine management guidelines for better cost estimating , 1992, CACM.

[132]  Chun Hung Cheng,et al.  Software development cost estimation: Integrating neural network with cluster analysis , 1998, Inf. Manag..

[133]  Tom Gilb Estimating software attributes: some unconventional points of view , 1986, SOEN.

[134]  Scott N. Woodfield,et al.  A study of several metrics for programming effort , 1981, J. Syst. Softw..

[135]  Barry W. Boehm,et al.  Disaggregating and Calibrating the CASE Tool Variable in COCOMO II , 2002, IEEE Trans. Software Eng..

[136]  Carolyn Mair,et al.  The consistency of empirical comparisons of regression and analogy-based software project cost prediction , 2005, 2005 International Symposium on Empirical Software Engineering, 2005..

[137]  John Moses,et al.  Measuring Effort Estimation Uncertainty to Improve Client Confidence , 2002, Software Quality Journal.

[138]  Michelle Cartwright,et al.  Predicting with Sparse Data , 2001, IEEE Trans. Software Eng..

[139]  Hareton K. N. Leung,et al.  Estimating Maintenance Effort by Analogy , 2002, Empirical Software Engineering.

[140]  Y. Miyazaki,et al.  Robust regression for developing software estimation models , 1994, J. Syst. Softw..

[141]  S DexterAlbert,et al.  A model for measuring information system size , 1991 .

[142]  Richard E. Fairley Recent advances in software estimation techniques , 1992, International Conference on Software Engineering.

[143]  Magne Jørgensen Top-down and bottom-up expert estimation of software development effort , 2004, Inf. Softw. Technol..

[144]  Linda A. Macaulay,et al.  A review of existing models for project planning and estimation and the need for a new approach , 1996 .

[145]  Donald J. Reifer,et al.  Web Development: Estimating Quick-to-Market Software , 2000, IEEE Softw..

[146]  Philip M. Johnson,et al.  Empirically Guided Software Effort Guesstimation , 2000, IEEE Softw..

[147]  Chris F. Kemerer,et al.  Reliability of function points measurement: a field experiment , 2015, CACM.

[148]  Keith Phalp,et al.  An investigation of machine learning based prediction systems , 2000, J. Syst. Softw..

[149]  Fj Fred Heemstra,et al.  Are software cost-estimation models accurate , 1990 .

[150]  Christina Soh,et al.  Developing an activity-based costing approach for system development and implementation , 2003, DATB.

[151]  Parag C. Pendharkar,et al.  Connectionist Models for Learning, Discovering, and Forecasting Software Effort: An Empirical Study , 2002, J. Comput. Inf. Syst..

[152]  Martin J. Shepperd,et al.  Making inferences with small numbers of training sets , 2002, IEE Proc. Softw..

[153]  Stefan Koch,et al.  Effort, co‐operation and co‐ordination in an open source software project: GNOME , 2002, Inf. Syst. J..

[154]  Albert L. Lederer,et al.  Software management and cost estimating error , 2000, J. Syst. Softw..

[155]  Manuel J. Barranco García,et al.  A Method for Estimating Maintenance Cost in a Software Project: A Case Study , 1997, J. Softw. Maintenance Res. Pract..

[156]  D. Ross Jeffery,et al.  Function Points in the Estimation and Evaluation of the Software Process , 1990, IEEE Trans. Software Eng..

[157]  S. L. Pfleeger,et al.  Model of software effort and productivity , 1991 .

[158]  Douglas Fisher,et al.  Machine Learning Approaches to Estimating Software Development Effort , 1995, IEEE Trans. Software Eng..

[159]  Kjetil Moløkken-Østvold,et al.  A review of software surveys on software effort estimation , 2003, 2003 International Symposium on Empirical Software Engineering, 2003. ISESE 2003. Proceedings..

[160]  Sophie Cockcroft Estimating CASE development size from outline specifications , 1996, Inf. Softw. Technol..

[161]  Albert L. Lederer,et al.  Systems development and cost estimating: challenges and guidelines , 1993 .

[162]  Barry W. Boehm,et al.  Cost models for future software life cycle processes: COCOMO 2.0 , 1995, Ann. Softw. Eng..

[163]  Witold Pedrycz,et al.  Software cost estimation with fuzzy models , 2000, SIAP.

[164]  Barry W. Boehm,et al.  Software development cost estimation approaches — A survey , 2000, Ann. Softw. Eng..

[165]  Mitsuari Hakuta,et al.  A software size estimation model and its evaluation , 1997, J. Syst. Softw..

[166]  José Javier Dolado,et al.  A Validation of the Component-Based Method for Software Size Estimation , 2000, IEEE Trans. Software Eng..

[167]  Jae Kyu Lee,et al.  Quasi-optimal case-selective neural network model for software effort estimation , 2001, Expert Syst. Appl..

[168]  Chris F. Kemerer,et al.  An empirical validation of software cost estimation models , 1987, CACM.

[169]  Heeseok Lee,et al.  A structured methodology for software development effort prediction using the analytic hierarchy process , 1993, J. Syst. Softw..

[170]  Magne Jørgensen,et al.  Better sure than safe? Over-confidence in judgement based software development effort prediction intervals , 2004, J. Syst. Softw..

[171]  Christopher J. Lokan An empirical analysis of function point adjustment factors , 2000, Inf. Softw. Technol..

[172]  Joanne M. Sulek,et al.  A methodology for forecasting knowledge work projects , 2000, Comput. Oper. Res..

[173]  Keith I. Watson COCOMO as a schedule prognosis and validation tool: a case study , 2005, Software Quality Journal.

[174]  Seungjin Whang,et al.  Contracting for Software Development , 1992 .

[175]  F. N. Parr,et al.  An Alternative to the Rayleigh Curve Model for Software Development Effort , 1980, IEEE Transactions on Software Engineering.

[176]  Barry W. Boehm,et al.  Software cost modeling: Some lessons learned , 1980, J. Syst. Softw..

[177]  Isabella Wieczorek,et al.  Resource Estimation in Software Engineering , 2002 .

[178]  Shari Lawrence Pfleeger,et al.  The economics of reuse: new approaches to modelling and assessing cost , 1994, Inf. Softw. Technol..

[179]  Robert Tausworthe,et al.  The work breakdown structure in software project management , 1984, J. Syst. Softw..

[180]  Eduardo Miranda Improving Subjective Estimates Using Paired Comparisons , 2001, IEEE Softw..

[181]  Dag I. K. Sjøberg,et al.  The impact of customer expectation on software development effort estimates , 2004 .

[182]  Robert A. Fleck Managing programmer resources in a maintenance environment with function points , 1998 .

[183]  Shari Lawrence Pfleeger,et al.  Economics of reuse: issues and alternatives , 1990 .

[184]  Barbara A. Kitchenham,et al.  Estimates, Uncertainty, and Risk , 1997, IEEE Softw..

[185]  James W. Borchering,et al.  Estimeetings: Development Estimates and a Front-End Process For a Large Project , 1991, IEEE Trans. Software Eng..

[186]  David Ellison,et al.  Software cost estimation using an Albus perceptron (CMAC) , 1997, Inf. Softw. Technol..

[187]  Magne Jørgensen,et al.  Software effort estimation terminology: The tower of Babel , 2006, Inf. Softw. Technol..

[188]  Linda A. Macaulay,et al.  A Rule-Based Approach to Developing Software Development Prediction Models , 1998, Automated Software Engineering.

[189]  Stephen G. MacDonell,et al.  Industry Practices in Project Management for Multimedia Information Systems , 1999, Int. J. Softw. Eng. Knowl. Eng..

[190]  D. V. Smirnov,et al.  A Model of Estimation and Optimization of Expenditures in Multilevel Fuzzy Environments , 2004, Programming and Computer Software.

[191]  Barbara A. Kitchenham,et al.  A Procedure for Analyzing Unbalanced Datasets , 1998, IEEE Trans. Software Eng..

[192]  Vojislav B. Misic,et al.  Cost estimation based on business models , 1999, J. Syst. Softw..

[193]  Vojislav B. Misic,et al.  Estimation of effort and complexity: An object-oriented case study , 1998, J. Syst. Softw..

[194]  Luiz A. Laranjeira Software Size Estimation of Object-Oriented Systems , 1990, IEEE Trans. Software Eng..

[195]  Watts S. Humphrey,et al.  Predicting (Individual) Software Productivity , 1991, IEEE Trans. Software Eng..

[196]  Vincent Yun Shen,et al.  Software Effort Estimation and Productivity , 1985, Adv. Comput..

[197]  Paolo Nesi,et al.  Effort estimation and prediction of object-oriented systems , 1998, J. Syst. Softw..

[198]  Gavin R. Finnie,et al.  Estimating software development effort with connectionist models , 1997, Inf. Softw. Technol..

[199]  Thomas E. Reeves,et al.  A technique for function block counting , 2001, J. Syst. Softw..

[200]  Roger D. H. Warburton Managing and Predicting the Costs of Real-Time Software , 1983, IEEE Transactions on Software Engineering.

[201]  Magne Jørgensen,et al.  A review of studies on expert estimation of software development effort , 2004, J. Syst. Softw..

[202]  Ray Dawson,et al.  Whole Life Cost: The Future Trend in Software Development , 1999, Software Quality Journal.

[203]  Trevor T. Moores Developing a software size model for rule-based systems: a case study , 2001, Expert Syst. Appl..

[204]  William M. Evanco,et al.  Modeling the effort to correct faults , 1995, J. Syst. Softw..

[205]  Barbara A. Kitchenham,et al.  Modeling Software Bidding Risks , 2003, IEEE Trans. Software Eng..

[206]  June M. Verner,et al.  Estimating size and effort in fourth-generation development , 1988, IEEE Software.

[207]  N. Nakagawa,et al.  Method to estimate parameter values in software prediction models , 1991 .

[208]  Magne Jørgensen,et al.  Experience With the Accuracy of Software Maintenance Task Effort Prediction Models , 1995, IEEE Trans. Software Eng..

[209]  Hoang Pham,et al.  A quasi-renewal process for software reliability and testing costs , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[210]  Sefer Kurnaz,et al.  Adapting Function Point Analysis to Object Oriented Systems , 2002 .

[211]  D. Ross Jeffery,et al.  An Empirical Study of Analogy-based Software Effort Estimation , 1999, Empirical Software Engineering.

[212]  Emilia Mendes,et al.  Comparison of Web size measures for predicting Web design and authoring effort , 2002, IEE Proc. Softw..

[213]  Kishore Sengupta,et al.  The impact of unreliable information on the management of software projects: a dynamic decision perspective , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[214]  Kaushal K. Shukla,et al.  Neuro-genetic prediction of software development effort , 2000, Inf. Softw. Technol..

[215]  Richard L. Jenson,et al.  Parametric estimation of programming effort: An object-oriented model , 1991, J. Syst. Softw..

[216]  Jean-Marc Desharnais,et al.  A comparison of software effort estimation techniques: Using function points with neural networks, case-based reasoning and regression models , 1997, J. Syst. Softw..

[217]  J. P. Lewis Limits to software estimation , 2001, SOEN.

[218]  Soumitra Dutta,et al.  Software Development Productivity of European Space, Military, and Industrial Applications , 1996, IEEE Trans. Software Eng..

[219]  Qing Hu Evaluating Alternative Software Production Functions , 1997, IEEE Trans. Software Eng..

[220]  Michael Philippsen,et al.  A controlled experiment on inheritance depth as a cost factor for code maintenance , 2003, J. Syst. Softw..

[221]  Michael J. Prietula,et al.  Software-Effort Estimation: An Exploratory Study of Expert Performance , 1991, Inf. Syst. Res..

[222]  B. Stewart Predicting project delivery rates using the Naive-Bayes classifier , 2002, J. Softw. Maintenance Res. Pract..

[223]  Albert L. Lederer,et al.  A Causal Model for Software Cost Estimating Error , 1998, IEEE Trans. Software Eng..

[224]  Michael J. Prietula,et al.  Examining the Feasibility of a Case-Based Reasoning Model for Software Effort Estimation , 1992, MIS Q..

[225]  Barbara A. Kitchenham,et al.  Software project development cost estimation , 1985, J. Syst. Softw..

[226]  Arnaldo Dias Belchior,et al.  Fuzzy Modeling for Function Points Analysis , 2003, Software Quality Journal.

[227]  Terry Connolly,et al.  Decomposed versus holistic estimates of effort required for software writing tasks , 1997 .

[228]  Ho Leung Tsoi,et al.  Modelling the probabilistic behaviour of function point analysis , 1998, Inf. Softw. Technol..

[229]  Justus D. Naumann,et al.  Empirical investigation of systems development practices and results , 1984, Inf. Manag..

[230]  Waldemar Czuchra Optimizing budget spendings for software implementation and testing , 1999, Comput. Oper. Res..

[231]  Shari Lawrence Pfleeger,et al.  An empirical study of maintenance and development estimation accuracy , 2002, J. Syst. Softw..

[232]  June M. Verner,et al.  A Software Size Model , 1992, IEEE Trans. Software Eng..

[233]  Sallie Keller-McNulty,et al.  Stochastic models for software science , 1991, J. Syst. Softw..

[234]  Souheil Khaddaj,et al.  Construction of an FPA-type metric for early lifecycle estimation , 1998, Inf. Softw. Technol..

[235]  Gil-Jo Kim,et al.  Optimal schedule and effort considering the penalty cost of schedule delay in software development , 2000, Int. J. Syst. Sci..

[236]  June M. Verner,et al.  Software sizing and costing models: a survey of empirical validation and comparison studies , 1990, J. Inf. Technol..

[237]  Peter K. Oriogun A Survey of Boehm's Work on the Spiral Models and COCOMO II—Towards Software Development Process Quality Improvement , 2004, Software Quality Journal.

[238]  Soumitra Dutta,et al.  Performance Evaluation of General and Company Specific Models in Software Development Effort Estimation , 1999 .

[239]  Miguel Toro,et al.  A simplified model of software project dynamics , 2001, J. Syst. Softw..

[240]  Gavin R. Finnie,et al.  Using Artificial Neural Networks and Function Points to Estimate 4GL Software Development Effort , 1994, Australas. J. Inf. Syst..

[241]  Khaled El Emam,et al.  Software Cost Estimation with Incomplete Data , 2001, IEEE Trans. Software Eng..

[242]  Albert L. Lederer,et al.  Information systems software cost estimating: a current assessment , 1993, J. Inf. Technol..

[243]  Stephen G. MacDonell Software source code sizing using fuzzy logic modeling , 2003, Inf. Softw. Technol..

[244]  Stephen G. MacDonell,et al.  A comparison of techniques for developing predictive models of software metrics , 1997, Inf. Softw. Technol..

[245]  Lutz Prechelt,et al.  An Experiment Measuring the Effects of Personal Software Process (PSP) Training , 2001, IEEE Trans. Software Eng..

[246]  Michiel van Genuchten,et al.  Why is Software Late? An Empirical Study of Reasons For Delay in Software Development , 1991, IEEE Trans. Software Eng..

[247]  Barry W. Boehm,et al.  Understanding and Controlling Software Costs , 1988, IEEE Trans. Software Eng..

[248]  Malcolm J. Morgan,et al.  Controlling Software Development Costs , 1994 .

[249]  Barbara A. Kitchenham,et al.  A Simulation Study of the Model Evaluation Criterion MMRE , 2003, IEEE Trans. Software Eng..

[250]  Michael J. Prietula,et al.  Software-effort estimation with a case-based reasoner , 1996, J. Exp. Theor. Artif. Intell..

[251]  R. Marwane,et al.  Building tailor-made software cost model: intermediate TUCOMO , 1991 .

[252]  John Moses,et al.  A Procedure for Assessing the Influence of Problem Domain on Effort Estimation Consistency , 2003, Software Quality Journal.

[253]  Michelle Cartwright,et al.  On Building Prediction Systems for Software Engineers , 2000, Empirical Software Engineering.

[254]  Thomas E. Reeves,et al.  Function point counting: one program's experience , 2000, J. Syst. Softw..

[255]  Albert L. Lederer,et al.  The validation of a political model of information systems development cost estimating , 1991, SIGCPR '91.

[256]  Abbas Heiat,et al.  Comparison of artificial neural network and regression models for estimating software development effort , 2002, Inf. Softw. Technol..

[257]  José Javier Dolado,et al.  A Study of the Relationships among Albrecht and Mark II Function Points, Lines of Code 4GL and Effort , 1997, J. Syst. Softw..

[258]  D. Ross Jeffery,et al.  Cost Estimation : A Review of Models , Process , and Practice , 2010 .

[259]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[260]  RAY W. WOLVERTON,et al.  The Cost of Developing Large-Scale Software , 1974, IEEE Transactions on Computers.

[261]  Claude E. Walston,et al.  A Method of Programming Measurement and Estimation , 1977, IBM Syst. J..