Software development effort prediction: A study on the factors impacting the accuracy of fuzzy logic systems

Reliable effort prediction remains an ongoing challenge to software engineers. Traditional approaches to effort prediction such as the use of models derived from historical data, or the use of expert opinion are plagued with issues pertaining to their effectiveness and robustness. These issues are more pronounced when the effort prediction is used during the early phases of the software development lifecycle. Recent works have demonstrated promising results obtained with the use of fuzzy logic. Fuzzy logic based effort prediction systems can deal better with imprecision, which characterizes the early phases of most software development projects, for example requirements development, whose effort predictors along with their relationships to effort are characterized as being even more imprecise and uncertain than those of later development phases, for example design. Fuzzy logic based prediction systems could produce further better estimates provided that various parameters and factors pertaining to fuzzy logic are carefully set. In this paper, we present an empirical study, which shows that the prediction accuracy of a fuzzy logic based effort prediction system is highly dependent on the system architecture, the corresponding parameters, and the training algorithms.

[1]  P. Martin Larsen,et al.  Industrial applications of fuzzy logic control , 1980 .

[2]  Martin J. Shepperd,et al.  Search Heuristics, Case-based Reasoning And Software Project Effort Prediction , 2002, GECCO.

[3]  Douglas Fisher,et al.  Machine Learning Approaches to Estimating Software Development Effort , 1995, IEEE Trans. Software Eng..

[4]  Zeeshan Muzaffar,et al.  Handling imprecision and uncertainty in software development effort prediction: A type-2 fuzzy logic based framework , 2009, Inf. Softw. Technol..

[5]  Barry W. Boehm,et al.  Calibrating the COCOMO II Post-Architecture model , 1998, Proceedings of the 20th International Conference on Software Engineering.

[6]  Moataz A. Ahmed,et al.  Adaptive fuzzy logic-based framework for software development effort prediction , 2005, Inf. Softw. Technol..

[7]  Alain Abran,et al.  COCOMO cost model using fuzzy logic , 2000 .

[8]  P. W. Garratt,et al.  A Neurofuzzy cost estimator , 1999 .

[9]  Ray Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[10]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[11]  Magne Jørgensen,et al.  A Systematic Review of Software Development Cost Estimation Studies , 2007 .

[12]  Witold Pedrycz,et al.  Software cost estimation with fuzzy models , 2000, SIAP.

[13]  Barry W. Boehm,et al.  Software development cost estimation approaches — A survey , 2000, Ann. Softw. Eng..

[14]  Barry W. Boehm,et al.  Cost models for future software life cycle processes: COCOMO 2.0 , 1995, Ann. Softw. Eng..

[15]  Liang Tian,et al.  Multistage software estimation , 2003, Proceedings of the 35th Southeastern Symposium on System Theory, 2003..

[16]  Syed Zeeshan Muzaffar Adaptive fuzzy logic based framework for handling imprecision and uncertainty in software development effort prediction models , 2006 .

[17]  H. Zimmermann,et al.  Fuzzy Set Theory and Its Applications , 1993 .

[18]  Lotfi A. Zadeh,et al.  The concept of a linguistic variable and its application to approximate reasoning-III , 1975, Inf. Sci..

[19]  Lawrence H. Putnam,et al.  A General Empirical Solution to the Macro Software Sizing and Estimating Problem , 1978, IEEE Transactions on Software Engineering.

[20]  Barry Boehm,et al.  Bayesian analysis of software cost and quality models , 1999 .

[21]  Ioannis Stamelos,et al.  Bayesian Belief Networks as a Software Productivity Estimation Tool , 2003 .

[22]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[23]  Claude E. Walston,et al.  A Method of Programming Measurement and Estimation , 1977, IBM Syst. J..

[24]  Building a software cost estimation model based on categorical data , 2001, Proceedings Seventh International Software Metrics Symposium.

[25]  Woei Tan,et al.  Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions (Mendel, J.M.; 2001) [book review] , 2007, IEEE Computational Intelligence Magazine.

[26]  M. Ahmed,et al.  Towards adaptive soft computing based software effort prediction , 2004, IEEE Annual Meeting of the Fuzzy Information, 2004. Processing NAFIPS '04..