Applying Absolute Residuals as Evaluation Criterion for Estimating the Development Time of Software Projects by Means of a Neuro-Fuzzy Approach

In the software development field, software practitioners expend between 30% and 40% more effort than is predicted. Accordingly, researchers have proposed new models for estimating the development effort such that the estimations of these models are close to actual ones. In this study, an application based on a new neurofuzzy system (NFS) is analyzed. The NFS accuracy was compared to that of a statistical multiple linear regression (MLR) model. The criterion for evaluating the accuracy of estimation models has mainly been the Magnitude of Relative Error (MRE), however, it was recently found that MRE is asymmetric, and the use of Absolute Residuals (AR) has been proposed, therefore, in this study, the accuracy results of the NFS and MLR were based on AR. After a statistical paired t-test was performed, results showed that accuracy of the NewNFS is statistically better than that of the MLR at the 99% confidence level. It can be concluded that a newNFS could be used for predicting the effort of software development projects when they have been individually developed on a disciplined process.

[1]  Magne Jørgensen,et al.  A Systematic Review of Software Development Cost Estimation Studies , 2007, IEEE Transactions on Software Engineering.

[2]  Yong Hu,et al.  Systematic literature review of machine learning based software development effort estimation models , 2012, Inf. Softw. Technol..

[3]  Phang Keat Keong,et al.  ENHANCED SOFTWARE DEVELOPMENT EFFORT AND COST ESTIMATION USING FUZZY LOGIC MODEL , 2007 .

[4]  Guilherme Horta Travassos,et al.  Cross versus Within-Company Cost Estimation Studies: A Systematic Review , 2007, IEEE Transactions on Software Engineering.

[5]  Danny Ho,et al.  Improving the COCOMO model using a neuro-fuzzy approach , 2007, Appl. Soft Comput..

[6]  Ajith Abraham,et al.  Adaptation of Fuzzy Inference System Using Neural Learning , 2005 .

[7]  Cuauhtemoc Lopez-Martin.  Predictive accuracy comparison between neural networks and statistical regression for development effort of software projects , 2015 .

[8]  Silvio Romero de Lemos Meira,et al.  An evolutionary morphological approach for software development cost estimation , 2012, Neural Networks.

[9]  Detlef Nauck,et al.  A Fuzzy Perceptron as a Generic Model for Neuro-Fuzzy Approaches , 1994 .

[10]  Lotfi A. Zadeh,et al.  From Computing with Numbers to Computing with Words - from Manipulation of Measurements to Manipulation of Perceptions , 2005, Logic, Thought and Action.

[11]  Cornelio Yáñez-Márquez,et al.  PREDICTIVE ANALYTICS USING MACHINE LEARNING Metaheuristic optimization of multivariate adaptive regression splines for predicting the schedule of software projects , 2015 .

[12]  Frederick P. Brooks,et al.  Three great challenges for half-century-old computer science , 2003, JACM.

[13]  T.C. Lethbridge,et al.  Guide to the Software Engineering Body of Knowledge (SWEBOK) and the Software Engineering Education Knowledge (SEEK) - a preliminary mapping , 2001, 10th International Workshop on Software Technology and Engineering Practice.

[14]  Qingzhong Liu,et al.  Predicting injection profiles using ANFIS , 2007, Inf. Sci..

[15]  Stephen G. MacDonell,et al.  Evaluating prediction systems in software project estimation , 2012, Inf. Softw. Technol..

[16]  Kjetil Moløkken-Østvold,et al.  A review of software surveys on software effort estimation , 2003, 2003 International Symposium on Empirical Software Engineering, 2003. ISESE 2003. Proceedings..

[17]  Watts S. Humphrey,et al.  Teaching disciplined software development , 2008, J. Syst. Softw..

[18]  E. H. Mamdani,et al.  Advances in the linguistic synthesis of fuzzy controllers , 1976 .

[19]  Barry W. Boehm,et al.  Software development cost estimation approaches — A survey , 2000, Ann. Softw. Eng..

[20]  Samarjit Kar,et al.  Applications of neuro fuzzy systems: A brief review and future outline , 2014, Appl. Soft Comput..

[21]  Michele Fedrizzi,et al.  Modelling group processes and effort estimation in project management using the Choquet integral: An MCDM approach , 2012, Expert Syst. Appl..

[22]  Sushmita Mitra,et al.  Neuro-fuzzy rule generation: survey in soft computing framework , 2000, IEEE Trans. Neural Networks Learn. Syst..

[23]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[24]  Cornelio Yáñez-Márquez,et al.  Predictive accuracy comparison of fuzzy models for software development effort of small programs , 2008, J. Syst. Softw..

[25]  M. Sugeno,et al.  Derivation of Fuzzy Control Rules from Human Operator's Control Actions , 1983 .

[26]  Teck Chaw Ling,et al.  Enhanced Software Development Effort and Cost Estimation Using Fuzzy Logic Model , 2007 .

[27]  Roger Sauter,et al.  Introduction to Probability and Statistics for Engineers and Scientists , 2005, Technometrics.

[28]  Moataz A. Ahmed,et al.  Adaptive fuzzy logic-based framework for software development effort prediction , 2005, Inf. Softw. Technol..

[29]  Watts S. Humphrey,et al.  A discipline for software engineering , 2012, Series in software engineering.

[30]  Noel Garcia-Diaz,et al.  Software development time estimation based on a new Neuro-fuzzy approach , 2015, 2015 10th Iberian Conference on Information Systems and Technologies (CISTI).

[31]  Luiz Fernando Capretz,et al.  Estimating Development Time of Software Projects Using a Neuro Fuzzy Approach , 2008 .

[32]  Sérgio Soares,et al.  A Morphological-Rank-Linear Approach for Software Development Cost Estimation , 2009, 2009 21st IEEE International Conference on Tools with Artificial Intelligence.

[33]  Taghi M. Khoshgoftaar,et al.  Identification of fuzzy models of software cost estimation , 2004, Fuzzy Sets Syst..

[34]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[35]  John P. Lewis,et al.  Large Limits to Software Estimation , 2001 .

[36]  Robert Lagerström,et al.  Identifying factors affecting software development cost and productivity , 2011, Software Quality Journal.

[37]  K. K. Aggarwal,et al.  Sensitivity analysis of fuzzy and neural network models , 2005, ACM SIGSOFT Softw. Eng. Notes.

[38]  Sérgio Soares,et al.  Hybrid morphological methodology for software development cost estimation , 2012, Expert Syst. Appl..

[39]  Brian Randell,et al.  Software engineering : report on a conference sponsored by the NATO Science Committee, Garmisch, Germany, 7th to 11th October 1968 , 1969 .

[40]  Cornelio Yáñez-Márquez,et al.  Software development effort estimation using fuzzy logic: a case study , 2005, Sixth Mexican International Conference on Computer Science (ENC'05).

[41]  Jan Jantzen,et al.  Neurofuzzy Modelling , 1998 .

[42]  Sérgio Soares,et al.  A shift-invariant morphological system for software development cost estimation , 2011, Expert Syst. Appl..