Systematic Mapping Study of Ensemble Effort Estimation

Ensemble methods have been used recently for prediction in data mining area in order to overcome the weaknesses of single estimation techniques. This approach consists on combining more than one single technique to predict a dependent variable and has attracted the attention of the software development effort estimation (SDEE) community. An ensemble effort estimation (EEE) technique combines several existing single/classical models. In this study, a systematic mapping study was carried out to identify the papers based on EEE techniques published in the period 2000-2015 and classified them according to five classification criteria: research type, research approach, EEE type, single models used to construct EEE techniques, and rule used the combine single estimates into an EEE technique. Publication channels and trends were also identified. Within the 16 studies selected, homogeneous EEE techniques were the most investigated. Furthermore, the machine learning single models were the most frequently employed to construct EEE techniques and two types of combiner (linear and non-linear) have been used to get the prediction value of an ensemble.

[1]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[2]  Yong Hu,et al.  Systematic literature review of machine learning based software development effort estimation models , 2012, Inf. Softw. Technol..

[3]  Jianping Li,et al.  Linear combination of multiple case-based reasoning with optimized weight for software effort estimation , 2010, The Journal of Supercomputing.

[4]  Mahmoud O. Elish.  Improved estimation of software project effort using multiple additive regression trees , 2009, Expert Syst. Appl..

[5]  Alain Abran,et al.  A fuzzy logic based set of measures for software project similarity: validation and possible improvements , 2001, Proceedings Seventh International Software Metrics Symposium.

[6]  Xin Yao,et al.  The impact of parameter tuning on software effort estimation using learning machines , 2013, PROMISE.

[7]  Lefteris Angelis,et al.  Using Ensembles for Web Effort Estimation , 2013, 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement.

[8]  Xin Yao,et al.  journal homepage: www.elsevier.com/locate/infsof Ensembles and locality: Insight on improving software effort estimation , 2022 .

[9]  Mahmoud O. Elish.  Assessment of voting ensemble for estimating software development effort , 2013, 2013 IEEE Symposium on Computational Intelligence and Data Mining (CIDM).

[10]  Martin J. Shepperd,et al.  Comparing Software Prediction Techniques Using Simulation , 2001, IEEE Trans. Software Eng..

[11]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2001, Springer Series in Statistics.

[12]  Silvio Romero de Lemos Meira,et al.  Bagging Predictors for Estimation of Software Project Effort , 2007, 2007 International Joint Conference on Neural Networks.

[13]  Ayse Basar Bener,et al.  Ensemble of neural networks with associative memory (ENNA) for estimating software development costs , 2009, Knowl. Based Syst..

[14]  Alain Abran,et al.  Software cost estimation by fuzzy analogy for web hypermedia applications , 2006 .

[15]  Ekrem Kocaguneli,et al.  Combining Multiple Learners Induced on Multiple Datasets for Software Effort Prediction , 2009 .

[16]  Leandro L. Minku,et al.  An empirical evaluation of ensemble adjustment methods for analogy-based effort estimation , 2015, J. Syst. Softw..

[17]  Kuan-Li Peng,et al.  A Study of Improving the Accuracy of Software Effort Estimation Using Linearly Weighted Combinations , 2010, 2010 IEEE 34th Annual Computer Software and Applications Conference Workshops.

[18]  Xin Yao,et al.  Software effort estimation as a multiobjective learning problem , 2013, TSEM.

[19]  Magne Jørgensen,et al.  A Systematic Review of Software Development Cost Estimation Studies , 2007, IEEE Transactions on Software Engineering.

[20]  Xin Yao,et al.  An analysis of multi-objective evolutionary algorithms for training ensemble models based on different performance measures in software effort estimation , 2013, PROMISE.

[21]  Tim Menzies,et al.  On the Value of Ensemble Effort Estimation , 2012, IEEE Transactions on Software Engineering.

[22]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[23]  Alain Abran,et al.  Investigating soft computing in case-based reasoning for software cost estimation , 2002 .

[24]  Alain Abran,et al.  Analogy-based software development effort estimation: A systematic mapping and review , 2015, Inf. Softw. Technol..

[25]  Tarek Helmy,et al.  Empirical Study of Homogeneous and Heterogeneous Ensemble Models for Software Development Effort Estimation , 2013 .

[26]  Mahil Carr,et al.  Software Cost Estimation using Soft Computing Approaches , 2010 .