A Review of Open Source Software Maintenance Effort Estimation

Open Source Software (OSS) is gaining interests of software engineering community as well as practitioners from industry with the growth of the internet. Studies in estimating maintenance effort (MEE) of such software product have been published in the literature in order to provide better estimation. The aim of this study is to provide a review of studies related to maintenance effort estimation for open source software (OSSMEE). To this end, a set of 60 primary empirical studies are selected from six electronic databases and a discussion is provided according to eight research questions (RQs) related to: publication year, publication source, datasets (OSS projects), metrics (independent variables), techniques, maintenance effort (dependent variable), validation methods, and accuracy criteria used in the empirical validation. This study has found that popular OSS projects have been used, Linear Regression, Naïve Bayes and k Nearest Neighbors were frequently used, and bug resolution was the most used regarding the estimation of maintenance effort for the future releases. A set of gaps are identified and recommendations for researchers are also provided.

[1]  Franz Wotawa,et al.  Mining effort data from the OSS repository of developer's bug fix activity , 2016 .

[2]  Ashish Sureka,et al.  Mining Peer Code Review System for Computing Effort and Contribution Metrics for Patch Reviewers , 2014, 2014 IEEE 4th Workshop on Mining Unstructured Data.

[3]  Marlon Dumas,et al.  Code churn estimation using organisational and code metrics: An experimental comparison , 2012, Inf. Softw. Technol..

[4]  Massimo Bilancia,et al.  Predicting Bug-Fix Time: Using Standard Versus Topic-Based Text Categorization Techniques , 2016, DS.

[5]  Ayse Basar Bener,et al.  On the Use of Hidden Markov Model to Predict the Time to Fix Bugs , 2018, IEEE Transactions on Software Engineering.

[6]  Austin Melton,et al.  Using indirect coupling metrics to predict package maintainability and testability , 2016, J. Syst. Softw..

[7]  Hui Liu,et al.  Emotion Based Automated Priority Prediction for Bug Reports , 2018, IEEE Access.

[8]  Barry W. Boehm,et al.  COSMIC Function Points Evaluation for Software Maintenance , 2018, ISEC.

[9]  R. K. Singh,et al.  Multiattribute Based Machine Learning Models for Severity Prediction in Cross Project Context , 2014, ICCSA.

[10]  H. S. Hota,et al.  Time Series Data Prediction Using Sliding Window Based RBF Neural Network , 2017 .

[11]  Rong Chen,et al.  Ensemble Data Reduction Techniques and Multi-RSMOTE via Fuzzy Integral for Bug Report Classification , 2018, IEEE Access.

[12]  Pasquale Ardimento,et al.  Knowledge extraction from on-line open source bug tracking systems to predict bug-fixing time , 2017, WIMS.

[13]  Opim Salim Sitompul,et al.  Biased support vector machine and weighted-smote in handling class imbalance problem , 2018 .

[14]  Barry W. Boehm,et al.  Maintenance Effort Estimation for Open Source Software: A Systematic Literature Review , 2016, 2016 IEEE International Conference on Software Maintenance and Evolution (ICSME).

[15]  Meera Sharma,et al.  Developing Prediction Models to Assist Software Developers and Support Managers , 2017, ICCSA.

[16]  Ali Idri,et al.  Towards a Taxonomy of Software Maintainability Predictors , 2019, WorldCIST.

[17]  Iulian Neamtiu,et al.  Assessing programming language impact on development and maintenance: a study on c and c++ , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[18]  Leandro L. Minku,et al.  An empirical evaluation of ensemble adjustment methods for analogy-based effort estimation , 2015, J. Syst. Softw..

[19]  Norman F. Schneidewind,et al.  The State of Software Maintenance , 1987, IEEE Transactions on Software Engineering.

[20]  Liguo Yu.  Indirectly predicting the maintenance effort of open-source software , 2006, J. Softw. Maintenance Res. Pract..

[21]  Alain Abran,et al.  Systematic literature review of ensemble effort estimation , 2016, J. Syst. Softw..

[22]  Vu Nguyen,et al.  Improved size and effort estimation models for software maintenance , 2010, 2010 IEEE International Conference on Software Maintenance.

[23]  Yasutaka Kamei,et al.  Is lines of code a good measure of effort in effort-aware models? , 2013, Inf. Softw. Technol..

[24]  Akito Monden,et al.  Revisiting common bug prediction findings using effort-aware models , 2010, 2010 IEEE International Conference on Software Maintenance.

[25]  Hongyu Zhang,et al.  Predicting defect numbers based on defect state transition models , 2012, Proceedings of the 2012 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement.

[26]  M. Xie,et al.  A model of open source software maintenance activities , 2009, 2009 IEEE International Conference on Industrial Engineering and Engineering Management.

[27]  Hajimu Iida,et al.  Micro process analysis of maintenance effort: an open source software case study using metrics based on program slicing , 2013, J. Softw. Evol. Process..

[29]  Chiara Francalanci,et al.  The Economics of Open Source Software: An Empirical Analysis of Maintenance Costs , 2007, 2007 IEEE International Conference on Software Maintenance.