A replicated assessment of the use of adaptation rules to improve Web cost estimation

Analogy-based estimation has, over the last 15 years, and particularly over the last 7 years, emerged as a promising approach with comparable accuracy to, or better than, algorithmic methods. In addition, it is potentially easier to both understand and apply; these two important factors can contribute to the successful adoption of estimation methods within Web development companies. We believe therefore, analogy-based estimation should be examined further. This paper replicates previous work that investigated the use of two types of adaptation rules as a contributing factor to better estimation accuracy. In addition, it also investigates the use of feature subset selection, in addition to adaptation rules. Two datasets are used in the analysis; results show that adaptation rules improved estimation accuracy for the less "messy" dataset. Feature subset selection also seems to help improve the adaptation results.

[1]  D. Ross Jeffery,et al.  An Empirical Study of Analogy-based Software Effort Estimation , 1999, Empirical Software Engineering.

[2]  Emilia Mendes,et al.  Investigating Early Web Size Measures for Web Cost Estimation , 2005 .

[3]  Ingunn Myrtveit,et al.  Assessing the benefits of imputing ERP projects with missing data , 2001, Proceedings Seventh International Software Metrics Symposium.

[4]  Lionel C. Briand,et al.  A replicated assessment and comparison of common software cost modeling techniques , 2000, Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium.

[5]  Lawrence H. Putnam,et al.  A General Empirical Solution to the Macro Software Sizing and Estimating Problem , 1978, IEEE Transactions on Software Engineering.

[6]  Lionel C. Briand,et al.  Resource modeling in software engineering , 2002 .

[7]  Donald J. Reifer,et al.  Web Development: Estimating Quick-to-Market Software , 2000, IEEE Softw..

[8]  Jeffrey C. Carver,et al.  Replicating software engineering experiments: addressing the tacit knowledge problem , 2002, Proceedings International Symposium on Empirical Software Engineering.

[9]  Adrian Cowderoy.  Measures of size and complexity for web-site content , 2000 .

[10]  Isabella Wieczorek,et al.  Resource Estimation in Software Engineering , 2002 .

[11]  Martin Shepperd,et al.  Using Simulation to Evaluate Prediction Techniques , 2001 .

[12]  Ioannis Stamelos,et al.  A Simulation Tool for Efficient Analogy Based Cost Estimation , 2000, Empirical Software Engineering.

[13]  Michelle Cartwright,et al.  Issues on the Effective Use of CBR Technology for Software Project Prediction , 2001, ICCBR.

[14]  Martin Shepperd,et al.  Case and Feature Subset Selection in Case-Based Software Project Effort Prediction , 2003 .

[15]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[16]  Emilia Mendes,et al.  Do adaptation rules improve web cost estimation? , 2003, HYPERTEXT '03.

[17]  Stephen G. MacDonell,et al.  Factors systematically associated with errors in subjective estimates of software development effort: the stability of expert judgment , 1999, Proceedings Sixth International Software Metrics Symposium (Cat. No.PR00403).

[18]  Emilia Mendes,et al.  An Empirical Analysis of Linear Adaptation Techniques for Case-Based Prediction , 2003, ICCBR.

[19]  Emilia Mendes,et al.  A comparison of development effort estimation techniques for Web hypermedia applications , 2002, Proceedings Eighth IEEE Symposium on Software Metrics.

[20]  Barbara A. Kitchenham,et al.  A Further Empirical Investigation of the Relationship Between MRE and Project Size , 2003, Empirical Software Engineering.

[21]  Martin J. Shepperd,et al.  Search Heuristics, Case-based Reasoning And Software Project Effort Prediction , 2002, GECCO.

[22]  Emilia Mendes,et al.  Web Metrics-Estimating Design and Authoring Effort , 2001, IEEE Multim..

[23]  Emilia Mendes,et al.  Further investigation into the use of CBR and stepwise regression to predict development effort for Web hypermedia applications , 2002, Proceedings International Symposium on Empirical Software Engineering.