Does the linear size adjustment to estimated effort improve web applications effort estimation accuracy?

Over the last 16 years, and particularly over the last 8 years, Analogy-based effort estimation has been used to estimate effort for software projects and in several studies has presented comparable estimation accuracy to, or better than, algorithmic methods. The Analogy technique is also potentially easier to understand and apply by both researchers and practitioners. These two factors suggest that this technique has great potential as an effort estimation technique to be used within Companies. However, there are still several challenges, in particular regarding the type of effort adaptation to use in order to obtain the highest prediction accuracy, that need further investigation. Therefore this paper compares several methods of Analogy-based effort estimation and investigates the use of adaptation rules as a contributing factor to better estimation accuracy. Two datasets are used in the analysis; results show that the best predictions are obtained for the dataset that first, presents a continuous "cost" function, translated as a strong linear relationship between size and effort, and second, is more "intact" in terms of outliers and collinearity. Only one of the two types of adaptation rules employed generated good predictions.

[1]  Barbara A. Kitchenham,et al.  A Further Empirical Investigation of the Relationship Between MRE and Project Size , 2003, Empirical Software Engineering.

[2]  Ben Shneiderman,et al.  Structural analysis of hypertexts: identifying hierarchies and useful metrics , 1992, TOIS.

[3]  Stefan Schulz CBR-Works A State-of-the-Art Shell for Case-Based Application Building , 1999 .

[4]  Albert L. Lederer,et al.  Information systems software cost estimating: a current assessment , 1993, J. Inf. Technol..

[5]  Ioannis Stamelos,et al.  A Simulation Tool for Efficient Analogy Based Cost Estimation , 2000, Empirical Software Engineering.

[6]  Michelle Cartwright,et al.  Issues on the Effective Use of CBR Technology for Software Project Prediction , 2001, ICCBR.

[7]  D. Ross Jeffery,et al.  Calibrating estimation tools for software development , 1990, Softw. Eng. J..

[8]  D. Ross Jeffery,et al.  Using public domain metrics to estimate software development effort , 2001, Proceedings Seventh International Software Metrics Symposium.

[9]  Scott W. Ambler,et al.  Lessons in Agility From Internet-Based Development , 2002, IEEE Softw..

[10]  Martin J. Shepperd,et al.  Comparing Software Prediction Techniques Using Simulation , 2001, IEEE Trans. Software Eng..

[11]  Lionel C. Briand,et al.  A replicated assessment and comparison of common software cost modeling techniques , 2000, Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium.

[12]  D. Ross Jeffery,et al.  A comparative study of two software development cost modeling techniques using multi-organizational and company-specific data , 2000, Inf. Softw. Technol..

[13]  Martin J. Shepperd,et al.  Estimating Software Project Effort Using Analogies , 1997, IEEE Trans. Software Eng..

[14]  Ingunn Myrtveit,et al.  A Controlled Experiment to Assess the Benefits of Estimating with Analogy and Regression Models , 1999, IEEE Trans. Software Eng..

[15]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[16]  Emilia Mendes,et al.  A comparison of case-based reasoning approaches , 2002, WWW '02.

[17]  Adrian J. C. Cowderoy,et al.  A metrics framework for multimedia creation , 1998, Proceedings Fifth International Software Metrics Symposium. Metrics (Cat. No.98TB100262).

[18]  Ivar Jacobson,et al.  The Unified Modeling Language User Guide , 1998, J. Database Manag..

[19]  H. E. Dunsmore,et al.  Software engineering metrics and models , 1986 .

[20]  D. Ross Jeffery,et al.  An Empirical Study of Analogy-based Software Effort Estimation , 1999, Empirical Software Engineering.

[21]  Lionel C. Briand,et al.  An assessment and comparison of common software cost estimation modeling techniques , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[22]  Chris F. Kemerer,et al.  An empirical validation of software cost estimation models , 1987, CACM.

[23]  Watts S. Humphrey,et al.  A discipline for software engineering , 2012, Series in software engineering.

[24]  Stephen G. MacDonell,et al.  Factors systematically associated with errors in subjective estimates of software development effort: the stability of expert judgment , 1999, Proceedings Sixth International Software Metrics Symposium (Cat. No.PR00403).

[25]  Donald J. Reifer,et al.  Web Development: Estimating Quick-to-Market Software , 2000, IEEE Softw..

[26]  R. S. Pressman,et al.  What a tangled Web we weave [Web engineering] , 2000 .

[27]  Emilia Mendes,et al.  Web Metrics-Estimating Design and Authoring Effort , 2001, IEEE Multim..

[28]  Emilia Mendes,et al.  A Comparative Study of Cost Estimation Models for Web Hypermedia Applications , 2003, Empirical Software Engineering.

[29]  Lawrence H. Putnam,et al.  A General Empirical Solution to the Macro Software Sizing and Estimating Problem , 1978, IEEE Transactions on Software Engineering.

[30]  Emilia Mendes,et al.  Measurement and Effort Prediction for Web Applications , 2001, Web Engineering.

[31]  Seishi Okamoto,et al.  An Average-Case Analysis of k-Nearest Neighbor Classifier , 1995, ICCBR.

[32]  Donald J. Reifer Ten Deadly Risks in Internet and Intranet Software Development , 2002, IEEE Softw..