Measures and Techniques for Effort Estimation of Web Applications: an Empirical Study Based on a Single-Company Dataset

Effort estimation is a key management activity which goes on throughout a software project being fundamental for accurate project planning and for allocating resources adequately. Thus, it is important to identify techniques and measures that can support such project management activity during the development of Web applications. To this aim, empirical investigations should be performed using data coming from the industrial world. To address this issue, this paper reports on an empirical study based on data from 15 Web applications developed by an Italian software company. The objective of the study was two-fold. The first goal was to verify whether or not some size measures were good indicators of the effort spent to develop the Web applications taken into account. The second goal was to compare the effectiveness of some techniques to establish the relationships between the employed size measures and the development effort of the Web applications. The measures were organized in two sets, where the first one included some length measures while the second one consisted of the nine components which are used to estimate the Web Objects measure. The techniques taken into account were Stepwise Regression, Case-Based Reasoning, and Regression Tree. The results indicated that both the sets of size measures were good indicators of the effort for the analyzed dataset. Furthermore, the analysis also revealed that the first set presented significantly superior performance than the second set when using Stepwise Regression. No significant differences between the two sets of size measures were highlighted when using Case-Based Reasoning and Regression Tree.

[1]  Tore Dybå,et al.  An empirical investigation on factors affecting software developer acceptance and utilization of electronic process guides , 2004 .

[2]  L. A. Merkle,et al.  Using factor analysis to identify neuromuscular synergies during treadmill walking , 1998, Journal of Neuroscience Methods.

[3]  Emilia Mendes,et al.  Effort estimation: how valuable is it for a web company to use a cross-company data set, compared to using its own single-company data set? , 2007, WWW '07.

[4]  Donald J. Reifer,et al.  Web Development: Estimating Quick-to-Market Software , 2000, IEEE Softw..

[5]  Shari Lawrence Pfleeger,et al.  Preliminary Guidelines for Empirical Research in Software Engineering , 2002, IEEE Trans. Software Eng..

[6]  Alain Abran,et al.  Fuzzy Analogy: A New Approach for Software Cost Estimation , 2001 .

[7]  P. Umbers,et al.  Resource estimation for Web applications , 2004 .

[8]  Genny Tortora,et al.  Effort estimation modeling techniques: a case study for web applications , 2006, ICWE '06.

[9]  Tore Dybå,et al.  An empirical investigation of the key factors for success in software process improvement , 2005, IEEE Transactions on Software Engineering.

[10]  Emilia Mendes,et al.  Towards a Taxonomy of Hypermedia and Web Application Size Metrics , 2005, ICWE.

[11]  Luciano Baresi,et al.  Estimating the design effort of Web applications , 2003, Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No.03EX717).

[12]  Marvin V. Zelkowitz,et al.  Experimental Models for Validating Technology , 1998, Computer.

[13]  Barbara A. Kitchenham,et al.  A Procedure for Analyzing Unbalanced Datasets , 1998, IEEE Trans. Software Eng..

[14]  Tore Dybå,et al.  A systematic review of effect size in software engineering experiments , 2007, Inf. Softw. Technol..

[15]  H. E. Dunsmore,et al.  Software engineering metrics and models , 1986 .

[16]  Ioannis Stamelos,et al.  Measuring functionality and productivity in Web-based applications: a case study , 1999, Proceedings Sixth International Software Metrics Symposium (Cat. No.PR00403).

[17]  Martin J. Shepperd,et al.  Estimating Software Project Effort Using Analogies , 1997, IEEE Trans. Software Eng..

[18]  Ingunn Myrtveit,et al.  A Controlled Experiment to Assess the Benefits of Estimating with Analogy and Regression Models , 1999, IEEE Trans. Software Eng..

[19]  Emilia Mendes,et al.  Further comparison of cross-company and within-company effort estimation models for Web applications , 2004 .

[20]  Khaled El Emam A Primer on Object-Oriented Measurement , 2001, IEEE METRICS.

[21]  Jim Conallen,et al.  Building Web applications with UML , 1999 .

[22]  Taghi M. Khoshgoftaar,et al.  The Detection of Fault-Prone Programs , 1992, IEEE Trans. Software Eng..

[23]  Ross Jeffery,et al.  Function point sizing: Structure, validity and applicability , 2004, Empirical Software Engineering.

[24]  Martin Shepperd,et al.  Using Simulation to Evaluate Prediction Techniques , 2001 .

[25]  D. Ross Jeffery,et al.  Using Web objects for estimating software development effort for Web applications , 2003, Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No.03EX717).

[26]  Elizabeth A. Peck,et al.  Introduction to Linear Regression Analysis , 2001 .

[27]  Genny Tortora,et al.  A COSMIC-FFP Based Method to Estimate Web Application Development Effort , 2004, ICWE.

[28]  Barbara A. Kitchenham,et al.  A Further Empirical Investigation of the Relationship Between MRE and Project Size , 2003, Empirical Software Engineering.

[29]  Emilia Mendes,et al.  Early Web size measures and effort prediction for Web costimation , 2003, Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No.03EX717).

[30]  Lionel C. Briand,et al.  A replicated assessment and comparison of common software cost modeling techniques , 2000, Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium.

[31]  Ragnar Westerling,et al.  The structure of quality systems is important to the process and outcome, an empirical study of 386 hospital departments in Sweden , 2007, BMC Health Services Research.

[32]  Adam A. Porter,et al.  Empirical studies of software engineering: a roadmap , 2000, ICSE '00.

[33]  Emilia Mendes,et al.  A replicated assessment of the use of adaptation rules to improve Web cost estimation , 2003, 2003 International Symposium on Empirical Software Engineering, 2003. ISESE 2003. Proceedings..

[34]  Stephen G. MacDonell,et al.  What accuracy statistics really measure , 2001, IEE Proc. Softw..

[35]  Agnar Aamodt,et al.  Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches , 1994, AI Commun..

[36]  R. Cook Detection of influential observation in linear regression , 2000 .

[37]  Oscar Pastor,et al.  Evaluating a functional size measurement method for Web applications: an empirical analysis , 2004 .

[38]  B. Kitchenham,et al.  Case Studies for Method and Tool Evaluation , 1995, IEEE Softw..

[39]  Barbara A. Kitchenham,et al.  Effort estimation using analogy , 1996, Proceedings of IEEE 18th International Conference on Software Engineering.

[40]  D. Ross Jeffery,et al.  An Empirical Study of Analogy-based Software Effort Estimation , 1999, Empirical Software Engineering.

[41]  Emilia Mendes,et al.  Comparison of Web size measures for predicting Web design and authoring effort , 2002, IEE Proc. Softw..

[42]  Lionel C. Briand,et al.  An assessment and comparison of common software cost estimation modeling techniques , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[43]  D. Ross Jeffery,et al.  Cost estimation for web applications , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[44]  Forrest Shull,et al.  Building Knowledge through Families of Experiments , 1999, IEEE Trans. Software Eng..

[45]  Ioannis Stamelos,et al.  Quality, Productivity, and Learning in Framework-Based Development: An Exploratory Case Study , 2002, IEEE Trans. Software Eng..

[46]  Emilia Mendes,et al.  Web Metrics-Estimating Design and Authoring Effort , 2001, IEEE Multim..

[47]  Emilia Mendes,et al.  Further investigation into the use of CBR and stepwise regression to predict development effort for Web hypermedia applications , 2002, Proceedings International Symposium on Empirical Software Engineering.

[48]  Lionel C. Briand,et al.  Modeling Development Effort in Object-Oriented Systems Using Design Properties , 2001, IEEE Trans. Software Eng..

[49]  Oscar Pastor,et al.  Measuring the functional size of web applications , 2003, Int. J. Web Eng. Technol..

[50]  Emilia Mendes,et al.  A Comparative Study of Cost Estimation Models for Web Hypermedia Applications , 2003, Empirical Software Engineering.

[51]  Victor R. Basili,et al.  A Validation of Object-Oriented Design Metrics as Quality Indicators , 1996, IEEE Trans. Software Eng..