A systematic review of web resource estimation

Background: Web development plays an important role in today's industry, so an in depth view into Web resource estimation would be valuable. However a systematic review (SR) on Web resource estimation in its entirety has not been done. Aim: The aim of this paper is to present a SR of Web resource estimation in order to define the current state of the art, and to identify any research gaps that may be present. Method: Research questions that would address the current state of the art in Web resource estimation were first identified. A comprehensive literature search was then executed resulting in the retrieval of 84 empirical studies that investigated any aspect of Web resource estimation. Data extraction and synthesis was performed on these studies with these research questions in mind. Results: We have found that there are no guidelines with regards to what resource estimation technique should be used in a particular estimation scenario, how it should be implemented, and how its effectiveness should be evaluated. Accuracy results vary widely and are dependent on numerous factors. Research has focused on development effort/cost estimation, neglecting other facets of resource estimation like quality and maintenance. Size measures have been used in all but one study as a resource predictor. Conclusions: Our results suggest that there is plenty of work to be done in the field of Web resource estimation whether it be investigating a more comprehensive approach that considers more than a single resource facet, evaluating other possible resource predictors, or trying to determine guidelines that would help simplify the process of selecting a resource estimation technique.

[1]  Emilia Mendes,et al.  The Need for Web Engineering: An Introduction , 2006, Web Engineering.

[2]  Donald J. Reifer,et al.  Web Development: Estimating Quick-to-Market Software , 2000, IEEE Softw..

[3]  P. Umbers,et al.  Resource estimation for Web applications , 2004 .

[4]  Barry W. Boehm,et al.  Achievements and Challenges in Cocomo-Based Software Resource Estimation , 2008, IEEE Software.

[5]  Stephen G. MacDonell,et al.  What accuracy statistics really measure , 2001, IEE Proc. Softw..

[6]  Donald J. Reifer Estimating Web Development Costs: There Are Differences , 2002 .

[7]  Emilia Mendes,et al.  Investigating Early Web Size Measures for Web Cost Estimation , 2005 .

[8]  M. J. Moayed,et al.  Comparing Between Web Application Effort Estimation Methods , 2007 .

[9]  David Taniar,et al.  Computational Science and Its Applications - ICCSA 2009, International Conference, Seoul, Korea, June 29-July 2, 2009, Proceedings, Part I , 2009, ICCSA.

[10]  Kiyoshi Agusa Software engineering evolution , 2004 .

[11]  Emilia Mendes A Comparison of Techniques for Web Effort Estimation , 2007, ESEM 2007.

[12]  Guilherme Horta Travassos,et al.  A systematic review of cross- vs. within- company cost estimation studies , 2006 .

[13]  Tim Menzies,et al.  On the Value of Ensemble Effort Estimation , 2012, IEEE Transactions on Software Engineering.

[14]  H. E. Dunsmore,et al.  Software engineering metrics and models , 1986 .

[15]  Emilia Mendes Predicting Web Development Effort Using a Bayesian Network , 2007, EASE.

[16]  Emilia Mendes,et al.  Using tabu search to configure support vector regression for effort estimation , 2013, Empirical Software Engineering.

[17]  Emilia Mendes A Comparison of Techniques for Web Effort Estimation , 2007, First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007).

[18]  Pearl Brereton,et al.  Evaluation and assessment in software engineering , 1997, J. Syst. Softw..

[19]  Emilia Mendes Web Cost Estimation and Productivity Benchmarking , 2008, ISSSE.

[20]  William Marsh,et al.  Making resource decisions for software projects , 2004, Proceedings. 26th International Conference on Software Engineering.

[21]  M. Petticrew,et al.  Systematic Reviews in the Social Sciences: A Practical Guide , 2005 .