Is there a place for qualitative studies when identifying effort predictors?: a case in web effort estimation

Background: Effort estimation is the key for efficiently managing Web projects and achieving their success. In order to correctly estimate, it is necessary to have a broad knowledge of the factors that influence effort estimation in Web projects. Aim: In this research we aim to increase the understanding of Web effort estimation by using a set of factors identified in literature along with the knowledge from experts in effort estimation. Method: We have gathered data from two different sources: (a) our previous work, in which we applied Grounded Theory procedures to identify factors that influence Web effort estimation from the point of view of Web project estimation experts; and (b) a Systematic Literature Review (SLR) extension, in which we identified factors reported in research papers. We have used the qualitative results from these sources to make comparisons and draw conclusions on factors affecting Web effort estimation. Results: We identified a total of 90 factors that influence effort estimation in Web projects. From this set, 30 factors were identified only in the qualitative study with experts in effort estimation, not being present in the SLR extension. Conclusions: By integrating the factors found in both our qualitative study with effort estimation experts and the SLR extension, we managed to create a comprehensive list of factors influencing effort estimation. Also, this set can be a starting point in the proposal of effort estimation models. Finally, the results from our comparison can be considered an indication that it is necessary to increase the employment of qualitative research to capture evidences regarding the current state of practice in Software Engineering.

[1]  Emilia Mendes,et al.  Exploring case-based reasoning for web hypermedia project cost estimation , 2005, Int. J. Web Eng. Technol..

[2]  Emilia Mendes,et al.  A Comparative Study of Cost Estimation Models for Web Hypermedia Applications , 2003, Empirical Software Engineering.

[3]  Carolyn B. Seaman,et al.  Qualitative Methods in Empirical Studies of Software Engineering , 1999, IEEE Trans. Software Eng..

[4]  Emilia Mendes.  Investigating metrics for a development effort prediction model of Web applications , 2000, Proceedings 2000 Australian Software Engineering Conference.

[5]  Emilia Mendes,et al.  Early Web size measures and effort prediction for Web costimation , 2003, Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No.03EX717).

[6]  Emilia Mendes,et al.  A Comparison of Case-Based Reasoning Approaches to Web Hypermedia Project Cost Estimation , 2002, WWW 2002.

[7]  Emilia Mendes,et al.  A comparison of case-based reasoning approaches , 2002, WWW '02.

[8]  Emilia Mendes,et al.  Towards the prediction of development effort for web applications , 2000, HYPERTEXT '00.

[9]  Emilia Mendes.  The Use of a Bayesian Network for Web Effort Estimation , 2007, ICWE.

[10]  Emilia Mendes.  Web Cost Estimation and Productivity Benchmarking , 2008, ISSSE.

[11]  Emilia Mendes.  Using Expert-based Bayesian Networks as Decision Support Systems to Improve Project Management of Healthcare Software Projects , 2013, ICSOFT.

[12]  Emilia Mendes,et al.  A comparison of development effort estimation techniques for Web hypermedia applications , 2002, Proceedings Eighth IEEE Symposium on Software Metrics.

[13]  Guilherme Horta Travassos,et al.  Improving a Web Usability Inspection Technique Using Qualitative and Quantitative Data from an Observational Study , 2009, 2009 XXIII Brazilian Symposium on Software Engineering.

[14]  Emilia Mendes,et al.  Using an engineering approach to understanding and predicting Web authoring and design , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[15]  Sergio F. Ochoa,et al.  Estimating the development effort of Web projects in Chile , 2003, Proceedings of the IEEE/LEOS 3rd International Conference on Numerical Simulation of Semiconductor Optoelectronic Devices (IEEE Cat. No.03EX726).

[16]  Emilia Mendes,et al.  Comparing effort prediction models for Web design and authoring using boxplots , 2001, Proceedings 24th Australian Computer Science Conference. ACSC 2001.

[17]  Emilia Mendes,et al.  Further comparison of cross-company and within-company effort estimation models for Web applications , 2004 .

[18]  Barbara Kitchenham,et al.  A comparison of cross-company and within-company effort estimation models for Web applications , 2004, ICSE 2004.

[19]  Emilia Mendes,et al.  Software process improvement success factors for small and medium Web companies: A qualitative study , 2012, Inf. Softw. Technol..

[20]  Emilia Mendes,et al.  Towards the prediction of development effort for hypermedia applications , 2001, Hypertext.

[21]  Emilia Mendes,et al.  Measurement and Effort Prediction for Web Applications , 2001, Web Engineering.

[22]  Filomena Ferrucci,et al.  An Empirical Study on the Use of Web-COBRA and Web Objects to Estimate Web Application Development Effort , 2009, ICWE.

[23]  Emilia Mendes,et al.  Aggregating Expert-Driven Causal Maps for Web Effort Estimation , 2010, FGIT-ASEA.

[24]  Emilia Mendes,et al.  Measures and Techniques for Effort Estimation of Web Applications: an Empirical Study Based on a Single-Company Dataset , 2009, J. Web Eng..

[25]  J. Hart.  [Qualitative methods]. , 2000, Recherche en soins infirmiers.

[26]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[27]  Emilia Mendes,et al.  Web hypermedia cost estimation: further assessment and comparison off cost estimation modelling techniques , 2002, New Rev. Hypermedia Multim..

[28]  Davi Viana,et al.  The influence of human aspects on software process improvement: Qualitative research findings and comparison to previous studies , 2012, EASE.

[29]  Emilia Mendes,et al.  The application of case-based reasoning to early Web project cost estimation , 2002, Proceedings 26th Annual International Computer Software and Applications.

[30]  Emilia Mendes,et al.  Effort estimation: how valuable is it for a web company to use a cross-company data set, compared to using its own single-company data set? , 2007, WWW '07.

[31]  Luciano Baresi,et al.  Estimating the design effort of Web applications , 2003, Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No.03EX717).

[32]  Emilia Mendes,et al.  Web Metrics-Estimating Design and Authoring Effort , 2001, IEEE Multim..

[33]  Tayana Conte,et al.  Realising web effort estimation: a qualitative investigation , 2013, EASE '13.

[34]  Emilia Mendes,et al.  Applying Knowledge Elicitation to Improve Web Effort Estimation: A Case Study , 2012, 2012 IEEE 36th Annual Computer Software and Applications Conference.

[35]  Filomena Ferrucci,et al.  Estimating Web Application Development Effort Using Web-COBRA and COSMIC: An Empirical Study , 2009, 2009 35th Euromicro Conference on Software Engineering and Advanced Applications.

[36]  D. Ross Jeffery,et al.  Using Web objects for estimating software development effort for Web applications , 2003, Proceedings. 5th International Workshop on Enterprise Networking and Computing in Healthcare Industry (IEEE Cat. No.03EX717).

[37]  Emilia Mendes,et al.  Comparison of Web size measures for predicting Web design and authoring effort , 2002, IEE Proc. Softw..

[38]  Emilia Mendes.  Predicting Web Development Effort Using a Bayesian Network , 2007, EASE.

[39]  Douglas Cunliffe Daniel Tudhope,et al.  The New Review of Hypermedia and Multimedia , 1995 .

[40]  D. Ross Jeffery,et al.  Cost estimation for web applications , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[41]  Ioannis Stamelos,et al.  Measuring functionality and productivity in Web-based applications: a case study , 1999, Proceedings Sixth International Software Metrics Symposium (Cat. No.PR00403).

[42]  Emilia Mendes,et al.  A Comparison of Length , Complexity and Functionality as Size Measures for Predicting Web Design and Authoring Effort , 2001 .

[43]  Emilia Mendes,et al.  A systematic review of web resource estimation , 2012, PROMISE '12.

[44]  Emilia Mendes,et al.  Investigating Web size metrics for early Web cost estimation , 2005, J. Syst. Softw..

[45]  Donald J. Reifer,et al.  Web Development: Estimating Quick-to-Market Software , 2000, IEEE Softw..

[46]  P. Umbers,et al.  Resource estimation for Web applications , 2004 .

[47]  Naveen Aggarwal,et al.  Web hypermedia content management system effort estimation model , 2009, SOEN.

[48]  Emilia Mendes.  Using knowledge elicitation to improve Web effort estimation: Lessons from six industrial case studies , 2012, 2012 34th International Conference on Software Engineering (ICSE).

[49]  Janice Singer,et al.  Guide to Advanced Empirical Software Engineering , 2007 .

[50]  Emilia Mendes,et al.  A replicated assessment of the use of adaptation rules to improve Web cost estimation , 2003, 2003 International Symposium on Empirical Software Engineering, 2003. ISESE 2003. Proceedings..

[51]  Emilia Mendes,et al.  Web development effort estimation using analogy , 2000, Proceedings 2000 Australian Software Engineering Conference.