Using knowledge elicitation to improve Web effort estimation: Lessons from six industrial case studies

This paper details our experience building and validating six different expert-based Web effort estimation models for ICT companies in New Zealand and Brazil. All models were created using Bayesian networks, via eliciting knowledge from domain experts, and validated using data from past finished projects. Post-mortem interviews with the participating companies showed that they found the entire process extremely beneficial and worthwhile, and that all the models created remained in use by those companies.

[1]  Parag C. Pendharkar,et al.  A probabilistic model for predicting software development effort , 2003, IEEE Transactions on Software Engineering.

[2]  Martin Neil,et al.  Building large-scale Bayesian networks , 2000, The Knowledge Engineering Review.

[3]  Noura Abbas.  Agile Software Assurance: An Empirical Study , 2007, ESEM 2007.

[4]  Lakhmi C. Jain,et al.  Introduction to Bayesian Networks , 2008 .

[5]  Emilia Mendes.  The Use of Bayesian Networks for Web Effort Estimation: Further Investigation , 2008, 2008 Eighth International Conference on Web Engineering.

[6]  Kathryn B. Laskey,et al.  Network Engineering for Agile Belief Network Models , 2000, IEEE Trans. Knowl. Data Eng..

[7]  Emilia Mendes,et al.  Investigating Web size metrics for early Web cost estimation , 2005, J. Syst. Softw..

[8]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems , 1988 .

[9]  Emilia Mendes.  A Comparison of Techniques for Web Effort Estimation , 2007, ESEM 2007.

[10]  William Marsh,et al.  Making resource decisions for software projects , 2004, Proceedings. 26th International Conference on Software Engineering.

[11]  Emilia Mendes,et al.  Bayesian Network Models for Web Effort Prediction: A Comparative Study , 2008, IEEE Transactions on Software Engineering.

[12]  Kevin B. Korb,et al.  Parameterising Bayesian Networks , 2004, Australian Conference on Artificial Intelligence.

[13]  Emilia Mendes,et al.  Building an Expert-based Web Effort Estimation Model using Bayesian Networks , 2009, EASE.

[14]  Brenda McCabe,et al.  Developing Complete Conditional Probability Tables from Fractional Data for Bayesian Belief Networks , 2007 .

[15]  Emilia Mendes.  The Use of a Bayesian Network for Web Effort Estimation , 2007, ICWE.

[16]  Marek J. Druzdzel,et al.  Building Probabilistic Networks: "Where Do the Numbers Come From?" Guest Editors Introduction , 2000, IEEE Trans. Knowl. Data Eng..

[17]  Kathryn B. Laskey,et al.  Network Engineering for Complex Belief Networks , 1996, UAI.

[18]  Emilia Mendes,et al.  Assessing the weighted sum algorithm for automatic generation of Probabilities in Bayesian Networks , 2010, The 2010 IEEE International Conference on Information and Automation.

[19]  Balaram Das,et al.  Generating Conditional Probabilities for Bayesian Networks: Easing the Knowledge Acquisition Problem , 2004, ArXiv.

[20]  Emilia Mendes,et al.  The Need for Web Engineering: An Introduction , 2006, Web Engineering.

[21]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[22]  Emilia Mendes.  Predicting Web Development Effort Using a Bayesian Network , 2007, EASE.

[23]  Emilia Mendes.  Improving Project Management of Healthcare Projects through Knowledge Elicitation , 2013 .

[24]  Emilia Mendes.  A Comparison of Techniques for Web Effort Estimation , 2007, First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007).

[25]  Emilia Mendes,et al.  Aggregating Expert-Driven Causal Maps for Web Effort Estimation , 2010, FGIT-ASEA.

[26]  L. C. van der Gaag,et al.  Building probabilistic networks: Where do the numbers come from? - a guide to the literature , 2000 .

[27]  Dieter Fensel,et al.  Knowledge Engineering: Principles and Methods , 1998, Data Knowl. Eng..

[28]  Emilia Mendes,et al.  Web Cost Estimation: An Introduction , 2005 .

[29]  Emilia Mendes,et al.  Evaluating the Weighted Sum Algorithm for Estimating Conditional Probabilities in Bayesian Networks , 2010, SEKE.

[30]  Emilia Mendes.  Building a Web Effort Estimation Model Through Knowledge Elicitation , 2011, ICEIS.