Expert Estimation of Web-Development Projects: Are Software Professionals in Technical Roles More Optimistic Than Those in Non-Technical Roles?

Estimating the effort required to complete web-development projects involves input from people in both technical (e.g., programming), and non-technical (e.g., user interaction design) roles. This paper examines how the employees' role and type of competence may affect their estimation strategy and performance. An analysis of actual web-development project data and results from an experiment suggest that people with technical competence provided less realistic project effort estimates than those with less technical competence. This means that more knowledge about how to implement a requirement specification does not always lead to better estimation performance. We discuss, amongst others, two possible reasons for this observation: (1) Technical competence induces a bottom-up, construction-based estimation strategy, while lack of this competence induces a more “outside” view of the project, using a top-down estimation strategy. An “outside” view may encourage greater use of the history of previous projects and reduce the bias towards over-optimism. (2) Software professionals in technical roles perceive that they are evaluated as more skilled when providing low effort estimates. A consequence of our findings is that the choice of estimation strategy, estimation evaluation criteria and feedback are important aspects to consider when seeking to improve estimation accuracy.

[1]  Fj Fred Heemstra,et al.  Function point analysis: evaluation of a software cost estimation model , 1991 .

[2]  Magne Jørgensen Top-down and bottom-up expert estimation of software development effort , 2004, Inf. Softw. Technol..

[3]  Donald J. Reifer,et al.  Web Development: Estimating Quick-to-Market Software , 2000, IEEE Softw..

[4]  S. Lichtenstein,et al.  Do those who know more also know more about how much they know?*1 , 1977 .

[5]  Magne Jørgensen,et al.  Impact of experience on maintenance skills , 2002, J. Softw. Maintenance Res. Pract..

[6]  Louis B. Rosenfeld,et al.  Information architecture for the world wide web - designing large-scale web sites , 1998 .

[7]  Claes Wohlin,et al.  A project effort estimation study , 1998, Inf. Softw. Technol..

[8]  Shari Lawrence Pfleeger,et al.  An empirical study of maintenance and development estimation accuracy , 2002, J. Syst. Softw..

[9]  Magne Jørgensen,et al.  A review of studies on expert estimation of software development effort , 2004, J. Syst. Softw..

[10]  Anthony Pengelly Performance of effort estimating techniques in current development environments , 1995, Softw. Eng. J..

[11]  John Moses Learning how to improve effort estimation in small software development companies , 2000, Proceedings 24th Annual International Computer Software and Applications Conference. COMPSAC2000.

[12]  Ingunn Myrtveit,et al.  A Controlled Experiment to Assess the Benefits of Estimating with Analogy and Regression Models , 1999, IEEE Trans. Software Eng..

[13]  A. Stuart,et al.  Non-Parametric Statistics for the Behavioral Sciences. , 1957 .

[14]  Paolo Ciancarini,et al.  Software process enactment in Oikos , 1990, SDE.

[15]  Karl E. Wiegers Software Process Improvement in Web Time , 1999, IEEE Softw..

[16]  Rebecca A. Henry The Effects of Choice and Incentives on the Overestimation of Future Performance , 1994 .

[17]  Barbara Kitchenham,et al.  Software Metrics: Measurement for Software Process Improvement , 1996 .

[18]  Glen Whyte,et al.  The Effect of Multiple Anchors on Anchoring in Individual and Group Judgment , 1997 .

[19]  D. Ross Jeffery,et al.  An Empirical Study of Analogy-based Software Effort Estimation , 1999, Empirical Software Engineering.

[20]  Caroline S. Langensiepen,et al.  Estimation support by lexical analysis of requirements documents , 2000, J. Syst. Softw..

[21]  Ronald Christensen,et al.  Analysis of Variance, Design, and Regression: Applied Statistical Methods , 1996 .

[22]  Kjetil Molkken,et al.  A Review of Surveys on Software Effort Estimation , 2003 .

[23]  Magne Jørgensen,et al.  Impact of effort estimates on software project work , 2001, Inf. Softw. Technol..

[24]  Fj Fred Heemstra,et al.  Are software cost-estimation models accurate , 1990 .

[25]  Albert L. Lederer,et al.  Software management and cost estimating error , 2000, J. Syst. Softw..

[26]  Magne Jørgensen,et al.  Group Processes in Software Effort Estimation , 2004, Empirical Software Engineering.

[27]  R. Buehler,et al.  Exploring the "planning fallacy": Why people underestimate their task completion times. , 1994 .

[28]  S. Fiske,et al.  Social Psychology , 2019, Encyclopedia of Personality and Individual Differences.

[29]  Andrew McDonald Web Engineering in Practice , 2001 .

[30]  D. Ross Jeffery,et al.  Cost Estimation : A Review of Models , Process , and Practice , 2010 .

[31]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[32]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[33]  Michael J. Prietula,et al.  Software-Effort Estimation: An Exploratory Study of Expert Performance , 1991, Inf. Syst. Res..

[34]  Michael J. Prietula,et al.  Examining the Feasibility of a Case-Based Reasoning Model for Software Effort Estimation , 1992, MIS Q..

[35]  Patrick Scott Chun Young Customizable process specification and enactment for technical and non-technical users , 1994 .