Does Agile work? - A quantitative analysis of agile project success

Abstract The Agile project management methodology has been widely used in recent years as a means to counter the dangers of traditional, front-end planning methods that often lead to downstream development pathologies. Although numerous authors have pointed to the advantages of Agile, with its emphasis on individuals and interactions over processes, customer collaboration over contracts and formal negotiations, and responsiveness over rigid planning, there are, to date, very few large-scale, empirical studies to support the contention that Agile methods can improve the likelihood of project success. Developed originally for software development, it is still predominantly an IT phenomenon. But due to its success it has now spread to non-IT projects. Using a data sample of 1002 projects across multiple industries and countries, we tested the effect of Agile use in organizations on two dimensions of project success: efficiency and overall stakeholder satisfaction against organizational goals. We further examined the moderating effects of variables such as perceived quality of the vision/goals of the project, project complexity, and project team experience. Our findings suggest that Agile methods do have a positive impact on both dimensions of project success. Further, the quality of the vision/goals is a marginally significant moderator of this effect. Implications of these findings and directions for future research are discussed.

[1]  Peter J. Byrne,et al.  Complex project management as complex problem solving: A distributed knowledge management perspective , 2014 .

[2]  Barry W. Boehm,et al.  Anchoring the Software Process , 1996, IEEE Softw..

[3]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[4]  Tzvi Raz,et al.  An empirical analysis of the relationship between project planning and project success , 2003 .

[5]  Robert Feldt,et al.  Confirming Distortional Behaviors in Software Cost Estimation Practice , 2011, 2011 37th EUROMICRO Conference on Software Engineering and Advanced Applications.

[6]  Barry W. Boehm,et al.  Empirical Findings in Agile Methods , 2002, XP/Agile Universe.

[7]  Barry W. Boehm,et al.  Get Ready for Agile Methods, with Care , 2002, Computer.

[8]  M. Martinsuo.  Project portfolio management in practice and in context , 2013 .

[9]  Ali Mohsenzadeh,et al.  The impact of agile methods on software project management , 2005, 12th IEEE International Conference and Workshops on the Engineering of Computer-Based Systems (ECBS'05).

[10]  Rodney Turner,et al.  The Relationship between Project Success and Project Efficiency , 2015 .

[11]  Roger Atkinson,et al.  Project management: cost, time and quality, two best guesses and a phenomenon, its time to accept other success criteria , 1999 .

[12]  B. Hobbs,et al.  Governance Regimes for Large Complex Projects , 2005 .

[13]  C. Lance,et al.  What Reviewers Should Expect from Authors Regarding Common Method Bias in Organizational Research , 2010 .

[14]  G. Norman.  Likert scales, levels of measurement and the “laws” of statistics , 2010, Advances in health sciences education : theory and practice.

[15]  Tore Dybå,et al.  Empirical studies of agile software development: A systematic review , 2008, Inf. Softw. Technol..

[16]  Susan Greener,et al.  Business Research Methods , 2008 .

[17]  Kam Jugdev,et al.  A Retrospective look at our Evolving Understanding of Project Success , 2005, IEEE Engineering Management Review.

[18]  A. Shenhar,et al.  Project Success: A Multidimensional Strategic Concept , 2001 .

[19]  A. K. Munns,et al.  The role of project management in achieving project success , 1996 .

[20]  R. Müller,et al.  The Influence of Project Managers on Project Success Criteria and Project Success by Type of Project , 2007 .

[21]  Hubert Smits,et al.  5 Levels of Agile Planning: From Enterprise Product Vision to Team Stand-up , 2006 .

[22]  Clive M.J. Warren,et al.  Aim, Fire, Aim—Project Planning Styles in Dynamic Environments , 2010 .

[23]  Frank Maurer,et al.  A case study on the impact of scrum on overtime and customer satisfaction , 2005, Agile Development Conference (ADC'05).

[24]  J. Pinto,et al.  Antecedents and consequences of project team cross-functional cooperation , 1993 .

[25]  Magnus Mähring.  IT project governance , 2002 .

[26]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[27]  G. Prabhakar.  What is Project Success: A Literature Review , 2009 .

[28]  David Baccarini,et al.  The concept of project complexity—a review , 1996 .

[29]  Subhash Sharma,et al.  Identification and Analysis of Moderator Variables , 1981 .

[30]  Richard F. Deckro,et al.  The social psychology of project management conflict , 1993 .

[31]  J. R. Turner,et al.  Goals-and-methods matrix: coping with projects with ill defined goals and/or methods of achieving them , 1993 .

[32]  Brian Fitzgerald,et al.  Formalized systems development methodologies: a critical perspective , 1996, Inf. Syst. J..

[33]  Carl B Traylor.  Project Management: A Systems Approach to Planning, Scheduling, and Controlling , 2014 .

[34]  Brian Hobbs,et al.  Project Categorization System and Their Use in Organisations: An Empirical Study , 2004 .

[35]  Eva Maaninen-Olsson,et al.  Deviations, Ambiguity and Uncertainty in a Project-Intensive Organization , 2005 .

[36]  Harold Koontz,et al.  A PRELIMINARY STATEMENT OF PRINCIPLES OF PLANNING AND CONTROL. , 1956 .

[37]  Debbie B. Tesch,et al.  Successful Project Sponsor Behaviors During Project Initiation: An Empirical Investigation , 2009 .

[38]  Bent Flyvbjerg,et al.  Making-Sense of the Impact and Importance of Outliers in Project Management through the Use of Power Laws , 2013 .

[39]  Pekka Abrahamsson,et al.  On-Site Customer in an XP Project: Empirical Results from a Case Study , 2004, EuroSPI.

[40]  Terry Cooke-Davies,et al.  The “real” success factors on projects , 2002 .

[41]  John Adams,et al.  Developing an Effective Project: Planning and Team Building Combined , 2008 .

[42]  Terry Williams,et al.  The Need for New Paradigms for Complex Projects , 1999 .