Failure factors of small software projects at a global outsourcing marketplace

Abstract The presented study aims at a better understanding of when and why small-scale software projects at a global outsourcing marketplace fail. The analysis is based on a data set of 785,325 projects/tasks completed at vWorker.com. A binary logistic regression model relying solely on information known at the time of a project's start-up correctly predicted 74% of the project failures and 67% of the non-failures. The model-predicted failure probability corresponded well with the actual frequencies of failures for most levels of failure risk. The model suggests that the factors connected to the strongest reduction in the risk of failure are related to previous collaboration between the client and the provider and a low failure rate of previous projects completed by the provider. We found the characteristics of the client to be almost as important as those of the provider in explaining project failures and that the risk of project failure increased with an increased client emphasis on low price and with an increased project size. The identified relationships seem to be reasonable stable across the studied project size categories.

[1]  R.N. Charette,et al.  Why software fails [software failure] , 2005, IEEE Spectrum.

[2]  Yasunari Takagi,et al.  An Empirical Approach to Characterizing Risky Software Projects Based on Logistic Regression Analysis , 2005, Empirical Software Engineering.

[3]  Capers Jones,et al.  Why software fails , 1996 .

[4]  S. Viswanathan,et al.  An Empirical Study of Online Software Outsourcing: Signals under Different Contract Regimes , 2010 .

[5]  Thomas H. Wonnacott,et al.  Introductory Statistics , 2007, Technometrics.

[6]  Blaize Horner Reich,et al.  The impact of size and volatility on IT project performance , 2007, CACM.

[7]  Magne Jørgensen,et al.  How does project size affect cost estimation error? Statistical artifacts and methodological challenges , 2012 .

[8]  Saleem Abuleil,et al.  A Taxonomy of an IT Project Failure: Root Causes , 2009 .

[9]  Markus Westner,et al.  THE CURRENT STATE OF IS OFFSHORING IN GERMANY: PROJECT CHARACTERISTICS AND SUCCESS PATTERNS , 2010 .

[10]  Magne Jørgensen,et al.  How large are software cost overruns? A review of the 1994 CHAOS report , 2006, Inf. Softw. Technol..

[11]  Urvashi Rathod,et al.  Defining ‘success’ for software projects: An exploratory revelation , 2006 .

[12]  Jarmo J. Ahonen,et al.  Software engineering projects may fail before they are started: Post-mortem analysis of five cancelled projects , 2010, J. Syst. Softw..

[13]  Søren L. Buhl,et al.  What Causes Cost Overrun in Transport Infrastructure Projects? , 2004, 1304.4476.

[14]  Claes Wohlin,et al.  Assessing Project Success Using Subjective Evaluation Factors , 2004, Software Quality Journal.

[15]  Trevor Wood-Harper,et al.  Understanding the Sources of Information Systems Project Failure , 2007 .

[16]  Robbie T. Nakatsu,et al.  A risk profile of offshore-outsourced development projects , 2008, CACM.

[17]  Rodney X. Sturdivant,et al.  Applied Logistic Regression: Hosmer/Applied Logistic Regression , 2005 .

[18]  Dorothy E. Leidner,et al.  Review: A Review of Culture in Information Systems Research: Toward a Theory of Information Technology Culture Conflict , 2006, MIS Q..

[19]  Barbara A. Kitchenham,et al.  Evaluating logistic regression models to estimate software project outcomes , 2010, Inf. Softw. Technol..

[20]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[21]  Yasunari Takagi,et al.  An Empirical Evaluation of Predicting Runaway Software Projects Using Bayesian Classification , 2004, PROFES.

[22]  Gary King,et al.  Logistic Regression in Rare Events Data , 2001, Political Analysis.

[23]  Magne Jørgensen,et al.  Over-optimism in software development projects: "the winner's curse" , 2005, 15th International Conference on Electronics, Communications and Computers (CONIELECOMP'05).

[24]  Chris Verhoef,et al.  The rise and fall of the Chaos report figures , 2010, IEEE Software.

[25]  Barry W. Boehm,et al.  Termination Doesn't Equal Project Failure , 2000, Computer.

[26]  Marco Torchiano,et al.  Actual vs. perceived effect of software engineering practices in the Italian industry , 2010, J. Syst. Softw..

[27]  Magne Jørgensen,et al.  Impact of effort estimates on software project work , 2001, Inf. Softw. Technol..

[28]  Kalle Lyytinen,et al.  Identifying Software Project Risks: An International Delphi Study , 2001, J. Manag. Inf. Syst..

[29]  Magne Jørgensen,et al.  A strong focus on low price when selecting software providers increases the likelihood of failure in software outsourcing projects , 2013, EASE '13.

[30]  Sjaak Brinkkemper,et al.  Reasons for Success and Failure in Offshore Software Development Projects , 2008, ECIS.

[31]  Henry C. Lucas,et al.  The Winner's Curse in High Tech , 2005, Computer.

[32]  Magne Jørgensen,et al.  From origami to software development: a review of studies on judgment-based predictions of performance time. , 2012, Psychological bulletin.

[33]  David Baccarini,et al.  The Logical Framework Method for Defining Project Success , 1999 .

[34]  Jennifer Sampson,et al.  What factors lead to software project failure? , 2008, 2008 Second International Conference on Research Challenges in Information Science.

[35]  J.D. Harry,et al.  Balancing act [noise based sensory enhancement technology] , 2005, IEEE Spectrum.

[36]  Andrey Maglyas,et al.  Comparison of two models of success prediction in software development projects , 2010, 2010 6th Central and Eastern European Software Engineering Conference (CEE-SECR).

[37]  Khaled El Emam,et al.  A Replicated Survey of IT Software Project Failures , 2008, IEEE Software.

[38]  L. Willcocks,et al.  ABOUT THE PRESENTER: , 2002 .

[39]  Alfredo Candia-Véjar,et al.  The optimization of success probability for software projects using genetic algorithms , 2011, J. Syst. Softw..

[40]  Kurt R. Linberg.  Software developer perceptions about software project failure: a case study , 1999, J. Syst. Softw..

[41]  Robbie T. Nakatsu,et al.  A comparative study of important risk factors involved in offshore and domestic outsourcing of software development projects: A two-panel Delphi study , 2009, Inf. Manag..