Assessing The Assessors - An Overview And Evaluation Of IT Project Success Reports

A great number of scholars in the information systems discipline motivate their research referring to poor performance of information technology (IT) projects, which is reported in prior success studies. However, the rigour of such success studies has either not been analysed to an adequate degree or in case of the most prominent study, the Chaos Report, widely criticised. In order to ensure a sound research foundation, there is a need for assessing the quality of existing success reports. We conduct a systematic mapping study of IT project success reports and provide an overview and a critical evaluation of existing reports as a result. We enable scholars to more carefully and thoughtfully motivate their research and help practitioners to assess published success rates at their true worth. By pointing out strengths and critical weaknesses of existing success reports, we hope to contribute to more considerate future inquiries.

[1]  Nenad Jukic,et al.  Information System Planning and Decision Making Framework: A Case Study , 2010, Inf. Syst. Manag..

[2]  Rajendra Singh,et al.  Identifying and overcoming the challenges of implementing a project management office , 2009, Eur. J. Inf. Syst..

[3]  A. Michael Huberman,et al.  An expanded sourcebook qualitative data analysis , 1994 .

[4]  Blaize Horner Reich,et al.  A Temporal Model of Information Technology Project Performance , 2007, J. Manag. Inf. Syst..

[5]  Urvashi Rathod,et al.  Defining ‘success’ for software projects: An exploratory revelation , 2006 .

[6]  Tao Chen,et al.  Comparing senior executive and project manager perceptions of IT project risk: a Chinese Delphi study , 2009, Inf. Syst. J..

[7]  Khaled El Emam,et al.  A Replicated Survey of IT Software Project Failures , 2008, IEEE Software.

[8]  Lianping Chen,et al.  A systematic review of evaluation of variability management approaches in software product lines , 2011, Inf. Softw. Technol..

[9]  Roderic J. Gray,et al.  Organisational climate and project success , 2001 .

[10]  Markku Sääksjärvi,et al.  Process and product success in information systems development , 1992, J. Strateg. Inf. Syst..

[11]  A. Shenhar,et al.  Project success: a multidimensional, strategic concept , 1997, Innovation in Technology Management. The Key to Global Leadership. PICMET '97.

[12]  A. Shenhar,et al.  Project Success: A Multidimensional Strategic Concept , 2001 .

[13]  George Valença,et al.  Accepted Manuscript Requirements Engineering for Software Product Lines: a Systematic Literature Review Accepted Manuscript Requirements Engineering for Software Product Lines: a Systematic Literature Review Accepted Manuscript , 2022 .

[14]  G. Guyatt,et al.  Grading quality of evidence and strength of recommendations , 2004, British medical journal.

[15]  Richard A. Huff,et al.  Information Systems Project Management Decision Making: The Influence of Experience and Risk Propensity , 2008 .

[16]  Ioannis Stamelos,et al.  Software project management anti-patterns , 2010, J. Syst. Softw..

[17]  Vijay S. Mookerjee,et al.  A Fault Threshold Policy to Manage Software Development Projects , 2004, Inf. Syst. Res..

[18]  M. D. Myers,et al.  Dialectical hermeneutics: a theoretical framework for the implementation of information systems , 1995, Inf. Syst. J..

[19]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[20]  C. Lance,et al.  The Sources of Four Commonly Reported Cutoff Criteria , 2006 .

[21]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[22]  David Baccarini,et al.  The Logical Framework Method for Defining Project Success , 1999 .

[23]  B MilesMatthew,et al.  Qualitative Data Analysis , 2009, Approaches and Processes of Social Science Research.

[24]  Richard T. Watson,et al.  Analyzing the Past to Prepare for the Future: Writing a Literature Review , 2002, MIS Q..

[25]  G. Guyatt,et al.  Grading quality of evidence and strength of recommendations , 2004, BMJ : British Medical Journal.

[26]  Michael Cuellar,et al.  Assessing Project Success: Moving Beyond the Triple Constraint , 2010 .

[27]  Magne Jørgensen,et al.  How large are software cost overruns? A review of the 1994 CHAOS report , 2006, Inf. Softw. Technol..

[28]  Lavagnon A. Ika.  Project Success as a Topic in Project Management Journals , 2009 .

[29]  SauerChris,et al.  A Temporal Model of Information Technology Project Performance , 2007 .

[30]  Kam Jugdev,et al.  A Retrospective look at our Evolving Understanding of Project Success , 2005, IEEE Engineering Management Review.

[31]  Nannette P. Napier,et al.  IT project managers' construction of successful project management practice: a repertory grid investigation , 2009, Inf. Syst. J..

[32]  Dov Dvir,et al.  Plans are nothing, changing plans is everything: the impact of changes on project success , 2004 .

[33]  Dirk Basten,et al.  Measurement of Information System Project Success in German Organizations , 2014, Int. J. Inf. Technol. Proj. Manag..

[34]  Dov Dvir,et al.  In search of project classification: a non-universal approach to project success factors , 1998 .

[35]  Dirk Basten,et al.  Managers' Perceptions of Information System Project Success , 2011, J. Comput. Inf. Syst..

[36]  Tore Dybå,et al.  Empirical studies of agile software development: A systematic review , 2008, Inf. Softw. Technol..

[37]  R. Müller,et al.  A Retrospective look at our Evolving Understanding of Project Success , 2005, IEEE Engineering Management Review.

[38]  John Wateridge,et al.  IT projects: a basis for success , 1995 .

[39]  Dirk Basten,et al.  A Current Assessment of Software Development Effort Estimation , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[40]  Adel M. Aladwani.  An Integrated Performance Model of Information Systems Projects , 2002, J. Manag. Inf. Syst..

[41]  Robert L. Glass,et al.  The Standish report: does it really describe a software crisis? , 2006, CACM.

[42]  Byron W. Keating,et al.  Designing IS service strategy: an information acceleration approach , 2012, Eur. J. Inf. Syst..

[43]  Jeffrey K. Pinto.  The Elements of Project Success , 2007 .

[44]  John Wateridge,et al.  How can IS/IT projects be measured for success? , 1998 .

[45]  Brenda Whittaker,et al.  What went wrong? Unsuccessful information technology projects , 1999, Inf. Manag. Comput. Secur..

[46]  Dragan Bjelica,et al.  Measuring Project Success in Project-Oriented , 2013 .

[47]  Chris Verhoef,et al.  The rise and fall of the Chaos report figures , 2010, IEEE Software.

[48]  Walter Fernandez,et al.  Success in IT projects: A matter of definition? , 2008 .

[49]  R. Ryan Nelson,et al.  Project Retrospectives: Evaluating Project Success, Failure, and Everything in Between , 2005, MIS Q. Executive.

[50]  Rajiv D. Banker,et al.  Performance Evaluation Metrics for Information Systems Development: A Principal-Agent Model , 2015, Inf. Syst. Res..