Opening the black box: Managers' perceptions of IS project success mechanisms

Abstract In general, works on information system (IS) project success focus on either project success factors or project success criteria, neglecting the relationships (mechanisms) between these concepts. Accordingly, it is mainly unclear how success factors actually contribute to success criteria. We attempt to illuminate this black box by conducting semi-structured qualitative interviews with experienced IS project managers by applying Repertory Grid and Laddering. Our exploratory study yields numerous success mechanisms, revealing project-related motivation to be the central hub in the factors-criteria network. Factors preceding project-related motivation such as transparency, certainty, and management attention are described.

[1]  John Wateridge,et al.  How can IS/IT projects be measured for success? , 1998 .

[2]  L. G. Pee,et al.  Mitigating the Impact of Member Turnover in Information Systems Development Projects , 2014, IEEE Transactions on Engineering Management.

[3]  Rajeev Sharma,et al.  The Contingent Effects of Training, Technical Complexity, and Task Interdependence on Successful Information Systems Implementation , 2007, MIS Q..

[4]  Rodney Turner,et al.  Forecasting Success on Large Projects: Developing Reliable Scales to Predict Multiple Perspectives by Multiple Stakeholders over Multiple Time Frames , 2012 .

[5]  J. F. Courtney,et al.  A system for organizational learning using cognitive maps , 1992 .

[6]  Irja Hyväri,et al.  Success of Projects in Different Organizational Conditions , 2006 .

[7]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[8]  Roger Tagg,et al.  Competitive advantage from erp projects: examining the role of key implementation drivers , 2014, IEEE Engineering Management Review.

[9]  Keng Siau,et al.  Toward a Unified Model of Information Systems Development Success , 2010, J. Database Manag..

[10]  Dirk Basten,et al.  Measurement of Information System Project Success in German Organizations , 2014, Int. J. Inf. Technol. Proj. Manag..

[11]  Robert Winter,et al.  Critical Success Factors of Service Orientation in Information Systems Engineering , 2011, Bus. Inf. Syst. Eng..

[12]  Keng Siau,et al.  Important characteristics of software development team members: an empirical investigation using Repertory Grid , 2010, Inf. Syst. J..

[13]  Dubravka Cecez-Kecmanovic,et al.  Reframing Success and Failure of Information Systems: A Performative Perspective , 2014, MIS Q..

[14]  A. Boonstra,et al.  Does risk management contribute to IT project success? A meta-analysis of empirical evidence , 2010 .

[15]  R. Müller,et al.  Work Motivation in Temporary Organizations: A Review of Literature Grounded in Job Design Perspective , 2017 .

[16]  Angela Clarke,et al.  A practical use of key success factors to improve the effectiveness of project management , 1999 .

[17]  Helen Sharp,et al.  Motivation in Software Engineering: A systematic literature review , 2008, Inf. Softw. Technol..

[18]  Fernando Tobal Berssaneti,et al.  Identification of variables that impact project success in Brazilian companies , 2015 .

[19]  D. Tesch,et al.  How executive sponsors influence project success , 2015 .

[20]  Dirk Basten,et al.  Ladder to success – eliciting project managers’ perceptions of IS project success criteria , 2022, International Journal of Information Systems and Project Management.

[21]  Anette C. Lien,et al.  A survey on software estimation in the Norwegian industry , 2004 .

[22]  Felix B. Tan,et al.  The Repertory Grid Technique: A Method for the Study of Cognition in Information Systems , 2002, MIS Q..

[23]  Mike Cohn,et al.  Succeeding with Agile: Software Development Using Scrum , 2009 .

[24]  Dirk Basten,et al.  Influence of Communication on Client Satisfaction in Information System Projects: A Quantitative Field Study , 2017 .

[25]  Gyeung-Min Kim,et al.  Agility of Project Manager in Global is Project , 2012, J. Comput. Inf. Syst..

[26]  Fabio Q. B. da Silva,et al.  Towards understanding the underlying structure of motivational factors for software engineers to guide the definition of motivational programs , 2012, J. Syst. Softw..

[27]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[28]  Adam Collins,et al.  PROJECT SUCCESS — A SURVEY , 2004 .

[29]  Muhammad Ali Babar,et al.  Factors that motivate software engineering teams: A four country empirical study , 2014, J. Syst. Softw..

[30]  Andrew Martin,et al.  A model of information systems development project performance , 2000, Inf. Syst. J..

[31]  Jeremy Rose,et al.  Decoupling, re‐engaging: managing trust relationships in implementation projects , 2013, Inf. Syst. J..

[32]  Gerold Riempp,et al.  The State of Research on Information Systems Success , 2009, Bus. Inf. Syst. Eng..

[33]  A. Stewart,et al.  Business applications of repertory grid , 1981 .

[34]  Dirk Basten,et al.  Knowledge Contribution Motivators - An Expectation-Confirmation Approach , 2013, ICIS.

[35]  Jan vom Brocke,et al.  Adapting Project Management Standards - Deriving Guidance from Reference Modelling , 2010, AMCIS.

[36]  William H. DeLone,et al.  Global boundaries, task processes and IS project success: a field study , 2006, Inf. Technol. People.

[37]  M. Kunc,et al.  Benefits Realisation Management and its influence on project success and on the execution of business strategies , 2015 .

[38]  Paul Benjamin Lowry,et al.  An Overview and Tutorial of the Repertory Grid Technique in Information Systems Research , 2008, Commun. Assoc. Inf. Syst..

[39]  Michael J. Ginzberg,et al.  Early Diagnosis of MIS Implementation Failure: Promising Results and Unanswered Questions , 1981 .

[40]  Stephen G. MacDonell,et al.  A Perspective-Based Understanding of Project Success , 2012, ArXiv.

[41]  Markus Biehl,et al.  Success factors for implementing global information systems , 2007, Commun. ACM.

[42]  Walid Belassi,et al.  A new framework for determining critical success/failure factors in projects , 1996 .

[43]  Kevin Crowston,et al.  Defining Open Source Software Project Success , 2003, ICIS.

[44]  U. Flick.  An Introduction to Qualitative Research , 1998 .

[45]  Varun Grover,et al.  The Impact of Influence Tactics in Information System Development Projects: A Control-Loss Perspective , 2013, J. Manag. Inf. Syst..

[46]  Albert L. Lederer,et al.  Information system cost estimating: a management perspective , 1990 .

[47]  Vicky Ching Gu,et al.  The effects of organizational culture and environmental pressures on IT project performance: A moderation perspective , 2014 .

[48]  Brian R. Gaines,et al.  Comparing conceptual structures: consensus, conflict, correspondence and contrast , 1989 .

[49]  Neil F. Doherty,et al.  An investigation of the factors affecting the successful treatment of organisational issues in systems development projects , 2001, Eur. J. Inf. Syst..

[50]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[51]  Herman Steyn,et al.  Project management for business, engineering, and technology : principles and practice , 2008 .

[52]  Ernest Jordan,et al.  Top management support: mantra or necessity? , 2008 .

[53]  R. Mayntz.  Mechanisms in the Analysis of Social Macro-Phenomena , 2004 .

[54]  P. Weill,et al.  Thriving in an increasingly digital ecosystem , 2015 .

[55]  K. Davis.  Different stakeholder groups and their perceptions of project success , 2014 .

[56]  J. Alberto Espinosa,et al.  Coordination and Performance in Global Software Service Delivery: The Vendor's Perspective , 2011, IEEE Transactions on Engineering Management.

[57]  Walter Fernandez,et al.  Success in IT projects: A matter of definition? , 2008 .

[58]  Claudia Löbbecke,et al.  Project managers' perception of IS project success factors - a repertory grid investigation , 2011, ECIS.

[59]  B. N. Baker,et al.  Factors Affecting Project Success , 2008 .

[60]  Margareta Gällstedt,et al.  Working conditions in projects: perceptions of stress and motivation among project team members and project managers , 2003 .

[61]  Marc Hassenzahl.  Character grid : a simple repertory grid technique for web site analysis and evaluation , 2003 .

[62]  E. Westerveld,et al.  The Project Excellence Model®: linking success criteria and critical success factors , 2003 .

[63]  Korin A. Kendra,et al.  Project Success: A Cultural Framework , 2004 .

[64]  G. Kelly.  The Psychology of Personal Constructs , 2020 .

[65]  Jeffrey K. Pinto.  The Elements of Project Success , 2007 .

[66]  John Noll,et al.  What Motivates Software Engineers Working in Global Software Development? , 2015, PROFES.

[67]  Wenhong Luo,et al.  Coordination in Consultant-Assisted IS Projects: An Agency Theory Perspective , 2010, IEEE Transactions on Engineering Management.

[68]  June M. Verner,et al.  In-house software development: what project management practices lead to success? , 2005, IEEE Software.

[69]  Mark Srite,et al.  The impact of project team attributes on ERP system implementations: A positivist field investigation , 2010, Inf. Technol. People.

[70]  Gordon Rugg,et al.  Eliciting information about organizational culture via laddering , 2002, Inf. Syst. J..

[71]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[72]  Narayan Ramasubbu,et al.  Software Process Diversity: Conceptualization, Measurement, and Analysis of Impact on Project Performance , 2015, MIS Q..

[73]  Jack Shih-Chieh Hsu,et al.  Reducing Requirement Incorrectness and Coping with Its Negative Impact in Information System Development Projects , 2012, Decis. Sci..

[74]  Bendik Bygstad,et al.  The Generative Mechanisms of Digital Infrastructure Evolution , 2013, MIS Q..

[75]  Helen M. Edwards,et al.  The repertory grid technique: Its place in empirical software engineering research , 2009, Inf. Softw. Technol..

[76]  Jack Shih-Chieh Hsu,et al.  Antecedents and Consequences of User Coproduction in Information System Development Projects , 2013, CONF-IRM.

[77]  Lavagnon A. Ika.  Project Success as a Topic in Project Management Journals , 2009 .

[78]  Cathy Urquhart,et al.  Using grounded theory method in information systems: the researcher as blank slate and other myths , 2013, J. Inf. Technol..

[79]  J. Morse.  Sampling in Grounded Theory , 2007 .

[80]  Stacie Petter,et al.  Managing User Expectations on Software Projects: Lessons from the Trenches , 2008 .

[81]  Albert L. Lederer,et al.  The role of monitoring and shirking in information systems project management , 2010 .

[82]  Felix B. Tan,et al.  Aligning business and information systems thinking: a cognitive approach , 2006, IEEE Transactions on Engineering Management.

[83]  Andrew Dillon,et al.  Towards a Classification of Text Types: A Repertory Grid Approach , 1990, Int. J. Man Mach. Stud..

[84]  Devi Jankowicz,et al.  The Easy Guide to Repertory Grids , 2003 .

[85]  W. Duncan.  A GUIDE TO THE PROJECT MANAGEMENT BODY OF KNOWLEDGE , 1996 .

[86]  Nannette P. Napier,et al.  IT project managers' construction of successful project management practice: a repertory grid investigation , 2009, Inf. Syst. J..

[87]  Richard Bell,et al.  A manual for repertory grid technique , 1977 .

[88]  Elmar Kutsch,et al.  Does risk matter? Disengagement from risk management practices in information systems projects , 2013, Eur. J. Inf. Syst..

[89]  R. Ryan Nelson,et al.  Project Retrospectives: Evaluating Project Success, Failure, and Everything in Between , 2005, MIS Q. Executive.

[90]  Dirk Basten,et al.  Customer Satisfaction in IS Projects: Assessing the Role of Process and Product Performance , 2015, Commun. Assoc. Inf. Syst..

[91]  Chrisanthi Avgerou,et al.  Social Mechanisms for Causal Explanation in Social Theory Based IS Research , 2013, J. Assoc. Inf. Syst..

[92]  L. Ryals,et al.  Using the repertory grid to access the underlying realities in key account relationships , 2007 .

[93]  Dirk Basten,et al.  Eliminating Failure by Learning from It - Systematic Review of IS Project Failure , 2013, ICIS.

[94]  Albert L. Lederer,et al.  An Agency Theory Explanation of Project Success , 2011, J. Comput. Inf. Syst..

[95]  J. Rodney Turner,et al.  The Project Manager's Leadership Style as a Success Factor on Projects: A Literature Review , 2005 .

[96]  Russell L. Purvis,et al.  What's in it for me? Using expectancy theory and climate to explain stakeholder participation, its direction and intensity , 2015 .

[97]  A. G. Bills,et al.  The quantitative set , 1929 .

[98]  Jan Terje Karlsen,et al.  What Characterizes Successful It Projects , 2005, Int. J. Inf. Technol. Decis. Mak..

[99]  Sarah Beecham,et al.  Motivating Software Engineers Working in Virtual Teams Across the Globe , 2014, Software Project Management in a Changing World.

[100]  R. Ryan Nelson,et al.  IT Project Management: Infamous Failures, Classic Mistakes, and Best Practices , 2007, MIS Q. Executive.

[101]  Dov Dvir,et al.  In search of project classification: a non-universal approach to project success factors , 1998 .

[102]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[103]  Helen Sharp,et al.  Models of motivation in software engineering , 2009, Inf. Softw. Technol..

[104]  Devi Jankowicz,et al.  Why does subjectivity make us nervous , 2001 .

[105]  Dirk Basten,et al.  Managers' Perceptions of Information System Project Success , 2011, J. Comput. Inf. Syst..

[106]  R. Müller,et al.  A Retrospective look at our Evolving Understanding of Project Success , 2005, IEEE Engineering Management Review.

[107]  John Wateridge,et al.  IT projects: a basis for success , 1995 .

[108]  Kweku-Muata Osei-Bryson,et al.  Determining the Contribution of IS Projects: An Approach to Measure Performance , 2009 .

[109]  Adel M. Aladwani.  An Integrated Performance Model of Information Systems Projects , 2002, J. Manag. Inf. Syst..

[110]  William N. Dunn,et al.  A Sociocognitive Network Approach to Organizational Analysis , 1986 .

[111]  Rodney Turner,et al.  Relationships Between Leadership and Success in Different Types of Project Complexities , 2012, IEEE Transactions on Engineering Management.

[112]  D. N. Hinkle.  The change of personal constructs from the viewpoint of a theory of construct implications , 1965 .

[113]  Mark Keil,et al.  The Dynamics of IT Project Status Reporting: A Self-Reinforcing Cycle of Distrust , 2014, J. Assoc. Inf. Syst..

[114]  Fabio Q. B. da Silva,et al.  Motivation in software engineering industrial practice: A cross-case analysis of two software organisations , 2014, Inf. Softw. Technol..

[115]  C. Eden.  ON THE NATURE OF COGNITIVE MAPS , 1992 .

[116]  David Gefen,et al.  What do software practitioners really think about project success: an exploratory study , 2005, J. Syst. Softw..

[117]  David A. Robb,et al.  A Model for Assessing Information Systems Success and its Application to e-Logistics Tracking Systems , 2015, Pac. Asia J. Assoc. Inf. Syst..

[118]  Ephraim R. McLean,et al.  A meta-analytic assessment of the DeLone and McLean IS success model: An examination of IS success at the individual level , 2009, Inf. Manag..

[119]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[120]  T. A. Ryan,et al.  Drives, tasks, and the initiation of behavior. , 1958, The American journal of psychology.

[121]  Jonathan Adams,et al.  Motivation in Project Management: The Project Manager's Perspective , 2008 .

[122]  Michael Smith.  A repertory grid analysis of supervisory jobs , 1986 .

[123]  David Baccarini,et al.  The Logical Framework Method for Defining Project Success , 1999 .

[124]  Charlie C. Chen,et al.  Relationships among interpersonal conflict, requirements uncertainty, and software project performance , 2011 .

[125]  Fabio Q. B. da Silva,et al.  Motivation in software engineering: A systematic review update , 2011, EASE.

[126]  Barbara Paech,et al.  Does Involving Users in Software Development Really Influence System Success? , 2013, IEEE Software.

[127]  Terry Cooke-Davies,et al.  The “real” success factors on projects , 2002 .

[128]  P. Hedström,et al.  Causal Mechanisms in the Social Sciences , 2010 .

[129]  Charlie C. Chen,et al.  Critical Success Factors for the Implementation of Integrated Healthcare Information Systems Projects: An Organizational Fit Perspective , 2014, Commun. Assoc. Inf. Syst..

[130]  Mark A. Fuller,et al.  Information Systems Project Management: A Process and Team Approach , 2010 .

[131]  Jarmo J. Ahonen,et al.  Software development project success and failure from the supplier's perspective: A systematic literature review , 2012 .

[132]  A. K. Munns,et al.  The role of project management in achieving project success , 1996 .

[133]  Urvashi Rathod,et al.  Defining ‘success’ for software projects: An exploratory revelation , 2006 .

[134]  Tsun Chow,et al.  A survey study of critical success factors in agile software projects , 2008, J. Syst. Softw..

[135]  Steven L. Alter.  Defining information systems as work systems: implications for the IS field , 2008, Eur. J. Inf. Syst..

[136]  E. A. Locke.  Toward a theory of task motivation and incentives , 1968 .

[137]  K. Davis.  A method to measure success dimensions relating to individual stakeholder groups , 2016 .

[138]  Colin Ashurst,et al.  Factors affecting the successful realisation of benefits from systems development projects: findings from three case studies , 2012, J. Inf. Technol..

[139]  Hans Wortmann,et al.  Risk Management Affecting IS/IT Project Success through Communicative Action , 2011 .

[140]  Jonas Söderlund,et al.  Reinventing project management, by Aaron Shenhar a Dov Dvir , 2008 .