How Software Project Risk Affects Project Performance: An Investigation of the Dimensions of Risk and an Exploratory Model

To reduce the high failure rate of software projects, managers need better tools to assess and manage software project risk. In order to create such tools, however, information systems researchers must first develop a better understanding of the dimensions of software project risk and how they can affect project performance. Progress in this area has been hindered by: (1) a lack of validated instruments for measuring software project risk that tap into the dimensions of risk that are seen as important by software project managers, and (2) a lack of theory to explain the linkages between various dimensions of software project risk and project performance. In this study, six dimensions of software project risk were identified and reliable and valid measures were developed for each. Guided by sociotechnical systems theory, an exploratory model was developed and tested. The results show that social subsystem risk influences technical subsystem risk, which, in turn, influences the level of project management risk, and ultimately, project performance. The implications of these findings for research and practice are discussed.

[1]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[2]  Christopher L. Carr.  A Psychometric Evaluation of the Expectations, Perceptions, and Difference-Scores Generated by the IS-Adapted SERVQUAL Instrument , 2002, Decis. Sci..

[3]  H. Marsh,et al.  Assessing Goodness of Fit: Is Parsimony Always Desirable? , 1996 .

[4]  Frederick P. Brooks,et al.  No Silver Bullet: Essence and Accidents of Software Engineering , 1987 .

[5]  Richard H. Thayer,et al.  Special Feature The Challenge of Software Engineering Project Management , 1980, Computer.

[6]  Gary Klein,et al.  Information system success as impacted by risks and development strategies , 2001, IEEE Trans. Engineering Management.

[7]  Capers Jones,et al.  Assessment and control of software risks , 1994, Yourdon Press Computing Series.

[8]  Detmar W. Straub,et al.  Structural Equation Modeling and Regression: Guidelines for Research Practice , 2000, Commun. Assoc. Inf. Syst..

[9]  Vincent K. Chong,et al.  Budget Goal Commitment and Informational Effects of Budget Participation on Performance: A Structural Equation Modeling Approach , 2002 .

[10]  K. Arrow.  Essays in the theory of risk-bearing , 1958 .

[11]  Dale N. Glaser,et al.  Jiving the Four-Step, Waltzing Around Factor Analysis, and Other Serious Fun , 2000 .

[12]  Sarma R. Nidumolu.  A Comparison of the Structural Contingency and Risk-Based Perspectives on Coordination in Software Development Projects , 1996, J. Manag. Inf. Syst..

[13]  Kenneth A. Bollen,et al.  Modeling Strategies: In Search of the Holy Grail , 2000 .

[14]  Daniel Robey,et al.  User Involvement in Information System Development: A Conflict Model and Empirical Test , 1982 .

[15]  Jeffrey H. Moore,et al.  A Framework for MIS Software Development Projects , 1979, MIS Q..

[16]  F. W. McFarlan,et al.  Portfolio approach to information systems , 1989 .

[17]  Stephen P. Keider,et al.  Why Systems Development Projects Fail , 1984 .

[18]  Arun Rai,et al.  The effects of development process modeling and task uncertainty on development quality performance , 2000, Inf. Manag..

[19]  B. Boehm.  Software risk management: principles and practices , 1991, IEEE Software.

[20]  Izak Benbasat,et al.  Development of an Instrument to Measure the Perceptions of Adopting an Information Technology Innovation , 1991, Inf. Syst. Res..

[21]  Gary Klein,et al.  Project Risk Impact on Software Development Team Performance , 2000 .

[22]  Arun Rai,et al.  Assessing the Validity of IS Success Models: An Empirical Test and Theoretical Analysis , 2002, Inf. Syst. Res..

[23]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[24]  G. A. Marcoulides,et al.  On desirability of parsimony in structural equation model selection , 1999 .

[25]  Roger E. Millsap,et al.  Doing the Four-Step Right , 2000 .

[26]  Karl G. Jöreskog,et al.  LISREL 7: A guide to the program and applications , 1988 .

[27]  Kalle Lyytinen,et al.  Identifying Software Project Risks: An International Delphi Study , 2001, J. Manag. Inf. Syst..

[28]  Zbigniew H. Przasnyski,et al.  On Information Systems Project Abandonment: An Exploratory Study of Organizational Practices , 1991, MIS Q..

[29]  David W. Gerbing,et al.  An Updated Paradigm for Scale Development Incorporating Unidimensionality and Its Assessment , 1988 .

[30]  R. Bagozzi,et al.  Representing and testing organizational theories: A holistic construal. , 1982 .

[31]  Blake Ives,et al.  Executive Involvement and Participation in the Management of Information Technology , 1991, MIS Q..

[32]  Kalle Lyytinen,et al.  A framework for identifying software project risks , 1998, CACM.

[33]  Gilbert A. Churchill.  A Paradigm for Developing Better Measures of Marketing Constructs , 1979 .

[34]  R. Bagozzi,et al.  On the evaluation of structural equation models , 1988 .

[35]  Brad Tuttle,et al.  A Study of Staff Turnover, Acquisition, and Assimilation and Their Impact on Software Development Cost and Schedule , 1989, J. Manag. Inf. Syst..

[36]  Jerald R. Herting,et al.  Another Perspective on "The Proper Number of Factors" and the Appropriate Number of Steps , 2000 .

[37]  Alexander Hars,et al.  Web Based Knowledge Infrastructures for the Sciences: An Adaptive Document , 2000, Commun. Assoc. Inf. Syst..

[38]  J. March,et al.  Managerial perspectives on risk and risk taking , 1987 .

[39]  Chris F. Kemerer,et al.  Barriers to successful strategic information systems , 1988 .

[40]  Dale Karolak,et al.  Software engineering risk management , 1995 .

[41]  Patricia Carlson,et al.  Information Technology and Organizational Change , 1999, SIGDOC '99.

[42]  H. Jeff Smith,et al.  Information Privacy: Measuring Individuals' Concerns About Organizational Practices , 1996, MIS Q..

[43]  Suzanne Rivard,et al.  Toward an Assessment of Software Development Risk , 1993, J. Manag. Inf. Syst..

[44]  R. W. Stone,et al.  A Structural Equation Model Of End-User Satisfaction With A Computer-Based Medical Information System , 1994 .

[45]  James C. Anderson,et al.  STRUCTURAL EQUATION MODELING IN PRACTICE: A REVIEW AND RECOMMENDED TWO-STEP APPROACH , 1988 .

[46]  Gordon B. Davis,et al.  Strategies for Information Requirements Determination , 1982, IBM Syst. J..

[47]  Markham T. Frohlich,et al.  e-Integration in the Supply Chain: Barriers and Performance , 2002, Decis. Sci..

[48]  Leslie A. Hayduk.  Structural equation modeling with LISREL: essentials and advances , 1987 .

[49]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[50]  Robert P. Bostrom,et al.  MIS Problems and failures: a sociotechnical perspective part I: the cause , 1977 .

[51]  Iris Vessey,et al.  The Effect of User Involvement on System Success: A Contingency Approach , 1988, MIS Q..

[52]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[53]  Philip W. Metzger.  Managing a programming project , 1973 .

[54]  Kenneth R. MacCrimmon,et al.  The Risk In-Basket , 1984 .

[55]  T. Moynihan,et al.  How Experienced Project Managers Assess Risk , 1997, IEEE Softw..

[56]  Mark W. Johnston,et al.  Analysis of role conflict and role ambiguity in a structural equations framework , 1990 .

[57]  C. Schriesheim.  Causal Analysis: Assumptions, Models, and Data , 1982 .

[58]  W. Duncan.  A GUIDE TO THE PROJECT MANAGEMENT BODY OF KNOWLEDGE , 1996 .

[59]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[60]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[61]  Rob J. Kusters,et al.  Dealing with risk: a practical approach , 1996, J. Inf. Technol..

[62]  Robert N. Charette,et al.  Software Engineering Risk Analysis and Management , 1989 .

[63]  C. Heckler.  A Step-by-Step Approach to Using the SAS™ System for Factor Analysis and Structural Equation Modeling , 1996 .