How user risk and requirements risk moderate the effects of formal and informal control on the process performance of IT projects

Improving the management of information technology (IT) projects is of prime concern to both IS researchers and practitioners, as IT projects are notorious for poor process performance, frequently running over budget and behind schedule. Over the years, at least two separate streams of research have emerged with the aim of contributing to our understanding of IT project management. One of these focuses on the exercise of formal and informal controls, while another focuses on identifying and managing key risks such as those associated with requirements and users. Proponents of the control stream would argue that the exercise of formal and informal controls can improve process performance and there is some evidence that this is so. An obvious question that emerges, however, is how effective these controls are in the presence of particular risks. In this study, we seek to answer this question by developing and testing a research model that integrates these two streams of research. On the basis of data collected from 63 completed IT projects in China, we examine the moderating effects of requirements risk and user risk on the relationship between control (both formal and informal) and the process performance of IT projects. We contribute to the current state of knowledge by clearly demonstrating that both types of risk moderate the effects of formal and informal controls on performance. Specifically, both requirements risk and user risk were found to reduce the positive influence of controls on process performance, implying that implementing solid controls is a necessary, but not sufficient, condition to ensure good process performance.

[1]  W. Ouchi The Relationship Between Organizational Structure and Organizational Control. , 1977 .

[2]  Sun-Jen Huang,et al.  An empirical analysis of risk components and performance on software projects , 2007, J. Syst. Softw..

[3]  Amrit Tiwana,et al.  Control in Internal and Outsourced Software Projects , 2009, J. Manag. Inf. Syst..

[4]  R. Zmud INDIVIDUAL DIFFERENCES AND MIS SUCCESS: A REVIEW OF THE EMPIRICAL LITERATURE* , 1979 .

[5]  Gary Klein,et al.  THE RELATIONSHIP OF CONTROL AND LEARNING TO PROJECT PERFORMANCE , 2006, Cybern. Syst..

[6]  Eric K. Clemons,et al.  Evaluation of strategic investments in information technology , 1991, CACM.

[7]  Mark Keil,et al.  How Software Project Risk Affects Project Performance: An Investigation of the Dimensions of Risk and an Exploratory Model , 2004, Decis. Sci..

[8]  Detmar W. Straub,et al.  A Practical Guide To Factorial Validity Using PLS-Graph: Tutorial And Annotated Example , 2005, Commun. Assoc. Inf. Syst..

[9]  Laurie J. Kirsch,et al.  Deploying Common Systems Globally: The Dynamics of Control , 2004, Inf. Syst. Res..

[10]  Wynne W. Chin,et al.  Extending the technology acceptance model: the influence of perceived user resources , 2001, DATB.

[11]  T. Moynihan,et al.  How Experienced Project Managers Assess Risk , 1997, IEEE Softw..

[12]  Gary Klein,et al.  The relative influence of management control and user-IS personnel interaction on project performance , 2006, Inf. Softw. Technol..

[13]  William G. Ouchi,et al.  Markets, Bureaucracies, and Clans. , 1980 .

[14]  Kenneth S. Law,et al.  On the Importance of Conducting Construct-Level Analysis for Multidimensional Constructs in Theory Development and Testing , 2008 .

[15]  Subhash Sharma,et al.  Identification and Analysis of Moderator Variables , 1981 .

[16]  William R. King,et al.  Predictors of Formal Control Usage in IT Outsourcing Partnerships , 2008, Inf. Syst. Res..

[17]  Mark I. Hwang,et al.  The effect of user engagement on system success: A meta-analytical integration of research findings , 1999, Inf. Manag..

[18]  Xiaotong Li,et al.  Software development risk and project performance measurement: Evidence in Korea , 2007, J. Syst. Softw..

[19]  Sarma R. Nidumolu Standardization, requirements uncertainty and software project performance , 1996, Inf. Manag..

[20]  A. Tiwana Does technological modularity substitute for control? A study of alliance performance in software outsourcing , 2008 .

[21]  James E. Hunton,et al.  Effects of User Participation in Systems Development: A Longitudinal Field Experiment , 1997, MIS Q..

[22]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[23]  Arun Rai,et al.  Knowledge Sharing Ambidexterity in Long-Term Interorganizational Relationships , 2008, Manag. Sci..

[24]  Kalle Lyytinen,et al.  A framework for identifying software project risks , 1998, CACM.

[25]  Russell L. Purvis,et al.  Controlling Information Systems Development Projects: The View from the Client , 2002, Manag. Sci..

[26]  W. Ouchi A Conceptual Framework for the Design of Organizational Control Mechanisms , 1979 .

[27]  David R. Firth,et al.  Communications of the Association for Information Systems , 2011 .

[28]  Likoebe M. Maruping,et al.  Offshore information systems project success: the role of social embeddedness and cultural characteristics , 2009 .

[29]  A. E. Sengün,et al.  Trust, Control, and Risk , 2007 .

[30]  Gary Klein,et al.  Software development risks to project effectiveness , 2000, J. Syst. Softw..

[31]  Kathleen M. Eisenhardt,et al.  Control: Organizational and Economic Approaches , 1985 .

[32]  Daniel C. Bello,et al.  The Effect of Output Controls, Process Controls, and Flexibility on Export Channel Performance , 1997 .

[33]  Suzanne Rivard,et al.  An Integrative Contingency Model of Software Project Risk Management , 2001, J. Manag. Inf. Syst..

[34]  Gary Klein,et al.  Risks to different aspects of system success , 1999, Inf. Manag..

[35]  Cheryl Burke Jarvis,et al.  A Critical Review of Construct Indicators and Measurement Model Misspecification in Marketing and Consumer Research , 2003 .

[36]  Mani R. Subramani,et al.  The Matrix of Control: Combining Process and Structure Approaches to Managing Software Development , 2003, J. Manag. Inf. Syst..

[37]  Sarma R. Nidumolu The Effect of Coordination and Uncertainty on Software Project Performance: Residual Performance Risk as an Intervening Variable , 1995, Inf. Syst. Res..

[38]  James J. Jiang,et al.  The effects of change control and management review on software flexibility and project performance , 2008, Inf. Manag..

[39]  Rosedith Sitgreaves Bowker Measurement Theory for the Behavioral Sciences , 1983 .

[40]  Xiaotong Li,et al.  Uncertainty profile and software project performance: A cross-national comparison , 2004, J. Syst. Softw..

[41]  J. March,et al.  Managerial perspectives on risk and risk taking , 1987 .

[42]  Robert W. Zmud,et al.  Management of Large Software Development Efforts , 1980, MIS Q..

[43]  Mark Keil,et al.  Software project risks and their effect on outcomes , 2004, CACM.

[44]  James E. Hunton,et al.  Involving Information System Users in Defining System Requirements: The Influence of Procedural Justice Perceptions on User Attitudes and Performance , 1996 .

[45]  Richard G. Mathieu,et al.  The importance of management practices in IS project performance: An empirical study , 2005, J. Enterp. Inf. Manag..

[46]  Gary Klein,et al.  Information system success as impacted by risks and development strategies , 2001, IEEE Trans. Engineering Management.

[47]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[48]  Greg W. Marshall,et al.  Formal and informal management control combinations in sales organizations: The impact on salesperson consequences , 2004 .

[49]  Arun Rai,et al.  The effects of development process modeling and task uncertainty on development quality performance , 2000, Inf. Manag..

[50]  M. Lindell,et al.  Accounting for common method variance in cross-sectional research designs. , 2001, The Journal of applied psychology.

[51]  Rajiv Sabherwal,et al.  Portfolios of Control in Outsourced Software Development Projects , 2003, Inf. Syst. Res..

[52]  A. Tiwana,et al.  Does peripheral knowledge complement control? An empirical test in technology outsourcing alliances , 2007 .

[53]  Anne S. Tsui,et al.  SELF-REGULATION FOR MANAGERIAL EFFECTIVENESS: THE ROLE OF ACTIVE FEEDBACK SEEKING , 1991 .

[54]  A. Adam Whatever happened to information systems ethics? Caught between the devil and the deep blue sea , 2004 .

[55]  F. W. McFarlan,et al.  Portfolio approach to information systems , 1989 .

[56]  Gary Klein,et al.  Pre-project partnering impact on an information system project, project team and project manager , 2002, Eur. J. Inf. Syst..

[57]  Patricia J. Guinan,et al.  Enabling Software Development Team Performance During Requirements Definition: A Behavioral Versus Technical Approach , 1998, Inf. Syst. Res..

[58]  M. Lynne Markus,et al.  Participation in Development and Implementation - Updating An Old, Tired Concept for Today's IS Contexts , 2004, J. Assoc. Inf. Syst..

[59]  Ronald T. Cenfetelli,et al.  Interpretation of Formative Measurement in Information Systems Research , 2009, MIS Q..

[60]  John P. Campbell,et al.  Measurement Theory for the Behavioral Sciences. , 1983 .

[61]  Traci Carte,et al.  In Pursuit of Moderation: Nine Common Errors and Their Solutions , 2003, MIS Q..

[62]  Wynne W. Chin,et al.  A Partial Least Squares Latent Variable Modeling Approach for Measuring Interaction Effects: Results from a Monte Carlo Simulation Study and an Electronic - Mail Emotion/Adoption Study , 2003, Inf. Syst. Res..

[63]  Laurie J. Kirsch,et al.  Contextual influences on self-control of is professionals engaged in systems development , 1996 .

[64]  Naresh K. Malhotra,et al.  Common Method Variance in IS Research: A Comparison of Alternative Approaches and a Reanalysis of Past Research , 2006, Manag. Sci..

[65]  Bernard J. Jaworski Toward a Theory of Marketing Control: Environmental Context, Control Types, and Consequences , 1988 .

[66]  L. Kirsch The Management of Complex Tasks in Organizations: Controlling the Systems Development Process , 1996 .

[67]  Arun Rai,et al.  Interfirm Strategic Information Flows in Logistics Supply Chain Relationships , 2009, MIS Q..

[68]  Kalle Lyytinen,et al.  Identifying software project risks in Nigeria: an International Comparative Study , 2003, Eur. J. Inf. Syst..

[69]  Cynthia Mathis Beath,et al.  Managing the User Relationship im Information Systems Development Projects: a Transaction Governance Approach , 1987, ICIS.

[70]  Laurie J. Kirsch,et al.  Portfolios of Control Modes and IS Project Management , 1997, Inf. Syst. Res..

[71]  Detmar W. Straub,et al.  Specifying Formative Constructs in Information Systems Research , 2007, MIS Q..

[72]  Kalle Lyytinen,et al.  Identifying Software Project Risks: An International Delphi Study , 2001, J. Manag. Inf. Syst..

[73]  B. Boehm Software risk management: principles and practices , 1991, IEEE Software.

[74]  Mark Keil,et al.  Understanding software project risk: a cluster analysis , 2004, Inf. Manag..

[75]  W. W. Rozeboom Sensitivity of a linear composite of predictor items to differential item weighting , 1979 .

[76]  J. C. Henderson,et al.  Managing I/S Design Teams: A Control Theories Perspective , 1992 .

[77]  N. Venkatraman,et al.  Measurement of Business Economic Performance: An Examination of Method Convergence , 1987 .

[78]  K. Law,et al.  Multidimensional constructs in structural equation analysis: An illustration using the job perception and job satisfaction constructs , 1999 .

[79]  J. Hair Multivariate data analysis , 1972 .

[80]  Suzanne Rivard,et al.  Toward an Assessment of Software Development Risk , 1993, J. Manag. Inf. Syst..