A Control Theory Perspective on Agile Methodology Use and Changing User Requirements

In this paper, we draw on control theory to understand the conditions under which the use of agile practices is most effective in improving software project quality. Although agile development methodologies offer the potential of improving software development outcomes, limited research has examined how project managers can structure the software development environment to maximize the benefits of agile methodology use during a project. As a result, project managers have little guidance on how to manage teams who are using agile methodologies. Arguing that the most effective control modes are those that provide teams with autonomy in determining the methods for achieving project objectives, we propose hypotheses related to the interaction between control modes, agile methodology use, and requirements change. We test the model in a field study of 862 software developers in 110 teams. The model explains substantial variance in four objective measures of project quality---bug severity, component complexity, coordinative complexity, and dynamic complexity. Results largely support our hypotheses, highlighting the interplay between project control, agile methodology use, and requirements change. The findings contribute to extant literature by integrating control theory into the growing literature on agile methodology use and by identifying specific contingencies affecting the efficacy of different control modes. We discuss the theoretical and practical implications of our results.

[1]  Martin Fowler,et al.  The new methodology , 2001, Wuhan University Journal of Natural Sciences.

[2]  Frederick P. Brooks,et al.  No Silver Bullet: Essence and Accidents of Software Engineering , 1987 .

[3]  Robert L. Glass,et al.  Measuring software design quality , 1990 .

[4]  B. Boehm Software risk management: principles and practices , 1991, IEEE Software.

[5]  J. Hackman,et al.  The psychology of self-management in organizations , 1986 .

[6]  Barry W. Boehm,et al.  Management challenges to implementing agile processes in traditional development organizations , 2005, IEEE Software.

[7]  Russell L. Purvis,et al.  Controlling Information Systems Development Projects: The View from the Client , 2002, Manag. Sci..

[8]  R. Wageman Interdependence and Group Effectiveness , 1995 .

[9]  S. G. Cohen,et al.  What Makes Teams Work: Group Effectiveness Research from the Shop Floor to the Executive Suite , 1997 .

[10]  A. Zellner An Efficient Method of Estimating Seemingly Unrelated Regressions and Tests for Aggregation Bias , 1962 .

[11]  Nancy Bogucki Duncan,et al.  Capturing Flexibility of Information Technology Infrastructure: A Study of Resource Characteristics and their Measure , 1995, J. Manag. Inf. Syst..

[12]  Rajiv D. Banker,et al.  A model to evaluate variables impacting the productivity of software maintenance projects , 1991 .

[13]  Brian Fitzgerald,et al.  Customising agile methods to software practices at Intel Shannon , 2006, Eur. J. Inf. Syst..

[14]  D. Gerwin,et al.  Withdrawal of team autonomy during concurrent engineering , 1997 .

[15]  J. C. Henderson,et al.  Managing I/S Design Teams: A Control Theories Perspective , 1992 .

[16]  John T. Nosek,et al.  The case for collaborative programming , 1998, CACM.

[17]  K. Beck,et al.  Extreme Programming Explained , 2002 .

[18]  W. Greene,et al.  计量经济分析 = Econometric analysis , 2009 .

[19]  M. Iansiti,et al.  Developing products on Internet time. , 1997, Harvard business review.

[20]  D. Chan Functional Relations among Constructs in the Same Content Domain at Different Levels of Analysis: A Typology of Composition Models , 1998 .

[21]  Watts S. Humphrey,et al.  A discipline for software engineering , 2012, Series in software engineering.

[22]  Patricia J. Guinan,et al.  Enabling Software Development Team Performance During Requirements Definition: A Behavioral Versus Technical Approach , 1998, Inf. Syst. Res..

[23]  Gordon B. Davis,et al.  Software Development Practices, Software Complexity, and Software Maintenance Performance: a Field Study , 1998 .

[24]  Robert F. DeVellis,et al.  Scale Development: Theory and Applications. , 1992 .

[25]  James M. Bieman Editorial: Risks to Software Quality , 2004, Software Quality Journal.

[26]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[27]  P. Bliese Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. , 2000 .

[28]  Soon Ang,et al.  Work Outcomes and Job Design for Contract Versus Permanent Information Systems Professionals on Software Development Teams , 2001, MIS Q..

[29]  Mikio Aoyama,et al.  Web-Based Agile Software Development , 1998, IEEE Softw..

[30]  L. James,et al.  Estimating within-group interrater reliability with and without response bias. , 1984 .

[31]  Bernard J. Jaworski Toward a Theory of Marketing Control: Environmental Context, Control Types, and Consequences , 1988 .

[32]  IRIS VESSEY,et al.  Toward a Theory of Computer Program Bugs: An Empirical Test , 1989, Int. J. Man Mach. Stud..

[33]  Bradley L. Kirkman,et al.  The impact of cultural values on job satisfaction and organizational commitment in self-managing work teams: The mediating role of employee resistance. , 2001 .

[34]  Marco Iansiti,et al.  Special Issue on Design and Development: Developing Products on "Internet Time": The Anatomy of a Flexible Development Process , 2001, Manag. Sci..

[35]  Gerald M. Weinberg,et al.  Psychology of computer programming , 1971 .

[36]  Kent L. Beck,et al.  Embracing Change with Extreme Programming , 1999, Computer.

[37]  James E. Tomayko,et al.  The structural complexity of software an experimental test , 2005, IEEE Transactions on Software Engineering.

[38]  L. Kirsch The Management of Complex Tasks in Organizations: Controlling the Systems Development Process , 1996 .

[39]  Gerald E. Ledford,et al.  A Predictive Model of Self-Managing Work Team Effectiveness , 1996 .

[40]  Larry E. Toothaker,et al.  Multiple Regression: Testing and Interpreting Interactions , 1991 .

[41]  Mani R. Subramani,et al.  The Matrix of Control: Combining Process and Structure Approaches to Managing Software Development , 2003, J. Manag. Inf. Syst..

[42]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[43]  Traci Carte,et al.  In Pursuit of Moderation: Nine Common Errors and Their Solutions , 2003, MIS Q..

[44]  David N. Card,et al.  Designing software for producibility , 1992, J. Syst. Softw..

[45]  Detmar W. Straub,et al.  Validating Instruments in MIS Research , 1989, MIS Q..

[46]  Sarma R. Nidumolu The Effect of Coordination and Uncertainty on Software Project Performance: Residual Performance Risk as an Intervening Variable , 1995, Inf. Syst. Res..

[47]  Craig Larman,et al.  Agile and Iterative Development: A Manager's Guide , 2003 .

[48]  Samar Mouakket,et al.  Varieties of Political Process During Systems Development , 1997, Inf. Syst. Res..

[49]  David A. Tepper,et al.  Aligning Software Processes with Strategy , 2006 .

[50]  Michael A. Cusumano,et al.  Software Development on Internet Time , 1999, Computer.

[51]  Bill Curtis,et al.  A field study of the software design process for large systems , 1988, CACM.

[52]  Henri Barki,et al.  Interpersonal Conflict and Its Management in Information System Development , 2001, MIS Q..

[53]  Brian Fitzgerald,et al.  Systems development methodologies: the problem of tenses , 2000, Inf. Technol. People.

[54]  Johan F. Hoorn,et al.  Requirements change: Fears dictate the must haves; desires the won't haves , 2007, J. Syst. Softw..

[55]  Chris F. Kemerer,et al.  Software complexity and software maintenance: A survey of empirical research , 1995, Ann. Softw. Eng..

[56]  K. Klein,et al.  Levels Issues in Theory Development, Data Collection, and Analysis , 1994 .

[57]  Laurie J. Kirsch,et al.  Deploying Common Systems Globally: The Dynamics of Control , 2004, Inf. Syst. Res..

[58]  Rajiv Sabherwal,et al.  Portfolios of Control in Outsourced Software Development Projects , 2003, Inf. Syst. Res..

[59]  Weidong Xia,et al.  The ability of information systems development project teams to respond to business and technology changes: a study of flexibility measures , 2005, Eur. J. Inf. Syst..

[60]  Tuure Tuunanen,et al.  A Contigency Model for Requirements Development , 2007, J. Assoc. Inf. Syst..

[61]  Kent L. Beck,et al.  Test-driven Development - by example , 2002, The Addison-Wesley signature series.

[62]  JaatunMartin Gilje,et al.  Agile Software Development , 2002, Comput. Sci. Educ..

[63]  Andraž Cej,et al.  Agile software development with Scrum , 2010 .

[64]  Alistair Cockburn,et al.  Agile Software Development: The Business of Innovation , 2001, Computer.

[65]  Jan Pries-Heje,et al.  Balancing Quality and Agility in Internet Speed Software Development , 2002, ICIS.

[66]  David Gefen,et al.  The impact of developer responsiveness on perceptions of usefulness and ease of use: an extension of the technology acceptance model , 1998, DATB.

[67]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[68]  W. Ouchi A Conceptual Framework for the Design of Organizational Control Mechanisms , 1979 .

[69]  H. P. Sims,et al.  Leading Workers to Lead Themselves: The External Leadership of Self-Managing Work Teams. , 1987 .

[70]  L. Bailyn Autonomy in the industrial R&D lab , 1985 .

[71]  Kieran Conboy,et al.  Agility from First Principles: Reconstructing the Concept of Agility in Information Systems Development , 2009, Inf. Syst. Res..

[72]  Anas N. Al-Rabadi,et al.  A comparison of modified reconstructability analysis and Ashenhurst‐Curtis decomposition of Boolean functions , 2004 .

[73]  Joyce J. Elam,et al.  Inside a software design team: knowledge acquisition, sharing, and integration , 1993, CACM.

[74]  Kathleen M. Eisenhardt,et al.  Control: Organizational and Economic Approaches , 1985 .

[75]  Salvatore T. March,et al.  Information Systems Research , 2004, IFIP International Federation for Information Processing.

[76]  Likoebe M. Maruping,et al.  Managing team interpersonal processes through technology: a task-technology fit perspective. , 2004, The Journal of applied psychology.

[77]  Terry Anthony Byrd,et al.  Measuring the Flexibility of Information Technology Infrastructure: Exploratory Analysis of a Construct , 2000, J. Manag. Inf. Syst..

[78]  Claus W. Langfred Too Much of a Good Thing? Negative Effects of High Trust and Individual Autonomy in Self-Managing Teams , 2004 .

[79]  Cynthia Mathis Beath,et al.  The Contradictory Structure of Systems Development Methodologies: Deconstructing the IS-User Relationship in Information Engineering , 1994, Inf. Syst. Res..

[80]  Laurie J. Kirsch,et al.  Portfolios of Control Modes and IS Project Management , 1997, Inf. Syst. Res..

[81]  Linda Rising,et al.  The Scrum Software Development Process for Small Teams , 2000, IEEE Softw..

[82]  Kent L. Beck,et al.  Extreme programming explained - embrace change , 1990 .