Developing a grounded theory to explain the practices of self-organizing Agile teams

Software Engineering researchers are constantly looking to improve the quantity and quality of their research findings through the use of an appropriate research methodology. Over the last decade, there has been a sustained increase in the number of researchers exploring the human and social aspects of Software Engineering, many of whom have used Grounded Theory. We have used Grounded Theory as a qualitative research method to study 40 Agile practitioners across 16 software organizations in New Zealand and India and explore how these Agile teams self-organize. We use our study to demonstrate the application of Grounded Theory to Software Engineering. In doing so, we present (a) a detailed description of the Grounded Theory methodology in general and its application in our research in particular; (b) discuss the major challenges we encountered while performing Grounded Theory’s various activities and our strategies for overcoming these challenges; and (c) we present a sample of our data and results to illustrate the artifacts and outcomes of Grounded Theory research.

[1]  James A. Highsmith,et al.  Adaptive Software Development: A Collaborative Approach to Managing Complex Systems , 1999 .

[2]  Tore Dybå,et al.  Empirical studies of agile software development: A systematic review , 2008, Inf. Softw. Technol..

[3]  Helen Sharp,et al.  Collaboration and co-ordination in mature eXtreme programming teams , 2008, Int. J. Hum. Comput. Stud..

[4]  Tsun Chow,et al.  A survey study of critical success factors in agile software projects , 2008, J. Syst. Softw..

[5]  Eric Molleman,et al.  VARIETY AND THE REQUISITE OF SELF‐ORGANIZATION , 1998 .

[6]  R. Suddaby.  From the Editors: What Grounded Theory is Not , 2006 .

[7]  Ken Schwaber,et al.  Agile Software Development with SCRUM , 2001 .

[8]  Philippe Kruchten,et al.  A methodological leg to stand on: lessons learned using grounded theory to study software development , 2008, CASCON '08.

[9]  Torgeir Dingsøyr,et al.  Scrum and Team Effectiveness: Theory and Practice , 2008, XP.

[10]  Rory V. O'Connor,et al.  Using grounded theory to understand software process improvement: A study of Irish software product companies , 2007, Inf. Softw. Technol..

[11]  G. Thomas,et al.  Reinventing grounded theory: some questions about theory, ground and discovery , 2006 .

[12]  S. Georgieva,et al.  Best Practices in Project Management Through a Grounded Theory Lens , 2008 .

[13]  Tore Dybå,et al.  Understanding Self-Organizing Teams in Agile Software Development , 2008 .

[14]  Jeffrey C. Carver.  The Impact of Background and Experience on Software Inspections , 2004, Empirical Software Engineering.

[15]  Robert C. Martin,et al.  Iterative and Incremental development , 1999 .

[16]  James Noble,et al.  The XP Customer Team: A Grounded Theory , 2009, 2009 Agile Conference.

[17]  Steve R. Palmer,et al.  A Practical Guide to Feature-Driven Development , 2002 .

[18]  Anthony F. Norcio,et al.  Exploring language in software process elicitation: A grounded theory approach , 2009, 2009 3rd International Symposium on Empirical Software Engineering and Measurement.

[19]  R. Larossa,et al.  Grounded Theory Methods and Qualitative Family Research. , 2005 .

[20]  B. Glaser.  Basics of Grounded Theory Analysis: Emergence Vs. Forcing , 1992 .

[21]  Kent L. Beck,et al.  Extreme programming explained - embrace change , 1990 .

[22]  James Noble,et al.  Agile Undercover: When Customers Don't Collaborate , 2010, XP.

[23]  Tore Dybå,et al.  Understanding Self-Organizing Teams in Agile Software Development , 2008, 19th Australian Conference on Software Engineering (aswec 2008).

[24]  Viktor Mikhaĭlovich Glushkov,et al.  An Introduction to Cybernetics , 1957, The Mathematical Gazette.

[25]  Judith A. Holton,et al.  Remodeling Grounded Theory , 2004 .

[26]  Bg Glaser,et al.  The grounded theory perspective Theoretical coding. , 2005 .

[27]  James Noble,et al.  Organizing self-organizing teams , 2010, 2010 ACM/IEEE 32nd International Conference on Software Engineering.

[28]  B. Glaser.  Theoretical Sensitivity: Advances in the Methodology of Grounded Theory , 1978 .

[29]  Helen Sharp,et al.  An Ethnographic Study of XP Practice , 2004, Empirical Software Engineering.

[30]  Jutta Eckstein,et al.  Xtreme programming and agile coaching , 2003, OOPSLA '03.

[31]  Sanjiv Augustine,et al.  Agile project management: steering from the edges , 2005, CACM.

[32]  A. Cockburn,et al.  Agile Software Development: The People Factor , 2001, Computer.

[33]  Rachel K. E. Bellamy,et al.  Moving into a new software project landscape , 2010, 2010 ACM/IEEE 32nd International Conference on Software Engineering.

[34]  Robert C. Martin.  Agile Software Development, Principles, Patterns, and Practices , 2002 .

[35]  A. Strauss,et al.  Basics of qualitative research: Grounded theory procedures and techniques. , 1992 .

[36]  James Noble,et al.  Balancing acts: walking the Agile tightrope , 2010, CHASE '10.

[37]  James Noble,et al.  Negotiating Contracts for Agile Projects: A Practical Perspective , 2009, XP.

[38]  Andrew Begel,et al.  Usage and Perceptions of Agile Software Development in an Industrial Context: An Exploratory Study , 2007, ESEM 2007.

[39]  A. Strauss,et al.  The discovery of grounded theory: strategies for qualitative research aldine de gruyter , 1968 .

[40]  Pekka Abrahamsson,et al.  The impact of agile practices on communication in software development , 2008, Empirical Software Engineering.

[41]  James Noble,et al.  Using grounded theory to study the human aspects of software engineering , 2010, HAoSE '10.

[42]  Venugopal Balijepally,et al.  Theoretical reflections on agile development methodologies , 2007, Commun. ACM.

[43]  Frank Maurer,et al.  Knowledge Sharing in Agile Software Teams , 2004, Logic versus Approximation.

[44]  K. Parry.  Grounded theory and social process: A new direction for leadership research , 1998 .

[45]  B. Glaser.  Doing grounded theory : issues and discussions , 1998 .

[46]  J. Alexander,et al.  Images of Organization , 1988 .

[47]  I. Nonaka.  A Dynamic Theory of Organizational Knowledge Creation , 1994 .

[48]  George Mangalaraj,et al.  Challenges of migrating to agile methodologies , 2005, CACM.

[49]  Robert Biddle,et al.  The Social Nature of Agile Teams , 2007, Agile 2007 (AGILE 2007).

[50]  Jim Highsmith.  Agile Project Management: Creating Innovative Products , 2009 .

[51]  Alistair Cockburn,et al.  Crystal Clear: A Human-Powered Methodology for Small Teams , 2004 .

[52]  Philippe Kruchten,et al.  Agility in context , 2010, OOPSLA.

[53]  E. Molleman,et al.  Empowerment and team development , 1998 .

[54]  Kent L. Beck,et al.  Agile management - an oxymoron?: who needs managers anyway? , 2003, OOPSLA '03.

[55]  George Allan,et al.  A critique of using grounded theory as a research method , 2003 .

[56]  Alistair Cockburn,et al.  People and Methodologies in Software Development , 2003 .