Combining lean thinking and agile software development : how do software-intensive companies use them in practice?

Software engineering is advancing according to market needs. Consequently, software development methods that initially caused controversies such as Agile, and more recently Lean, are increasingly being adopted by the software industry. Particularly, Lean Software Development, which was initially regarded as one of the Agile methods, is acquiring an identity of its own as a means to scale Agile. However, Lean thinking is still open to interpretation in the domain of software development, which differs fundamentally from the manufacturing domain where Lean originally emerged. Specific issues such as the essence of Lean Software Development, the compatibility of Lean and Agile and the best combination of them are not properly understood. This dissertation addresses Lean thinking and its combination with Agile in the field of software development, by providing empirical evidence on how software-intensive organisations use them in practice. The research was performed in four phases. First, the relevant literature was analysed to identify research opportunities. Second, a survey strategy was used to investigate status and trends in the adoption of Agile and Lean. The third phase explored in detail how Agile and Lean are combined in practice, by conducting case studies on two large-scale, industryleading companies that were transforming their processes from Agile Software Development into Lean Software Development. Finally, in the fourth phase, the results of the previous research phases were synthetized to draw conclusions and outline implications. The results of the study confirmed the interest of practitioners in using a combination of Agile and Lean. Unlike in manufacturing, the borders of Agile and Lean are not clearly defined in the software domain. The results provided evidence of numerous compatibilities between Agile and Lean in software development. Generally, the use of Agile methods at a prescriptive level is guided by Lean principles. However, Lean thinking also brings new practical elements to software development processes, such as Kanban, work-in-progress limits, a ‘pull’ and ‘less waste’oriented culture and an extended emphasis on transparency and collaborative development. The results showed the fundamental importance of practices that enable quick feedback, fast learning and adaptation.

[1]  Manoj Kumar Tiwari,et al.  Modeling the metrics of lean, agile and leagile supply chain: An ANP-based approach , 2006, Eur. J. Oper. Res..

[2]  Pekka Abrahamsson,et al.  The impact of agile practices on communication in software development , 2008, Empirical Software Engineering.

[3]  Maarit Laanti,et al.  Agile Methods in large-scale software development organizations : applicability and model for adoption , 2012 .

[4]  Jay Trimble,et al.  From Traditional, to Lean, to Agile Development: Finding the Optimal Software Engineering Cycle , 2013, 2013 46th Hawaii International Conference on System Sciences.

[5]  Rachna Shah,et al.  Defining and developing measures of lean production , 2007 .

[6]  M. Myllykoski Structure and function of the myelin enzyme 2′,3′-cyclic nucleotide 3′-phosphodiesterase , 2013 .

[7]  Michael A. Cusumano,et al.  Lean Software Development: A Tutorial , 2012, IEEE Software.

[8]  Kurt Matzler,et al.  THE KANO MODEL: HOW TO DELIGHT YOUR CUSTOMERS , 1996 .

[9]  Claes Wohlin,et al.  Experimentation in Software Engineering , 2012, Springer Berlin Heidelberg.

[10]  Vinod Kumar,et al.  Identifying some important success factors in adopting agile software development practices , 2009, J. Syst. Softw..

[11]  M. Kuokkanen Development of an eco- and material-efficient pellet production chain—a chemical study , 2013 .

[12]  Xiaofeng Wang,et al.  People over Process: Key Challenges in Agile Development , 2011, IEEE Software.

[13]  Andrey Maglyas,et al.  Lean Solutions to Software Product Management Problems , 2012, IEEE Software.

[14]  Danny Berry,et al.  Leagility: Integrating the lean and agile manufacturing paradigms in the total supply chain , 1999 .

[15]  Juhani Iivari,et al.  The relationship between organizational culture and the deployment of agile methods , 2011, Inf. Softw. Technol..

[16]  David Raffo,et al.  Providing value to customers in software development through lean principles , 2008 .

[17]  J. Hokkanen Liquid chromatography/mass spectrometry of bioactive secondary metabolites – in vivo and in vitro studies , 2013 .

[18]  Pasi Kuvaja,et al.  Combining Lean Thinking and Agile Methods for Software Development: A Case Study of a Finnish Provider of Wireless Embedded Systems Detailed , 2014, 2014 47th Hawaii International Conference on System Sciences.

[19]  D. Towill,et al.  Supply chain migration from lean and functional to agile and customised , 2000 .

[20]  Markku Oivo,et al.  Establishing product process dependencies in SPI , 1999 .

[21]  Pasi Kuvaja,et al.  Software process capability and maturity determination : BOOTSTRAP methodology and its evolution , 2012 .

[22]  D. Sim The Rise of the Network Society (The Information Age: Economy, Society and Culture, Volume 1) , 1998 .

[23]  Mary Poppendieck,et al.  Leading Lean Software Development: Results Are Not the Point , 2009 .

[24]  Tore Dybå,et al.  Empirical studies of agile software development: A systematic review , 2008, Inf. Softw. Technol..

[25]  Marshall S. Smith,et al.  The general inquirer: A computer approach to content analysis. , 1967 .

[26]  Remko I. van Hoek,et al.  The thesis of leagility revisited , 2000 .

[27]  Anthony I. Wasserman Low ceremony processes for short lifecycle projects (keynote) , 2013, ICSSP 2013.

[28]  Jeff Sutherland,et al.  Manifesto for Agile Software Development , 2013 .

[29]  Raul Sidnei Wazlawick,et al.  Agile methods and organizational culture: reflections about cultural levels , 2009, J. Softw. Maintenance Res. Pract..

[30]  Carl Lawrence Innovating with information technology in a globalized world : being proactive about culture , 2013 .

[31]  Juan Garbajosa,et al.  Analyzing the Drivers of the Combination of Lean and Agile in Software Development Companies , 2012, PROFES.

[32]  Raul Sidnei Wazlawick,et al.  The influence of organizational culture on the adoption of extreme programming , 2008, J. Syst. Softw..

[33]  Carolyn B. Seaman,et al.  Qualitative Methods in Empirical Studies of Software Engineering , 1999, IEEE Trans. Software Eng..

[34]  D. Morgan Focus groups for qualitative research. , 1988, Hospital guest relations report.

[35]  Barry W. Boehm Towards richer process principles , 2011, ICSSP '11.

[36]  Neil C. Ramiller,et al.  The Organizing Vision in Information Systems Innovation , 1997 .

[37]  Muhammad Ovais Ahmad,et al.  Kanban in software development: A systematic literature review , 2013, 2013 39th Euromicro Conference on Software Engineering and Advanced Applications.

[38]  Mary Poppendieck,et al.  Implementing Lean Software Development: From Concept to Cash (The Addison-Wesley Signature Series) , 2006 .

[39]  Kathleen M. Eisenhardt,et al.  DYNAMIC CAPABILITIES, WHAT ARE THEY? , 2000 .

[40]  Pavlo Ardanov Priming capacities of endophytic Methylobacterium sp. on potato ( Solanum tuberosum L.) , 2013 .

[41]  J. Liker The Toyota Way , 2003 .

[42]  S. Raman Lean software development: is it feasible? , 1998, 17th DASC. AIAA/IEEE/SAE. Digital Avionics Systems Conference. Proceedings (Cat. No.98CH36267).

[43]  Matt Stephens,et al.  Extreme Programming Refactored: The Case Against XP , 2003, Apress.

[44]  N. Tokatli Global sourcing: insights from the global clothing industry—the case of Zara, a fast fashion retailer , 2007 .

[45]  A. Cockburn,et al.  Agile Software Development: The People Factor , 2001, Computer.

[46]  Craig Larman,et al.  Scaling Lean & Agile Development: Thinking and Organizational Tools for Large-Scale Scrum , 2008 .

[47]  M. Castells The Information Age: Economy, Society and Culture , 1999 .

[48]  Waldemar Karwowski,et al.  A review of enterprise agility: Concepts, frameworks, and attributes , 2007 .

[49]  K. Juntunen Tieto- ja viestintätekniikan soveltamiseen perustuvat toimintaprosessien uudistukset terveydenhuollossa : sosio-teknis-taloudellinen näkökulma , 2012 .

[50]  Steve R. Palmer,et al.  A Practical Guide to Feature-Driven Development , 2002 .

[51]  Audrey Hernoux-Villière Catalytic depolymerisation of starch-based industrial waste : use of non-conventional activation methods and novel reaction media , 2013 .

[52]  Tony Gorschek,et al.  The lean gap: A review of lean approaches to large-scale software systems development , 2013, J. Syst. Softw..

[53]  Dag I. K. Sjøberg,et al.  Quantifying the Effect of Using Kanban versus Scrum: A Case Study , 2012, IEEE Software.

[54]  John W. Creswell,et al.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches , 2010 .

[55]  Pekka Abrahamsson,et al.  Lean Software Development , 2012, IEEE Softw..

[56]  Kai Petersen ImplemenTIng leAn And AgIle SofTwARe developmenT In InduSTRy , 2010 .

[57]  K. Seppä Quantifying regional variation in the survival of cancer patients , 2012 .

[58]  Jim Highsmith,et al.  Agile Software Development Ecosystems , 2002 .

[59]  A. Adam Whatever happened to information systems ethics? Caught between the devil and the deep blue sea , 2004 .

[60]  S. Dutta,et al.  The Global Information Technology Report , 2003 .

[61]  Janice Singer,et al.  Guide to Advanced Empirical Software Engineering , 2007 .

[62]  M. Venables Boeing: going for lean [lean manufacturing] , 2005 .

[63]  Michael A. Cusumano Reflections on the Toyota debacle , 2011, Commun. ACM.

[64]  James O. Coplien,et al.  Lean Architecture: for Agile Software Development , 2010 .

[65]  M. Castells Rise of the Network Society: The Information Age: Economy, Society and Culture , 1996 .

[66]  Peter Middleton,et al.  Lean Software Management: BBC Worldwide Case Study , 2012, IEEE Transactions on Engineering Management.

[67]  James P. Womack,et al.  Lean Thinking: Banish Waste and Create Wealth in Your Corporation , 1996 .

[68]  Bernhard Rumpe,et al.  Limitations of Agile Software Processes , 2014, ArXiv.

[69]  Torgeir Dingsøyr,et al.  A decade of agile methodologies: Towards explaining agile software development , 2012, J. Syst. Softw..

[70]  Tsun Chow,et al.  A survey study of critical success factors in agile software projects , 2008, J. Syst. Softw..

[71]  Richard Baskerville,et al.  Fashion Waves in Information Systems Research and Practice , 2009, MIS Q..

[72]  Aaron J. Shenhar,et al.  Adapting Your Technological Base: The Organizational Challenge , 2007 .

[73]  O. Vuolteenaho,et al.  Genetic analysis of demography and selection in Lyrate rockcress (Arabidopsis lyrata) populations , 2013 .

[74]  James Sutton,et al.  Lean Software Strategies: Proven Techniques for Managers and Devel - opers , 2005 .

[75]  Tore Dybå,et al.  What's the Evidence for Lean? , 2012, IEEE Software.

[76]  J. Holm Catalytic pretreatment and hydrolysis of fibre sludge into reducing sugars , 2013 .

[77]  Christopher S Kim,et al.  Implementation of lean thinking: one health system's journey. , 2009, Joint Commission journal on quality and patient safety.

[78]  Emma Parnell-Klabo Introducing lean principles with agile practices at a Fortune 500 company , 2006, AGILE 2006 (AGILE'06).

[79]  Jane Cleland-Huang Are Requirements Alive and Kicking? , 2013, IEEE Software.

[80]  Pekka Abrahamsson,et al.  ‘Lots done, more to do’: the current state of agile systems development research , 2009, Eur. J. Inf. Syst..

[81]  Kent L. Beck,et al.  Extreme programming explained - embrace change , 1990 .

[82]  Ivar Jacobson,et al.  The Unified Software Development Process , 1999 .

[83]  P. Boehm,et al.  Some Future Trends and Implications for Systems and Software Engineering , 2006 .

[84]  William W. Agresti,et al.  New paradigms for software development : tutorial , 1986 .

[85]  Pekka Abrahamsson,et al.  Exploring the Sources of Waste in Kanban Software Development Projects , 2010, 2010 36th EUROMICRO Conference on Software Engineering and Advanced Applications.

[86]  Pasi Kuvaja,et al.  BOOTSTRAP — a European assessment methodology , 2004, Software Quality Journal.

[87]  Juan Garbajosa,et al.  Building lean thinking in a telecom software development organization: strengths and challenges , 2013, ICSSP 2013.

[88]  Kieran Conboy,et al.  Agility from First Principles: Reconstructing the Concept of Agility in Information Systems Development , 2009, Inf. Syst. Res..

[89]  D. Reinertsen The Principles of Product Development Flow: Second Generation Lean Product Development , 2009 .

[90]  Luciano Brandão de Souza,et al.  Trends and approaches in lean healthcare , 2009 .

[91]  Charles G. Cobb Making Sense of Agile Project Management: Balancing Control and Agility , 2011 .

[92]  Chuck Maples Enterprise Agile Transformation: The Two-Year Wall , 2009, 2009 Agile Conference.

[93]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[94]  Tyson R. Browning,et al.  Applying the design structure matrix to system decomposition and integration problems: a review and new directions , 2001, IEEE Trans. Engineering Management.

[95]  Mary Poppendieck,et al.  Lean Software Development: An Agile Toolkit , 2003 .

[96]  Robert L. Nord,et al.  Making Architecture Visible to Improve Flow Management in Lean Software Development , 2012, IEEE Software.

[97]  Hossein Sharifi,et al.  A methodology for achieving agility in manufacturing organisations : An introduction , 1999 .

[98]  Rick Dove,et al.  21st Century Manufacturing Enterprise Strategy: An Industry-Led View , 1991 .

[99]  Kweku Ewusi-Mensah,et al.  Software development failures : anatomy of abandoned projects , 2003 .

[100]  Laura Lehtola,et al.  The Focus Group Method as an Empirical Tool in Software Engineering , 2008, Guide to Advanced Empirical Software Engineering.

[101]  Kati Vilkki,et al.  When Agile Is Not Enough , 2010, LESS.

[102]  Ulla Kemi Adaptation to growing season length in the perennial Arabidopsis lyrata , 2013 .

[103]  Dorothy E. Leidner,et al.  Review: A Review of Culture in Information Systems Research: Toward a Theory of Information Technology Culture Conflict , 2006, MIS Q..

[104]  Jan C. Recker,et al.  Information Systems Research as a Science , 2021, Progress in IS.

[105]  Xiaofeng Wang,et al.  Comparing Apples with Oranges? The Perceived Differences between Agile and Lean Software Development Processes , 2011, ICIS.

[106]  Philippe Kruchten,et al.  A plea for lean software process models , 2011, ICSSP '11.

[107]  Bengt Klefsjö,et al.  The machine that changed the world , 2008 .

[108]  Oisín Cawley,et al.  "Leagile" software development: An experience report analysis of the application of lean approaches in agile software development , 2012, J. Syst. Softw..

[109]  Diane E. Strode,et al.  The Impact of Organizational Culture on Agile Method Use , 2009, 2009 42nd Hawaii International Conference on System Sciences.

[110]  Daniel E. Turk,et al.  AGILE SOFTWARE DEVELOPMENT: A SURVEY OF EARLY ADOPTERS , 2008 .

[111]  Victor R. Basili,et al.  Iterative enhancement: A practical technique for software development , 1975, IEEE Transactions on Software Engineering.

[112]  Barry W. Boehm,et al.  Agility through Discipline: A Debate , 2003, Computer.

[113]  Burak Turhan,et al.  What Is Flowing in Lean Software Development? , 2010, LESS.

[114]  K. Krippendorff Reliability in Content Analysis: Some Common Misconceptions and Recommendations , 2004 .

[115]  Peter Middleton,et al.  Lean Software Development: Two Case Studies , 2001, Software Quality Journal.

[116]  Mikael Lindvall,et al.  An introduction to agile methods , 2004, Adv. Comput..

[117]  Gareth R. Jones Organizational theory, design, and change / Gareth R. Jones. , 2006 .

[118]  Philip L. Bowers Highpoints From the Agile Software Development Forum , 2002 .

[119]  Ken Schwaber,et al.  Agile Software Development with SCRUM , 2001 .

[120]  Barry W. Boehm,et al.  Get Ready for Agile Methods, with Care , 2002, Computer.

[121]  Bradley R. Staats,et al.  Lean principles, learning, and knowledge work: Evidence from a software services provider , 2011 .

[122]  Barry Boehm,et al.  Using the Incremental Commitment Model to Integrate System Acquisition, Systems Engineering, and Software Engineering , 2007 .

[123]  Tuomas Lehto The importance of persuasive systems design in enhancing consumers’ perceptions and adoption of health behavior change support systems , 2013 .

[124]  Pilar Rodríguez Marín,et al.  The Interpretation and Legitimization of Values in Agile's Organizing Vision , 2012, ECIS.

[125]  Jürgen Münch,et al.  Software Process Definition and Management , 2012, The Fraunhofer IESE Series on Software and Systems Engineering.

[126]  E. Jansson Past and present genetic diversity and structure of the Finnish wolf population , 2013 .

[127]  Daniela Cruzes,et al.  Recommended Steps for Thematic Synthesis in Software Engineering , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[128]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[129]  Jouni Markkula,et al.  Survey on agile and lean usage in finnish software industry , 2012, Proceedings of the 2012 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement.

[130]  Barry W. Boehm,et al.  A spiral model of software development and enhancement , 1986, Computer.

[131]  Peter Middleton,et al.  Lean Software Management Case Study: Timberline Inc , 2005, XP.

[132]  W. W. Royce,et al.  Managing the development of large software systems , 1970 .

[133]  Pasi Kuvaja,et al.  Approaches to Agile Adoption in Large Settings: A Comparison of the Results from a Literature Analysis and an Industrial Inventory , 2010, PROFES.