Why are many business instilling a DevOps culture into their organization?

DevOps can be defined as a cultural movement and a technical solution to improve and accelerate the delivery of business value by making the collaboration between development and operations effective, which is rapidly spreading in software industry. However this movement is relatively recent, being necessary more empirical evidence about the real reasons why companies move to DevOps and what results they expect to obtain when adopting DevOps culture. This paper describes empirical research on practicing DevOps through an exploratory multiple case study of 30 multinational software-intensive companies that consists of interviews to relevant stakeholders. This study aims to help practitioners and researchers to better understand the context and the problems that many companies face day to day in their organizations when they do not reach the levels of innovation and software delivery they expect, as well as the main drivers that move these companies to adopting DevOps. This would contribute to strengthening the evidence and support practitioners in making better informed decisions. Furthermore, we have made available the methods to increase the reliability of findings and the instruments used in this study to motivate others to provide similar evidence to help mature DevOps research and practice.

[1]  Klaas-Jan Stol,et al.  Continuous software engineering: A roadmap and agenda , 2017, J. Syst. Softw..

[2]  C. Spearman.  The proof and measurement of association between two things. , 2015, International journal of epidemiology.

[3]  Yann Mathet,et al.  The Unified and Holistic Method Gamma (γ) for Inter-Annotator Agreement Measure and Alignment , 2015, CL.

[4]  Pasi Kuvaja,et al.  Chapter Four - Advances in Using Agile and Lean Processes for Software Development , 2019, Adv. Comput..

[5]  Terhi Kilamo,et al.  Improving the delivery cycle: A multiple-case study of the toolchains in Finnish software intensive enterprises , 2016, Inf. Softw. Technol..

[6]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[7]  Jeff Sutherland,et al.  Manifesto for Agile Software Development , 2013 .

[8]  Jim Buchan,et al.  DevOps Capabilities, Practices, and Challenges: Insights from a Case Study , 2018, EASE.

[9]  Claes Wohlin,et al.  Experimentation in Software Engineering , 2012, Springer Berlin Heidelberg.

[10]  Kati Kuusinen,et al.  A Large Agile Organization on Its Journey Towards DevOps , 2018, 2018 44th Euromicro Conference on Software Engineering and Advanced Applications (SEAA).

[11]  Ramtin Jabbari,et al.  What is DevOps?: A Systematic Mapping Study on Definitions and Practices , 2016, XP Workshops.

[12]  Guilherme Horta Travassos,et al.  Characterizing DevOps by Hearing Multiple Voices , 2016, SBES '16.

[13]  Stuart Anderson,et al.  Requirements Evolution from Process to Product Oriented Management , 2001, PROFES.

[14]  A. Harden,et al.  Methods for the thematic synthesis of qualitative research in systematic reviews , 2008, BMC medical research methodology.

[15]  Fabio Kon,et al.  A Survey of DevOps Concepts and Challenges , 2020, ACM Comput. Surv..

[16]  Horst Lichter,et al.  Towards Definitions for Release Engineering and DevOps , 2015, 2015 IEEE/ACM 3rd International Workshop on Release Engineering.

[17]  C. Spearman.  The proof and measurement of association between two things. By C. Spearman, 1904. , 1987, The American journal of psychology.

[18]  Pasi Kuvaja,et al.  An Exploratory Study of DevOps Extending the Dimensions of DevOps with Practices , 2016 .

[19]  Christof Ebert,et al.  DevOps , 2016, IEEE Software.

[20]  Bjørnar Tessem,et al.  Problems in the interplay of development and IT operations in system development projects: A Delphi study of Norwegian IT experts , 2011, Inf. Softw. Technol..

[21]  Wu Yu,et al.  Towards a Hypothetical Framework to Secure DevOps Adoption: Grounded Theory Approach , 2020, EASE.

[22]  Janice Singer,et al.  Studying Software Engineers: Data Collection Techniques for Software Field Studies , 2005, Empirical Software Engineering.

[23]  Tommi Mikkonen,et al.  DevOps in practice: A multiple case study of five companies , 2019, Inf. Softw. Technol..

[24]  Tomi Männistö,et al.  DevOps Adoption Benefits and Challenges in Practice: A Case Study , 2016, PROFES.

[25]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[26]  M. Crouch,et al.  The logic of small samples in interview-based qualitative research , 2006 .

[27]  Andrea Villegas,et al.  DevOps in Practice - A preliminary Analysis of two Multinational Companies , 2019, PROFES.

[28]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[29]  Maya Daneva,et al.  A Mapping Study on Cooperation between Information System Development and Operations , 2014, PROFES.

[30]  Eoin Woods.  Software Architecture in a Changing World , 2016, IEEE Software.

[31]  Mika Mäntylä,et al.  The highways and country roads to continuous deployment , 2015, IEEE Software.

[32]  Susanne Friese,et al.  Qualitative Data Analysis with ATLAS.ti , 2012 .

[33]  Patrick Debois,et al.  Agile Infrastructure and Operations: How Infra-gile are You? , 2008, Agile 2008 Conference.

[34]  Torgeir Dingsøyr,et al.  A decade of agile methodologies: Towards explaining agile software development , 2012, J. Syst. Softw..

[35]  Dror G. Feitelson,et al.  Development and Deployment at Facebook , 2013, IEEE Internet Computing.

[36]  Floris Erich,et al.  DevOps is Simply Interaction Between Development and Operations , 2018, DEVOPS.

[37]  Jennifer Pérez,et al.  DevOps in practice: an exploratory case study , 2018, XP Companion.

[38]  Eric Helms,et al.  The Top 10 Adages in Continuous Deployment , 2017, IEEE Software.

[39]  Peter N. Rule,et al.  A Necessary Dialogue , 2015 .

[40]  Pasi Kuvaja,et al.  Relationship of DevOps to Agile, Lean and Continuous Deployment - A Multivocal Literature Review Study , 2016, PROFES.

[41]  Fabio Kon,et al.  Platform Teams: An Organizational Structure for Continuous Delivery , 2020, ICSE.

[42]  Daniela Cruzes,et al.  Recommended Steps for Thematic Synthesis in Software Engineering , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[43]  K. Krippendorff.  Krippendorff, Klaus, Content Analysis: An Introduction to its Methodology . Beverly Hills, CA: Sage, 1980. , 1980 .

[44]  Ramtin Jabbari,et al.  Towards a benefits dependency network for DevOps based on a systematic literature review , 2018, J. Softw. Evol. Process..

[45]  Farrokh Jazizadeh,et al.  Indoor Positioning Based on Visible Light Communication , 2019, ACM Comput. Surv..

[46]  Ivan Porres,et al.  DevOps: A Definition and Perceived Adoption Impediments , 2015, XP.

[47]  Jan Bosch,et al.  Building Products as Innovation Experiment Systems , 2012, ICSOB.

[48]  Jerry Floersch,et al.  Integrating Thematic, Grounded Theory and Narrative Analysis , 2010 .

[49]  W. A. Scott,et al.  Reliability of Content Analysis ; The Case of Nominal Scale Cording , 1955 .

[50]  Daniela E. Damian,et al.  Selecting Empirical Methods for Software Engineering Research , 2008, Guide to Advanced Empirical Software Engineering.

[51]  John W. Creswell,et al.  Research Design: Qualitative, Quantitative, and Mixed Methods Approaches , 2010 .

[52]  Klaus Krippendorff,et al.  Computing Krippendorff's Alpha-Reliability , 2011 .

[53]  K. Krippendorff.  Reliability in Content Analysis: Some Common Misconceptions and Recommendations , 2004 .

[54]  Juliet M. Corbin,et al.  Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory , 2008 .

[55]  Mary Poppendieck,et al.  Implementing Lean Software Development: From Concept to Cash (The Addison-Wesley Signature Series) , 2006 .

[56]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[57]  J. Fleiss.  Measuring nominal scale agreement among many raters. , 1971 .

[58]  Klaus Krippendorff,et al.  On the reliability of unitizing textual continua: Further developments , 2016 .

[59]  Julian M. Bass,et al.  Spotify Tailoring for Promoting Effectiveness in Cross-Functional Autonomous Squads , 2019, XP Workshops.

[60]  Klaus Krippendorff,et al.  Answering the Call for a Standard Reliability Measure for Coding Data , 2007 .

[61]  Ioannis Stamelos,et al.  Software project management anti-patterns , 2010, J. Syst. Softw..

[62]  Ricardo Colomo-Palacios,et al.  Characterizing DevOps Culture: A Systematic Literature Review , 2018 .

[63]  Rodrigo Bonifácio,et al.  Adopting DevOps in the real world: A theory, a model, and a case study , 2019, J. Syst. Softw..

[64]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[65]  Maya Daneva,et al.  A qualitative study of DevOps usage in practice , 2017, J. Softw. Evol. Process..