Identification and prioritization of DevOps success factors using fuzzy-AHP approach

DevOps (development and operations) is a collaborative and multidisciplinary organizational effort to automate continuous delivery of a software project with an aim to improve software quality. The implementation of DevOps practices is not straightforward as there are several complexities associated with it. The aim of this study is to identify and prioritize the factors that positively influence the DevOps practices in software organizations. Using a systematic literature review, 19 factors were identified. The identified factors were further validated with experts via a questionnaire survey study. Finally, Fuzzy Analytical Hierarchy Process (FAHP) was used to prioritize the identified success factors. The results indicate that “DevOps security pipeline,” “use system orchestration” and “attempt matrix organization and transparency” factors are the highest ranked success factors for the successful implementation of DevOps practices. The FAHP analysis is novel in this research area as it provides the prioritization based taxonomy of the identified factors which will assist the researchers and practitioners to focus on the critical areas that are significant for the successful adoption of DevOps practices.

[1]  Mohammad Alshayeb,et al.  Towards Implementation of Requirements Management Specific Practices (SP1.3 and SP1.4) for Saudi Arabian Small and Medium Sized Software Development Organizations , 2017, IEEE Access.

[2]  Arif Ali Khan,et al.  Systematic literature study for dimensional classification of success factors affecting process improvement in global software development: client-vendor perspective , 2018, IET Softw..

[3]  Arif Ali Khan,et al.  Prioritizing challenges of agile process in distributed software development environment using analytic hierarchy process , 2018, J. Softw. Evol. Process..

[4]  Mika Mäntylä,et al.  The highways and country roads to continuous deployment , 2015, IEEE Software.

[5]  Brian M. Belgodere,et al.  Composable DevOps: Automated Ontology Based DevOps Maturity Analysis , 2015, 2015 IEEE International Conference on Services Computing.

[6]  José Carlos Bregieiro Ribeiro,et al.  Improving La Redoute's CI/CD Pipeline and DevOps Processes by Applying Machine Learning Techniques , 2018, 2018 11th International Conference on the Quality of Information and Communications Technology (QUATIC).

[7]  Sajjad Mahmood,et al.  Success factors influencing requirements change management process in global software development , 2019, J. Comput. Lang..

[8]  Lotfi Ben Othmane,et al.  SecDevOps: Is It a Marketing Buzzword? - Mapping Research on Security in DevOps , 2016, 2016 11th International Conference on Availability, Reliability and Security (ARES).

[9]  Kraig Finstad,et al.  Response interpolation and scale sensitivity: evidence against 5-point scales , 2010 .

[10]  Ramtin Jabbari,et al.  What is DevOps?: A Systematic Mapping Study on Definitions and Practices , 2016, XP Workshops.

[11]  Lianping Chen,et al.  Continuous Delivery: Huge Benefits, but Challenges Too , 2015, IEEE Software.

[12]  Tahere Yaghoobi,et al.  Prioritizing key success factors of software projects using fuzzy AHP , 2018, J. Softw. Evol. Process..

[13]  Pasi Kuvaja,et al.  Relationship of DevOps to Agile, Lean and Continuous Deployment - A Multivocal Literature Review Study , 2016, PROFES.

[14]  Lianping Chen,et al.  Towards an Evidence-Based Understanding of Electronic Data Sources , 2010, EASE.

[15]  Muhammad Azeem Akbar,et al.  SRCMIMM: managing requirements change activities in global software development: student research abstract , 2019, SAC.

[16]  Horst Lichter,et al.  Towards Definitions for Release Engineering and DevOps , 2015, 2015 IEEE/ACM 3rd International Workshop on Release Engineering.

[17]  Sajjad Mahmood,et al.  Challenges of project management in global software development: A client-vendor analysis , 2016, Inf. Softw. Technol..

[18]  Tomi Männistö,et al.  DevOps Adoption Benefits and Challenges in Practice: A Case Study , 2016, PROFES.

[19]  Thierry Marchant,et al.  Evaluation and Decision Models: A Critical Perspective , 2000 .

[20]  Ivan Porres,et al.  DevOps: A Definition and Perceived Adoption Impediments , 2015, XP.

[21]  Matt Callanan,et al.  DevOps: Making It Easy to Do the Right Thing , 2016, IEEE Software.

[22]  Deepak Kumar,et al.  Modeling and measuring attributes influencing DevOps implementation in an enterprise using structural equation modeling , 2017, Inf. Softw. Technol..

[23]  Wasif Afzal,et al.  A systematic review of search-based testing for non-functional system properties , 2009, Inf. Softw. Technol..

[24]  Zhiguang Qin,et al.  Toward unified DevOps model , 2015, 2015 6th IEEE International Conference on Software Engineering and Service Science (ICSESS).

[25]  Hausi A. Müller,et al.  DevOps' Shift-Left in Practice: An Industrial Case of Application , 2018 .

[26]  Josef J. Langerman,et al.  Factors inhibiting the adoption of DevOps in large organisations: South African context , 2017, 2017 2nd IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT).

[27]  Fabio Kon,et al.  A Survey of DevOps Concepts and Challenges , 2020, ACM Comput. Surv..

[28]  Drakoulis Martakos,et al.  Supplier selection in electronic marketplaces using satisficing and fuzzy AHP , 2010, Expert Syst. Appl..

[29]  Karin Melendez,et al.  Software Product Quality in DevOps Contexts: A Systematic Literature Review , 2019 .

[30]  Ramtin Jabbari,et al.  Towards a benefits dependency network for DevOps based on a systematic literature review , 2018, J. Softw. Evol. Process..

[31]  Matthew Sacks.  DevOps Principles for Successful Web Sites , 2012 .

[32]  Liming Zhu,et al.  Beyond Continuous Delivery: An Empirical Investigation of Continuous Deployment Challenges , 2017, 2017 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM).

[33]  Jordi Cabot,et al.  Are CS conferences (too) closed communities? , 2018, Commun. ACM.

[34]  Sajjad Mahmood,et al.  Toward successful project management in global software development , 2016 .

[35]  Jim Buchan,et al.  DevOps Capabilities, Practices, and Challenges: Insights from a Case Study , 2018, EASE.

[36]  Shari Lawrence Pfleeger,et al.  Principles of survey research part 6: data analysis , 2003, SOEN.

[37]  Gene Kim,et al.  Leading the Transformation: Applying Agile and DevOps Principles at Scale , 2015 .

[38]  Daniela E. Damian,et al.  Selecting Empirical Methods for Software Engineering Research , 2008, Guide to Advanced Empirical Software Engineering.

[39]  Arif Ali Khan,et al.  Fuzzy AHP based prioritization and taxonomy of software process improvement success factors in global software development , 2019, Appl. Soft Comput..

[40]  Carol Lefebvre,et al.  The effect of postings information on searching behaviour A statistical approach to designing search filters to find systematic reviews : objectivity enhances accuracy , 2001 .

[41]  Lianping Chen,et al.  The Journal of Systems and Software , 2022 .

[42]  Anne Connell,et al.  Modern DevOps: Optimizing software development through effective system interactions , 2014, 2014 IEEE International Professional Communication Conference (IPCC).

[43]  Prabal Mahanta,et al.  DevOps culture and its impact on cloud delivery and software development , 2016, 2016 International Conference on Advances in Computing, Communication, & Automation (ICACCA) (Spring).

[44]  Martin Bland,et al.  An Introduction to Medical Statistics , 1987 .

[45]  Nicole Forsgren.  DevOps delivers , 2018, Commun. ACM.

[46]  Ari Fadli,et al.  Pioneering the automation of lnternal quality assurance system of higher education (IQAS-HE) using DevOps approach , 2017, 2017 International Conference on Sustainable Information Engineering and Technology (SIET).

[47]  Kostas Pentikousis,et al.  Service Provider DevOps , 2017, IEEE Communications Magazine.

[48]  Selin Soner Kara,et al.  Long term supplier selection using a combined fuzzy MCDM approach: A case study for a telecommunication company , 2009, Expert Syst. Appl..

[49]  Bill Curtis,et al.  Using Analytics to Guide Improvement during an Agile–DevOps Transformation , 2017, IEEE Software.

[50]  Arif Ali Khan,et al.  Towards the Guidelines for Requirements Change Management in Global Software Development: Client-Vendor Perspective , 2019, IEEE Access.

[51]  AhmadAwais,et al.  Systematic literature review and empirical investigation of barriers to process improvement in global software development , 2017 .

[52]  Marina Waldén,et al.  DevOps meets formal modelling in high-criticality complex systems , 2015, QUDOS@SIGSOFT FSE.

[53]  D. Chang.  Applications of the extent analysis method on fuzzy AHP , 1996 .

[54]  Saadettin Erhan Kesen,et al.  A fuzzy AHP approach to personnel selection problem , 2009, Appl. Soft Comput..

[55]  Sabrina Marczak,et al.  A systematic literature review on agile requirements engineering practices and challenges , 2015, Comput. Hum. Behav..

[56]  Gaurav Kabra,et al.  Identification and prioritization of coordination barriers in humanitarian supply chain management , 2015 .

[57]  Rick Kazman,et al.  Architectural Support for DevOps in a Neo-Metropolis BDaaS Platform , 2015, 2015 IEEE 34th Symposium on Reliable Distributed Systems Workshop (SRDSW).

[58]  Iñaki Etxaniz,et al.  Agile Development and Operation of Complex Systems in Multi-technology and Multi-company Environments: Following a DevOps Approach , 2018, EuroSPI.

[59]  Sagar Sen,et al.  DevOps Improvements for Reduced Cycle Times with Integrated Test Optimizations for Continuous Integration , 2018, 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC).

[60]  Arif Ali Khan,et al.  Investigation of the requirements change management challenges in the domain of global software development , 2019, J. Softw. Evol. Process..

[61]  Sajjad Mahmood,et al.  Key factors that influence task allocation in global software development , 2017, Inf. Softw. Technol..

[62]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A systematic literature review , 2009, Inf. Softw. Technol..

[63]  Muhammad Ali Babar,et al.  Identifying relevant studies in software engineering , 2011, Inf. Softw. Technol..

[64]  Arif Ali Khan,et al.  Statistical Analysis of the Effects of Heavyweight and Lightweight Methodologies on the Six-Pointed Star Model , 2018, IEEE Access.

[65]  Logica Banica,et al.  Is DevOps another Project Management Methodology , 2017 .

[66]  Frank Elberzhager,et al.  From Agile Development to DevOps: Going Towards Faster Releases at High Quality - Experiences from an Industrial Context , 2017, SWQD.

[67]  Yildiz Esra Albayrak,et al.  Using analytic hierarchy process (AHP) to improve human performance: An application of multiple criteria decision making problem , 2004, J. Intell. Manuf..

[68]  Q. B. Chung,et al.  Clinical engineering technology assessment decision support: a case study using the analytic hierarchy process (AHP) , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[69]  George J. Klir,et al.  Fuzzy Sets, Fuzzy Logic, and Fuzzy Systems - Selected Papers by Lotfi A Zadeh , 1996, Advances in Fuzzy Systems - Applications and Theory.

[70]  Ainul Akmar Mokhtar,et al.  Comparative Analysis between Fuzzy and Traditional Analytical Hierarchy Process , 2014 .

[71]  Jan Bosch,et al.  Towards DevOps in the Embedded Systems Domain: Why is It So Hard? , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[72]  Heng Li,et al.  Application of the analytic hierarchy process (AHP) in multi-criteria analysis of the selection of intelligent building systems , 2008 .

[73]  Indika Perera,et al.  Continuous scrum: A framework to enhance scrum with DevOps , 2017, 2017 Seventeenth International Conference on Advances in ICT for Emerging Regions (ICTer).

[74]  Helmut Krcmar,et al.  Research for practice , 2019, Commun. ACM.

[75]  Arif Ali Khan,et al.  Taxonomical classification of barriers for scaling agile methods in global software development environment using fuzzy analytic hierarchy process , 2020, Appl. Soft Comput..

[76]  Awais Ahmad,et al.  Systematic literature review and empirical investigation of barriers to process improvement in global software development: Client-vendor perspective , 2017, Inf. Softw. Technol..

[77]  Robert Rosenberger,et al.  The problem with hands-free dashboard cellphones , 2013, CACM.

[78]  Siffat Ullah Khan,et al.  Factors influencing clients in the selection of offshore software outsourcing vendors: An exploratory study using a systematic literature review , 2011, J. Syst. Softw..

[79]  Manish Virmani,et al.  Understanding DevOps & bridging the gap from continuous integration to continuous delivery , 2015, Fifth International Conference on the Innovative Computing Technology (INTECH 2015).

[80]  Cengiz Kahraman,et al.  Multi-attribute comparison of catering service companies using fuzzy AHP: The case of Turkey , 2004 .

[81]  Asif Qumer Gill,et al.  DevOps for information management systems , 2017 .

[82]  Arif Ali Khan,et al.  SPIIMM: Toward a Model for Software Process Improvement Implementation and Management in Global Software Development , 2017, IEEE Access.

[83]  Heng Li,et al.  Construction Partnering Process and Associated Critical Success Factors: Quantitative Investigation , 2002 .

[84]  Chaim Noy,et al.  Sampling Knowledge: The Hermeneutics of Snowball Sampling in Qualitative Research , 2008 .

[85]  Thomas L. Saaty,et al.  Decision making with the analytic network process , 2013 .

[86]  Yehia Mostafa Helmy,et al.  Enhancing Lean Software Development by using Devops Practices , 2017 .

[87]  James Roche,et al.  Adopting DevOps practices in quality assurance , 2013, CACM.