Turnover-induced knowledge loss in practice

When contributors to a software project leave, the knowledge they hold may become lost, thus impacting code quality and team productivity. Although well-known strategies can be used to mitigate knowledge loss, these strategies have to be tailored to their target context to be effective. To help software development organizations mitigate turnover-induced knowledge loss, we sought to better understand the different contexts in which developers experience this knowledge loss, and the resulting implications. We conducted qualitative interviews with 27 professional developers and managers from three different companies that provide software products and services. Leveraging the experience of these practitioners, we contribute a framework for characterizing turnover-induced knowledge loss and descriptions of the implications of knowledge loss, synthesized into 20 observations. These observations about knowledge loss in practice are organized into four themes, validated by the participants, and discussed within the context of the research literature in software engineering.

[1]  Harald C. Gall,et al.  Don't touch my code!: examining the effects of ownership on software quality , 2011, ESEC/FSE '11.

[2]  Kimiz Dalkir,et al.  Knowledge Management in Theory and Practice , 2005 .

[3]  A. Panter,et al.  APA handbook of research methods in psychology, Vol 2: Research designs: Quantitative, qualitative, neuropsychological, and biological. , 2012 .

[4]  Carolyn B. Seaman,et al.  Could removal of project-level knowledge flow obstacles contribute to software process improvement? A study of software engineer perceptions , 2016, Inf. Softw. Technol..

[5]  Martin P. Robillard,et al.  Lessons Learned While Migrating From Swing to JavaFX , 2020, IEEE Software.

[6]  Murray E. Jennex,et al.  Assessing Knowledge Loss Risk , 2013, 2013 46th Hawaii International Conference on System Sciences.

[7]  C. P. Goodman,et al.  The Tacit Dimension , 2003 .

[8]  R. Weiss Learning from strangers : the art and method of qualitative interview studies , 1995 .

[9]  野中 郁次郎,et al.  The Knowledge-Creating Company: How , 1995 .

[10]  Donald O. Case,et al.  Looking for Information: A Survey of Research on Information Seeking, Needs and Behavior , 2012 .

[11]  Susanne Durst,et al.  Knowledge management in practice: insights into a medium‐sized enterprise's exposure to knowledge loss , 2011 .

[12]  K. North,et al.  Knowledge Management: Value Creation Through Organizational Learning , 2014 .

[13]  Deborah E. White,et al.  Thematic Analysis , 2017 .

[14]  L. Giddings Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, 2d ed , 2005 .

[15]  Jan C. van Ours,et al.  Job turnover and labor turnover: a taxonomy of employment dynamics , 1994 .

[16]  Dorothy Leonard-Barton,et al.  Critical Knowledge Transfer: Tools for Managing Your Company's Deep Smarts , 2014 .

[17]  Rainer Koschke,et al.  On the Comprehension of Program Comprehension , 2014, TSEM.

[18]  Rory V. O'Connor,et al.  A systematic examination of knowledge loss in open source software projects , 2019, Int. J. Inf. Manag..

[19]  Marco Tulio Valente,et al.  A novel approach for estimating Truck Factors , 2016, 2016 IEEE 24th International Conference on Program Comprehension (ICPC).

[20]  J Liebowitz,et al.  A Theoretical Framework for Knowledge Management Implementation , 2002 .

[21]  David W. DeLong,et al.  Lost knowledge : confronting the threat of an aging workforce , 2004 .

[22]  Nina Helander,et al.  Knowledge Sharing Barriers in Growing Software Companies , 2012, 2012 45th Hawaii International Conference on System Sciences.

[23]  Janice Singer,et al.  How software engineers use documentation: the state of the practice , 2003, IEEE Software.

[24]  T. Davenport,et al.  Strategies for preventing a knowledge-loss crisis , 2006 .

[25]  Mary Sumner,et al.  Knowledge management: theory and practice , 1999, SIGCPR '99.

[26]  Jesús M. González-Barahona,et al.  Using Software Archaeology to Measure Knowledge Loss in Software Projects Due to Developer Turnover , 2009, 2009 42nd Hawaii International Conference on System Sciences.

[27]  Kurt Schneider,et al.  Experience and Knowledge Management in Software Engineering , 2009 .

[28]  Martin P. Robillard,et al.  Threats of Aggregating Software Repository Data , 2018, 2018 IEEE International Conference on Software Maintenance and Evolution (ICSME).

[29]  Audris Mockus,et al.  Quantifying and Mitigating Turnover-Induced Knowledge Loss: Case Studies of Chrome and a Project at Avaya , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE).

[30]  Padraig Cunningham,et al.  Exploring the Relationship between Membership Turnover and Productivity in Online Communities , 2014, ICWSM.

[31]  Elmar Jürgens,et al.  The loss of architectural knowledge during system evolution: An industrial case study , 2009, 2009 IEEE 17th International Conference on Program Comprehension.

[32]  Olivia B. Newton,et al.  Expertise and Complexity as Mediators of Knowledge Loss in Open Source Software Development , 2019, Proceedings of the Human Factors and Ergonomics Society Annual Meeting.

[33]  Nick Bontis,et al.  Voluntary turnover: knowledge management – friend or foe? , 2002 .

[34]  Gabriele Bavota,et al.  Software Documentation Issues Unveiled , 2019, 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE).

[35]  Martin P. Robillard,et al.  Revisiting Turnover-Induced Knowledge Loss in Software Projects , 2017, 2017 IEEE International Conference on Software Maintenance and Evolution (ICSME).

[36]  Michael E. Atwood,et al.  Effective Design Rationale: Understanding the Barriers , 2006 .

[37]  Stephanie B. Steinhardt,et al.  Application Programming Interface Documentation: What Do Software Developers Want? , 2018 .

[38]  Roman Beck,et al.  Breaching the Knowledge Transfer Blockade in IT Offshore Outsourcing Projects - A Case from the Financial Services Industry , 2009, 2009 42nd Hawaii International Conference on System Sciences.

[39]  L. G. Pee,et al.  Mitigating the Impact of Member Turnover in Information Systems Development Projects , 2014, IEEE Transactions on Engineering Management.

[40]  Ioannis Stamelos,et al.  Understanding knowledge sharing activities in free/open source software projects: An empirical study , 2008, J. Syst. Softw..

[41]  Audris Mockus,et al.  Organizational volatility and its effects on software defects , 2010, FSE '10.

[42]  Gail C. Murphy,et al.  Impact of developer turnover on quality in open-source software , 2015, ESEC/SIGSOFT FSE.

[43]  Virginia Braun,et al.  To saturate or not to saturate? Questioning data saturation as a useful concept for thematic analysis and sample-size rationales , 2019 .

[44]  Martin P. Robillard,et al.  Creating and evolving developer documentation: understanding the decisions of open source contributors , 2010, FSE '10.

[45]  Jordi Cabot,et al.  Assessing the bus factor of Git repositories , 2015, 2015 IEEE 22nd International Conference on Software Analysis, Evolution, and Reengineering (SANER).

[46]  Gregorio Robles,et al.  Developer Turnover in Global, Industrial Open Source Projects: Insights from Applying Survival Analysis , 2017, 2017 IEEE 12th International Conference on Global Software Engineering (ICGSE).

[47]  Davi Viana,et al.  Knowledge Creation and Loss within a Software Organization: An Exploratory Case Study , 2015, 2015 48th Hawaii International Conference on System Sciences.

[48]  Beth Ulrich,et al.  Lost knowledge. , 2010, Nephrology nursing journal : journal of the American Nephrology Nurses' Association.

[49]  Robert DeLine,et al.  Information Needs in Collocated Software Development Teams , 2007, 29th International Conference on Software Engineering (ICSE'07).

[50]  Peter C. Rigby,et al.  Mitigating Turnover with Code Review Recommendation: Balancing Expertise, Workload, and Knowledge Distribution , 2020, 2020 IEEE/ACM 42nd International Conference on Software Engineering (ICSE).

[51]  Stefan Thalmann,et al.  Protecting organizational knowledge: a structured literature review , 2015, J. Knowl. Manag..

[52]  Jean-Paul A. Barthès,et al.  Knowledge Management , 1994, Encyclopedia of Database Systems.

[53]  Wasif Afzal,et al.  Knowledge transfer challenges and mitigation strategies in global software development - A systematic literature review and industrial validation , 2013, Int. J. Inf. Manag..

[54]  Martin P. Robillard,et al.  How API Documentation Fails , 2015, IEEE Software.

[55]  Charles A. Tryon Managing Organizational Knowledge: 3rd Generation Knowledge Management and Beyond , 2012 .