A systematic literature review on the barriers faced by newcomers to open source software projects

Display Omitted ContextNumerous open source software projects are based on volunteers collaboration and require a continuous influx of newcomers for their continuity. Newcomers face barriers that can lead them to give up. These barriers hinder both developers willing to make a single contribution and those willing to become a project member. ObjectiveThis study aims to identify and classify the barriers that newcomers face when contributing to open source software projects. MethodWe conducted a systematic literature review of papers reporting empirical evidence regarding the barriers that newcomers face when contributing to open source software (OSS) projects. We retrieved 291 studies by querying 4 digital libraries. Twenty studies were identified as primary. We performed a backward snowballing approach, and searched for other papers published by the authors of the selected papers to identify potential studies. Then, we used a coding approach inspired by open coding and axial coding procedures from Grounded Theory to categorize the barriers reported by the selected studies. ResultsWe identified 20 studies providing empirical evidence of barriers faced by newcomers to OSS projects while making a contribution. From the analysis, we identified 15 different barriers, which we grouped into five categories: social interaction, newcomers' previous knowledge, finding a way to start, documentation, and technical hurdles. We also classified the problems with regard to their origin: newcomers, community, or product. ConclusionThe results are useful to researchers and OSS practitioners willing to investigate or to implement tools to support newcomers. We mapped technical and non-technical barriers that hinder newcomers' first contributions. The most evidenced barriers are related to socialization, appearing in 75% (15 out of 20) of the studies analyzed, with a high focus on interactions in mailing lists (receiving answers and socialization with other members). There is a lack of in-depth studies on technical issues, such as code issues. We also noticed that the majority of the studies relied on historical data gathered from software repositories and that there was a lack of experiments and qualitative studies in this area.

[1]  Marco Aurélio Gerosa,et al.  Recommending mentors to software project newcomers , 2012, 2012 Third International Workshop on Recommendation Systems for Software Engineering (RSSE).

[2]  Robert E. Kraut,et al.  Predicting Continued Participation in Newsgroups , 2006, J. Comput. Mediat. Commun..

[3]  Gail C. Murphy,et al.  Hipikat: recommending pertinent software development artifacts , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[4]  F. Schmidt,et al.  The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. , 1998 .

[5]  Jonathan T. Morgan,et al.  Tea and sympathy: crafting positive new user experiences on wikipedia , 2013, CSCW.

[6]  Janice Singer,et al.  Hipikat: a project memory for software development , 2005, IEEE Transactions on Software Engineering.

[7]  Marco Aurélio Gerosa,et al.  Social Barriers Faced by Newcomers Placing Their First Contribution in Open Source Software Projects , 2015, CSCW.

[8]  Nir Kshetri,et al.  Improving Open Source Software Maintenance , 2010, J. Comput. Inf. Syst..

[9]  Anita Sarma,et al.  Which bug should I fix: helping new developers onboard a new project , 2011, CHASE '11.

[10]  A. Mockus,et al.  Does the initial environment impact the future of developers , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[11]  Cliff Lampe,et al.  Defining, Understanding, and Supporting Open Collaboration , 2013 .

[12]  Sven Laumer,et al.  Who Will Remain? An Evaluation of Actual Person-Job and Person-Team Fit to Predict Developer Retention in FLOSS Projects , 2012, 2012 45th Hawaii International Conference on System Sciences.

[13]  Premkumar T. Devanbu,et al.  Open Borders? Immigration in Open Source Projects , 2007, Fourth International Workshop on Mining Software Repositories (MSR'07:ICSE Workshops 2007).

[14]  Budi Arief,et al.  focus developing with open source software The Many Meanings of Open Source , 2022 .

[15]  Cliff Lampe,et al.  Follow the (slash) dot: effects of feedback on new members in an online community , 2005, GROUP.

[16]  Muhammad Ali Babar,et al.  Identifying Architectural Patterns Used in Open Source Software: Approaches and Challenges , 2010, EASE.

[17]  Bing Li,et al.  Applying Centrality Measures to the Behavior Analysis of Developers in Open Source Software Community , 2012, 2012 Second International Conference on Cloud and Green Computing.

[18]  Marco Aurélio Gerosa,et al.  Why do newcomers abandon open source software projects? , 2013, 2013 6th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE).

[19]  Andrew Begel,et al.  Novice software developers, all over again , 2008, ICER '08.

[20]  Christian Bird,et al.  Diversity in software engineering research , 2013, ESEC/FSE 2013.

[21]  Marco Aurélio Gerosa,et al.  Attracting , Onboarding , and Retaining Newcomer Developers in Open Source Software Projects , 2014 .

[22]  John M. Levine,et al.  To stay or leave?: the relationship of emotional and informational support to commitment in online health support groups , 2012, CSCW.

[23]  Anthony I. Wasserman,et al.  A Framework for Evaluating Managerial Styles in Open Source Projects , 2008, OSS.

[24]  Pearl Brereton,et al.  A systematic review of systematic review process research in software engineering , 2013, Inf. Softw. Technol..

[25]  Ryan Faulkner,et al.  Etiquette in Wikipedia: weening new editors into productive ones , 2012, WikiSym '12.

[26]  Paula Gomes Mian,et al.  Systematic Review in Software Engineering , 2005 .

[27]  Walt Scacchi,et al.  Understanding the requirements for developing open source software systems , 2002, IEE Proc. Softw..

[28]  Ed H. Chi,et al.  The singularity is not near: slowing growth of Wikipedia , 2009, Int. Sym. Wikis.

[29]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[30]  Jonathan T. Morgan,et al.  The Rise and Decline of an Open Collaboration System , 2013 .

[31]  Audris Mockus,et al.  What make long term contributors: Willingness and opportunity in OSS community , 2012, 2012 34th International Conference on Software Engineering (ICSE).

[32]  Yulin Fang,et al.  Socialization in Open Source Software Projects: A Growth Mixture Modeling Approach , 2011 .

[33]  Xu Ben,et al.  Mining Developer Contribution in Open Source Software Using Visualization Techniques , 2013, 2013 Third International Conference on Intelligent System Design and Engineering Applications.

[34]  N. Hoffart.  Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory , 2000 .

[35]  Karl Fogel,et al.  Producing open source software - how to run a successful free software project , 2005 .

[36]  Carlos Jensen,et al.  Joining Free/Open Source Software Communities: An Analysis of Newbies' First Interactions on Project Mailing Lists , 2011, 2011 44th Hawaii International Conference on System Sciences.

[37]  Nicolas Ducheneaut,et al.  Socialization in an Open Source Software Community: A Socio-Technical Analysis , 2005, Computer Supported Cooperative Work (CSCW).

[38]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[39]  Marco Aurélio Gerosa,et al.  Preliminary Empirical Identification of Barriers Faced by Newcomers to Open Source Software Projects , 2014, 2014 Brazilian Symposium on Software Engineering.

[40]  Martin Michlmayr,et al.  From the Cathedral to the Bazaar: An Empirical Study of the Lifecycle of Volunteer Community Projects , 2007, OSS.

[41]  Claes Wohlin,et al.  Systematic literature studies: Database searches vs. backward snowballing , 2012, Proceedings of the 2012 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement.

[42]  Gerardo Canfora,et al.  Who is going to mentor newcomers in open source projects? , 2012, SIGSOFT FSE.

[43]  Aaron Halfaker,et al.  Don't bite the newbies: how reverts affect the quantity and quality of Wikipedia work , 2011, Int. Sym. Wikis.

[44]  Karim R. Lakhani,et al.  Community, Joining, and Specialization in Open Source Software Innovation: A Case Study , 2003 .

[45]  Robert E. Kraut,et al.  Wikipedia classroom experiment: bidirectional benefits of students' engagement in online production communities , 2013, CHI.

[46]  Christian Bird,et al.  Sociotechnical coordination and collaboration in open source software , 2011, 2011 27th IEEE International Conference on Software Maintenance (ICSM).

[47]  Barbara Kitchenham,et al.  Procedures for Performing Systematic Reviews , 2004 .

[48]  Michael Weiss,et al.  Evolution of Open Source Communities , 2006, OSS.

[49]  Rachel K. E. Bellamy,et al.  Moving into a new software project landscape , 2010, 2010 ACM/IEEE 32nd International Conference on Software Engineering.

[50]  Carlos Jensen,et al.  Beyond pretty pictures: Examining the benefits of code visualization for Open Source newcomers , 2009, 2009 5th IEEE International Workshop on Visualizing Software for Understanding and Analysis.