Adoption of open source software in software-intensive organizations - A systematic literature review

Context: Open source software (OSS) is changing the way organizations develop, acquire, use, and commercialize software. Objective: This paper seeks to identify how organizations adopt OSS, classify the literature according to these ways of adopting OSS, and with a focus on software development evaluate the research on adoption of OSS in organizations. Method: Based on the systematic literature review method we reviewed publications from 24 journals and seven conference and workshop proceedings, published between 1998 and 2008. From a population of 24,289 papers, we identified 112 papers that provide empirical evidence on how organizations actually adopt OSS. Results: We show that adopting OSS involves more than simply using OSS products. We moreover provide a classification framework consisting of six distinctly different ways in which organizations adopt OSS. This framework is used to illustrate some of the opportunities and challenges organizations meet when approaching OSS, to show that OSS can be adopted successfully in different ways, and to organize and review existing research. We find that existing research on OSS adoption does not sufficiently describe the context of the organizations studied, and it fails to benefit fully from related research fields. While existing research covers a large number of topics, it contains very few closely related studies. To aid this situation, we offer directions for future research. Conclusion: The implications of our findings are twofold. On the one hand, practitioners should embrace the many opportunities OSS offers, but consciously evaluate the consequences of adopting it in their own context. They may use our framework and the success stories provided by the literature in their own evaluations. On the other hand, researchers should align their work, and perform more empirical research on topics that are important to organizations. Our framework may be used to position this research and to describe the context of the organization they are studying.

[1]  Juho Lindman,et al.  Understanding Open Source in an Industrial Context , 2008, 2008 IEEE International Conference on Signal Image Technology and Internet Based Systems.

[2]  Sebastian Spaeth,et al.  Knowledge Reuse in Open Source Software: An Exploratory Study of 15 Open Source Projects , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[3]  Liguo Yu,et al.  Understanding component co-evolution with a study on Linux , 2007, Empirical Software Engineering.

[4]  Brian Fitzgerald,et al.  Open source application spaces: 5th workshop on open source software engineering , 2005, SOEN.

[5]  B. Donnellan,et al.  Implementing an Open Source Knowledge Base , 2005, IEEE Softw..

[6]  Jesús M. González-Barahona,et al.  Corporate Involvement of Libre Software: Study of Presence in Debian Code over Time , 2007, OSS.

[7]  Andrea Bonaccorsi,et al.  Comparing motivations of individual programmers and firms to take part in the open source movement: From community to business , 2006 .

[8]  Kris Ven,et al.  Challenges and strategies in the use of Open Source Software by Independent Software Vendors , 2008, Inf. Softw. Technol..

[9]  Mark Staples,et al.  Experiences using systematic review guidelines , 2006, J. Syst. Softw..

[10]  Gerald Bortis Experiences with Mirth , 2008, 2008 ACM/IEEE 30th International Conference on Software Engineering.

[11]  Bartel Van de Walle,et al.  Open source software for disaster management , 2007, Commun. ACM.

[12]  Tommi Mikkonen,et al.  Forging A Community - Not: Experiences On Establishing An Open Source Project , 2008, OSS.

[13]  Michael Jiang,et al.  Using Eclipse as a Tool-Integration Platform for Software Development , 2007, IEEE Software.

[14]  Wasif Afzal,et al.  A systematic review of search-based testing for non-functional system properties , 2009, Inf. Softw. Technol..

[15]  Kevin Crowston,et al.  The social structure of free and open source software development , 2005, First Monday.

[16]  Brian Fitzgerald,et al.  Open source application spaces , 2005 .

[17]  Brian Fitzgerald,et al.  Understanding open source software development , 2002 .

[18]  Brian Fitzgerald,et al.  Developing an information systems infrastructure with open source software , 2004, IEEE Software.

[19]  Thomas Wieland,et al.  Evaluation criteria for free/open source software products based on project analysis , 2006, Softw. Process. Improv. Pract..

[20]  Brian Fitzgerald,et al.  Commercial adoption of open source software: an empirical study , 2005, 2005 International Symposium on Empirical Software Engineering, 2005..

[21]  Cornelius Puschmann,et al.  DiPP and eLanguage: Two cooperative models for open access , 2007, First Monday.

[22]  Attilio Fiandrotti,et al.  A graphical installation system for the GNU/Linux Debian distribution , 2006, OSS.

[23]  Brian Fitzgerald,et al.  The Transformation of Open Source Software , 2006, MIS Q..

[24]  Reidar Conradi,et al.  Adoption of Open Source in the Software Industry , 2008, OSS.

[25]  Marvin V. Zelkowitz,et al.  An update to experimental models for validating computer technology , 2009, J. Syst. Softw..

[26]  M. Brian Blake,et al.  IGSTK: an open source software toolkit for image-guided surgery , 2006, Computer.

[27]  Eric S. Raymond,et al.  The cathedral and the bazaar - musings on Linux and Open Source by an accidental revolutionary , 2001 .

[28]  Mariella Di Giacomo MySQL: Lessons Learned on a Digital Library , 2005, IEEE Softw..

[29]  Dave Thomas,et al.  Open Source Ecosystems , 2004, IEEE Softw..

[30]  Jim Waldo Alive and Well: Jini Technology Today , 2000, Computer.

[31]  Walt Scacchi,et al.  Free and open source development practices in the game community , 2004, IEEE Software.

[32]  J. Herbsleb,et al.  Two case studies of open source software development: Apache and Mozilla , 2002, TSEM.

[33]  Barry W. Boehm,et al.  Value-based processes for COTS-based applications , 2005, IEEE Software.

[34]  Pär J. Ågerfalk,et al.  Assessing the role of open source software in the European secondary software sector: a voice from industry , 2005 .

[35]  W.-F. Bleek Migrating a development project to open source software development , 2004, ICSE 2004.

[36]  Pär J. Ågerfalk,et al.  Outsourcing to an Unknown Workforce: Exploring Opensourcing as a Global Sourcing Strategy , 2008, MIS Q..

[37]  Carl-Fredrik Sørensen,et al.  Surveying Industrial Roles in Open Source Software Development , 2007, OSS.

[38]  Venkataraman Ramesh,et al.  Research in Information Systems: An Empirical Study of Diversity in the Discipline and Its Journals , 2002, J. Manag. Inf. Syst..

[39]  朴轍柱 Pragmatism의 眞理論 小考 , 1962 .

[40]  Kal Toth,et al.  Experiences with Open Source Software Engineering Tools , 2006, IEEE Software.

[41]  Pankaj K. Garg,et al.  Progressive open source , 2002, ICSE '02.

[42]  Tore Dybå,et al.  Applying Systematic Reviews to Diverse Study Types: An Experience Report , 2007, ESEM 2007.

[43]  Magne Jørgensen,et al.  A Systematic Review of Software Development Cost Estimation Studies , 2007 .

[44]  Will Tracz,et al.  Proceedings of the 24th International Conference on Software Engineering, ICSE 2002, 19-25 May 2002, Orlando, Florida, USA , 2002, ICSE.

[45]  Cornelia Boldyreff,et al.  Communication and conflict issues in collaborative software research projects , 2004, ICSE 2004.

[46]  David G. Glance,et al.  Factors affecting the use of open source software in tertiary education institutions , 2004, First Monday.

[47]  Reidar Conradi,et al.  An empirical study on software development with open source components in the chinese software industry , 2008 .

[48]  Diomidis Spinellis Global software development in the freeBSD project , 2006, GSD '06.

[49]  Patrick Finnegan,et al.  Delivering the 'Whole Product': Business Model Impacts and Agility Challenges in a Network of Open Source Firms , 2008, J. Database Manag..

[50]  Shari Lawrence Pfleeger,et al.  Preliminary Guidelines for Empirical Research in Software Engineering , 2002, IEEE Trans. Software Eng..

[51]  Pearl Brereton,et al.  Objectivity in Research: Challenges from the Evidence-Based Paradigm , 2009, 2009 Australian Software Engineering Conference.

[52]  Gabriella Dodero,et al.  Comparing macro development for personal productivity tools: an experience in validating accessibility of Talking Books , 2006, OSS.

[53]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[54]  James D. Herbsleb,et al.  A case study of a corporate open source development model , 2006, ICSE.

[55]  Richard T. Watson,et al.  JBOSS: The Evolution of Professional Open Source Software , 2005, MIS Q. Executive.

[56]  Eric A. von Hippel,et al.  How Open Source Software Works: 'Free' User-to-User Assistance? , 2000 .

[57]  James M. Bieman,et al.  The FreeBSD project: a replication case study of open source development , 2005, IEEE Transactions on Software Engineering.

[58]  Jean-Christophe Deprez,et al.  Comparing Assessment Methodologies for Free/Open Source Software: OpenBRR and QSOS , 2008, PROFES.

[59]  D HerbslebJames,et al.  Two case studies of open source software development , 2002 .

[60]  A. Onetti,et al.  Source and Business Model Innovation . The Funambol case , 2005 .

[61]  Kris Ven,et al.  Should You Adopt Open Source Software? , 2008, IEEE Software.

[62]  Alfonso Fuggetta,et al.  A classification of CASE technology , 1993, Computer.

[63]  Marco Torchiano,et al.  An empirical study on decision making in off-the-shelf component-based development , 2006, ICSE '06.

[64]  Eileen Moore Trauth,et al.  Social Inclusion: Societal and Organizational Implications for Information Systems - IFIP TC8 WG8.2 International Working Conference, July 12-15, 2006, Limerick, Ireland , 2006, Social Inclusion.

[65]  Uros Jovanovic,et al.  Perceptions on F/OSS Adoption , 2007, OSS.

[66]  Maurizio Morisio,et al.  Evidences in the evolution of OS projects through Changelog Analyses , 2003 .

[67]  Agostino Poggi,et al.  JADE: A software framework for developing multi-agent applications. Lessons learned , 2008, Inf. Softw. Technol..

[68]  Giancarlo Succi,et al.  Open Source Software and Open Data Standards as a form of Technology Adoption: a Case Study , 2007, OSS.

[69]  Mats Magnusson,et al.  How do firms make use of open source communities , 2008 .

[70]  David A. E. Wall Software Technologies - Using Open Source for a Profitable Startup , 2001, Computer.

[71]  Frank Hecker,et al.  Setting Up Shop: The Business of Open-Source Software , 1999, IEEE Softw..

[72]  Andrea Bonaccorsi,et al.  Intrinsic Motivations and Profit-Oriented Firms in Open Source Software: Do Firms Practise What They Preach? , 2005 .

[73]  Paolo Giacalone Akhela,et al.  OSS implementation solutions for Public Administration applications , 2005 .

[74]  Gabriella Dodero,et al.  Open source technologies for visually impaired people , 2007, OSS.

[75]  Richard T. Watson,et al.  The business of open source , 2008, CACM.

[76]  A. Bonaccorsi,et al.  Why Open Source Software Can Succeed , 2002 .

[77]  J. Henkel Selective revealing in open innovation processes: the case of embedded Linux (gekürzte Version) , 2006 .

[79]  Pearl Brereton,et al.  Component-Based Systems: A Classification of Issues , 2000, Computer.

[80]  Fatemeh Zahedi,et al.  Design, retrieval, and assembly in component-based software development , 2003, CACM.

[81]  Wilhelm Hasselbring,et al.  Introducing Version Control to Database-Centric Applications in a Small Enterprise , 2007, IEEE Software.

[82]  Reidar Conradi,et al.  Quality, productivity and economic benefits of software reuse: a review of industrial studies , 2007, Empirical Software Engineering.

[83]  P. D. Laat Copyright or copyleft?: An analysis of property regimes for software development , 2005 .

[84]  Brian Fitzgerald,et al.  Adopting Open Source Software Engineering (OSSE) Practices by Adopting OSSE Tools , 2007 .

[85]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[86]  E.S. Raymond Up from alchemy [open source development] , 2004, IEEE Software.

[87]  Thomas Østerlie,et al.  A Critical Review of Software Engineering Research on Open Source Software Development , 2007 .

[88]  Michela Montesi,et al.  Software engineering article types: An analysis of the literature , 2008, J. Syst. Softw..

[89]  M. Merito,et al.  Business Firms' Engagement in Community Projects. Empirical Evidence and Further Developments of the Research , 2007, First International Workshop on Emerging Trends in FLOSS Research and Development (FLOSS'07: ICSE Workshops 2007).

[90]  Timo Aaltonen,et al.  Influence in the Linux Kernel Community , 2007, OSS.

[91]  Tore Dybå,et al.  Empirical studies of agile software development: A systematic review , 2008, Inf. Softw. Technol..

[92]  Jeffrey S. Norris,et al.  Mission-critical development with open source software: lessons learned , 2004, IEEE Software.

[93]  Marco Scotto,et al.  Criteria for the non invasive transition to OpenOffice , 2005 .

[94]  A. Bonaccorsi,et al.  Contributing to OS projects: a comparison between individual and firms , 2004, ICSE 2004.

[95]  Richard G. Dewar,et al.  A new research agenda for tool integration , 2007, J. Syst. Softw..

[96]  Liguo Yu,et al.  Self-organization process in open-source software: An empirical study , 2008, Inf. Softw. Technol..

[97]  Giovanni Caire,et al.  To What Extent Does It Pay to Approach Open Source Software for a Big Telco Player? , 2008, OSS.

[98]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[99]  Magnus Mähring,et al.  Lost and Gained in Translation: Adoption of Open Source Software Development at Hewlett-Packard , 2008, OSS.

[100]  Tore Dybå,et al.  Applying Systematic Reviews to Diverse Study Types: An Experience Report , 2007, First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007).

[101]  J. William Ahwood,et al.  CLASSIFICATION , 1931, Foundations of Familiar Language.

[102]  J.-M. Dalle Toward collaborative open-source technology transfer , 2004, ICSE 2004.

[103]  Walter F. Tichy,et al.  Status of Empirical Research in Software Engineering , 2006, Empirical Software Engineering Issues.

[104]  Olivier Berger,et al.  Why and how to contribute to libre software when you integrate them into an in-house application ? , 2005 .

[105]  Lars Mathiassen,et al.  A Conceptual MAP of Software Process Improvement , 2001, Scand. J. Inf. Syst..

[106]  Victor R. Basili,et al.  Experimentation in software engineering , 1986, IEEE Transactions on Software Engineering.

[107]  Sonia Calzada,et al.  Open Source Tools in Information Systems Development , 2004 .

[108]  Marco Torchiano,et al.  Development with Off-the-Shelf Components: 10 Facts , 2009, IEEE Software.

[109]  James D. Herbsleb,et al.  A case study of open source tools and practices in a commercial setting , 2005 .

[110]  Georg von Krogh,et al.  Open Source Software and the "Private-Collective" Innovation Model: Issues for Organization Science , 2003, Organ. Sci..

[111]  Scott A. Hissam,et al.  Has Open Source Software a Future , 2007 .

[112]  Marvin V. Zelkowitz,et al.  Experimental Models for Validating Technology , 1998, Computer.

[113]  Jean-Paul Van Belle,et al.  Critical Success Factors for Migrating to OSS-on-the-Desktop: Common Themes across Three South African Case Studies , 2006, OSS.

[114]  Alfonso Fuggetta,et al.  Open source software - an evaluation , 2003, J. Syst. Softw..

[115]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A systematic literature review , 2009, Inf. Softw. Technol..

[116]  Brian Fitzgerald,et al.  Understanding Free/Open Source Software Development Processes , 2006, Softw. Process. Improv. Pract..

[117]  Ken Martin,et al.  An Open Source Approach to Developing Software in a Small Organization , 2007, IEEE Software.

[118]  Dario Lorenzi,et al.  Assessing Innovation in the Software Sector: Proprietary vs. FOSS Production Mode. Preliminary Evidence from the Italian Case , 2008, OSS.

[119]  Martin Campbell-Kelly,et al.  Pragmatism, not ideology: Historical perspectives on IBM's adoption of open-source software , 2009, Inf. Econ. Policy.

[120]  Tore Dybå,et al.  Evidence-based software engineering , 2004, Proceedings. 26th International Conference on Software Engineering.

[121]  Evangelia Berdou,et al.  Insiders and outsiders: paid contributors and the dynamics of cooperation in community led F/OS projects , 2006, OSS.

[122]  Linus Dahlander,et al.  Relationships Between Open Source Software Companies and Communities: Observations from Nordic Firms , 2005 .

[123]  LiWei,et al.  The effectiveness of software metrics in identifying error-prone classes in post-release software evolution process , 2008 .

[124]  Ann Westenholz,et al.  Institutional Entrepreneurs and the Bricolage of Intellectual Property Discourses , 2006, OSS.

[125]  Björn Lundell,et al.  Perceptions and Uptake of Open Source in Swedish Organisations , 2006, OSS.

[126]  Jukka K. Nurminen,et al.  Reusing an open source application - practical experiences with a mobile CRM pilot , 2007, OSS.

[127]  Tore Dybå,et al.  An empirical investigation of the key factors for success in software process improvement , 2005, IEEE Transactions on Software Engineering.

[128]  Juan Martínez-Romo,et al.  Using Social Network Analysis Techniques to Study Collaboration between a FLOSS Community and a Company , 2008, OSS.

[129]  Tore Dybå,et al.  A systematic review of quasi-experiments in software engineering , 2009, Inf. Softw. Technol..

[130]  Leonhard Dobusch,et al.  Migration Discourse Structures: Escaping Microsoft's Desktop Path , 2008, OSS.

[131]  W. Swap,et al.  Resource allocation beyond firm boundaries: A multi-level model for Open Source innovation , 2004 .

[132]  Netta Iivari,et al.  Usability in Company Open Source Software Context - Initial Findings from an Empirical Case Study , 2008, OSS.

[133]  Torgeir Dingsøyr,et al.  Knowledge management in software engineering: A systematic review of studied concepts, findings and research methods used , 2008, Inf. Softw. Technol..

[134]  Brian Fitzgerald,et al.  Taking stock of the bazaar: the third workshop on open source software engineering , 2003, SOEN.

[135]  Sebastian G. Elbaum,et al.  Quality assurance under the open source development model , 2003, J. Syst. Softw..

[136]  Michael Lewis,et al.  Game Engine Virtual Reality with CaveUT , 2005, Computer.

[137]  Christof Ebert Guest Editor's Introduction: How Open Source Tools Can Benefit Industry , 2009, IEEE Softw..

[138]  O. Dieste,et al.  Developing Search Strategies for Detecting Relevant Experiments for Systematic Reviews , 2007, First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007).

[139]  Joseph Feller Meeting challenges and surviving success: the 2nd workshop on open source software engineering , 2002, Proceedings of the 24th International Conference on Software Engineering. ICSE 2002.

[140]  Stephane Lussier,et al.  New tricks: how open source changed the way my team works , 2004, IEEE Software.

[141]  Guido Hertel,et al.  Motivation of software developers in Open Source projects: an Internet-based survey of contributors to the Linux kernel , 2003 .

[142]  Ari Jaaksi,et al.  Experiences on Product Development with Open Source Software , 2007, OSS.

[143]  Kris Ven,et al.  The Impact of Ideology on the Organizational Adoption of Open Source Software , 2008, J. Database Manag..

[144]  Joel West,et al.  The Role of Participation Architecture in Growing Sponsored Open Source Communities , 2008 .

[145]  Raed Shatnawi,et al.  The effectiveness of software metrics in identifying error-prone classes in post-release software evolution process , 2008, J. Syst. Softw..

[146]  R A Risdon,et al.  Alive and well , 1988 .

[147]  Kris Ven,et al.  The Introduction of OpenOffice.org in the Brussels Public Administration , 2006, OSS.

[148]  Marco Torchiano,et al.  A State-of-the-Practice Survey of Off-the-Shelf Component-Based Development Processes , 2006, ICSR.

[149]  Lorraine Morgan,et al.  How Perceptions of Open Source Software Influence Adoption: An Exploratory Study , 2007, ECIS.

[150]  Ioannis Stamelos,et al.  Understanding knowledge sharing activities in free/open source software projects: An empirical study , 2008, J. Syst. Softw..

[151]  Juho Lindman,et al.  Applying Open Source Development Practices Inside a Company , 2008, OSS.

[152]  Pascal Ravesteyn,et al.  Willingness to Cooperate Within the Open Source Software Domain , 2008, OSS.

[153]  Michael J. Ackerman,et al.  Open source software for medical image processing and visualization , 2005, CACM.

[154]  Andrea Fosfuri,et al.  The Penguin Has Entered the Building: The Commercialization of Open Source Software Products , 2008, Organ. Sci..

[155]  Jacco H. Wesselius,et al.  The Bazaar inside the Cathedral: Business Models for Internal Markets , 2008, IEEE Software.

[156]  Pankaj Garg,et al.  Corporate Source: Applying Open Source Concepts to a Corporate Environment , 2001 .

[157]  Kris Ven,et al.  The Organizational Adoption of Open Source Server Software by Belgian Organizations , 2006, OSS.

[158]  Cornelia Boldyreff,et al.  Adaptive reuse of libre software systems for supporting on-line collaboration , 2005, ACM SIGSOFT Softw. Eng. Notes.

[159]  Andrea Bonaccorsi,et al.  Entry Strategies Under Competing Standards: Hybrid Business Models in the Open Source Software Industry , 2006, Manag. Sci..

[160]  Budi Arief,et al.  focus developing with open source software The Many Meanings of Open Source , 2022 .

[161]  C. Jensen,et al.  Collaboration, leadership, control, and conflict negotiation in the Netbeans.org community , 2004, ICSE 2004.

[162]  R. Stallman,et al.  Free Software, Free Society , 2002 .

[163]  David Kelly,et al.  Developing Open Source Software: A Community-Based Analysis of Research , 2006, Social Inclusion.

[164]  So Young Sohn,et al.  A strategic analysis for successful open source software utilization based on a structural equation model , 2008, J. Syst. Softw..

[165]  Kevin Crowston,et al.  Self-organization of teams for free/libre open source software development , 2007, Inf. Softw. Technol..

[166]  Joel West,et al.  How open is open enough?: Melding proprietary and open source platform strategies , 2003 .

[167]  Cornelia Boldyreff,et al.  Using Open Source Tools to Support Collaboration Within CALIBRE , 2005 .

[168]  Ola Hodne Titlestad,et al.  Networks of Open Source Health Care Action , 2006, OSS.

[169]  Björn Lundell,et al.  Communication, coordination and control in distributed development : an OSS case study , 2005 .

[170]  Muhammad Ali Babar,et al.  Reporting Empirical Research in Open Source Software: The State of Practice , 2009, OSS.

[171]  Pekka Abrahamsson,et al.  Is Open Source Software Development Essentially an Agile Method , 2003 .

[172]  Jason E. Robbins Adopting Open Source Software Engineering (OSSE) Practices by Adopting OSSE Tools , 2003 .

[173]  Hans Christian von Baeyer Up from Alchemy , 1993 .

[174]  Gregorio Robles,et al.  Impact of libre software tools and methods in the robotics field , 2005, ACM SIGSOFT Softw. Eng. Notes.

[175]  Michael W. Godfrey,et al.  “Cloning considered harmful” considered harmful: patterns of cloning in software , 2008, Empirical Software Engineering.

[176]  Björn Lundell,et al.  Commodification of Industrial Software: A Case for Open Source , 2009, IEEE Software.

[177]  Ioannis Stamelos,et al.  Code quality analysis in open source software development , 2002, Inf. Syst. J..

[178]  Nicholas Lesiecki Applyinq AspectJ to J2EE application development , 2006, IEEE Software.

[179]  Georg von Krogh,et al.  The Promise of Research on Open Source Software , 2006, Manag. Sci..

[180]  Austen Rainer,et al.  Open-source software in an occupational health application: the case of Heales Medical Ltd , 2005 .

[181]  Pearl Brereton,et al.  Presenting software engineering results using structured abstracts: a randomised experiment , 2008, Empirical Software Engineering.

[182]  Alberto Sillitti,et al.  Open Source Development, Adoption and Innovation , 2007 .

[183]  Carola Jungwirth,et al.  Pervasive fun , 2007, First Monday.

[184]  Brian Fitzgerald,et al.  Open Source Software Adoption: Anatomy of Success and Failure , 2009, Int. J. Open Source Softw. Process..

[185]  Tore Dybå,et al.  Strength of evidence in systematic reviews in software engineering , 2008, ESEM '08.

[186]  Lorraine Morgan,et al.  Benefits and Drawbacks of Open Source Software: An Exploratory Study of Secondary Software Firms , 2007, OSS.

[187]  Cristina V. Lopes,et al.  Archetypal Internet-Scale Source Code Searching , 2008, OSS.

[188]  TorkarRichard,et al.  A systematic review of search-based testing for non-functional system properties , 2009 .

[189]  Giancarlo Succi,et al.  An empirical study of open-source and closed-source software products , 2004, IEEE Transactions on Software Engineering.

[190]  Richard M. Stallman,et al.  Free Software, Free Society: Selected Essays of Richard M. Stallman , 2009 .

[191]  Martin W. Wallin,et al.  A man on the inside: Unlocking communities as complementary assets , 2006 .

[192]  Andrea Bonaccorsi,et al.  How is it possible to profit from innovation in the absence of any appropriability? , 2006, OSS.

[193]  Venkataraman Ramesh,et al.  Research in software engineering: an analysis of the literature , 2002, Inf. Softw. Technol..

[194]  Karim R. Lakhani,et al.  Perspectives on Free and Open Source Software , 2005 .

[195]  Linus Dahlander,et al.  Online Communities and Open Innovation , 2008 .

[196]  Amela Karahasanovic,et al.  A survey of controlled experiments in software engineering , 2005, IEEE Transactions on Software Engineering.

[197]  Giancarlo Succi,et al.  A study on the introduction of Open Source Software in the Public Administration , 2006, OSS.

[198]  Pearl Brereton,et al.  Lessons from applying the systematic literature review process within the software engineering domain , 2007, J. Syst. Softw..

[199]  John Noll,et al.  What Constitutes Open Source? A Study of the Vista Electronic Medical Record Software , 2009, OSS.

[200]  David Hovemeyer,et al.  Using Static Analysis to Find Bugs , 2008, IEEE Software.

[201]  Andrea Bonaccorsi,et al.  Why profit-oriented companies enter the OS field? , 2005, ACM SIGSOFT Softw. Eng. Notes.

[202]  A.I. Wasserman,et al.  Evaluating Software Engineering Processes in Commercial and Community Open Source Projects , 2007, First International Workshop on Emerging Trends in FLOSS Research and Development (FLOSS'07: ICSE Workshops 2007).

[203]  Carlos Santos Understanding Partnerships between Corporations and the Open Source Community: A Research Gap , 2008, IEEE Software.

[204]  Michael Gschwind,et al.  An Open Source Environment for Cell Broadband Engine System Software , 2007, Computer.

[205]  Di Wu,et al.  Empirical study of the effects of open source adoption on software development economics , 2007, J. Syst. Softw..

[206]  Colin Atkinson,et al.  Code Conjurer: Pulling Reusable Software out of Thin Air , 2008, IEEE Software.

[207]  W. Stam When Does Community Participation Enhance the Performance of Open Source Software Companies? , 2008 .

[208]  Larry M. Augustin,et al.  Accelerating software development through collaboration , 2002, ICSE '02.