Adoption of Open Source Software in Software-Intensive Industry

Context: Open source software (OSS) has seen significant adoption, and it has changed not only how software-intensive companies develop and make money on software, but also how they select and acquire software. As a consequence of these changes there has been confusion about how organizations may benefit from OSS. Objective: Through answering the following research questions (RQ1-RQ3), this thesis aims to explore and describe (1) the different ways in which organizations adopt OSS and (2) how these organizations select OSS components. RQ1: How and to what extent are software-intensive organizations currently adopting OSS? RQ2: What is the current status of research on OSS adoption in organizations and how may this research benefit practitioners? RQ3: Which strategies and resources do software developers use to identify, evaluate, and select OSS components? Method: This thesis consists of six related studies, all focused on the adoption of OSS in software-intensive organizations. These studies embody case studies, systematic literature reviews, and surveys using face-to-face interviews, e-mail, and web-based questionnaires. Results: Based on these six studies, this thesis provides the following five contributions (C1-C5) through eight papers (P1-P8): C1 Empirically grounded descriptions of how several organizations adopt OSS. C2 A systematic review of the literature on OSS adoption in organizations. C3 A classification framework presenting six ways of organizational OSS adoption, each with its particular benefits and challenges. The six ways include: deploying OSS products, using OSS CASE tools, integrating OSS components, participating in the development of OSS products, providing OSS products, and using OSS development practices. C4 Descriptions, based on empirical evidence, of the strategies and resources practitioners actually use to identify, evaluate, and select OSS components. C5 A model for situated software selection and its constraints, indicating why formalized selection methods have failed to see significant adoption. Conclusion: Practitioners should observe that they have several possibilities and take this into account when adopting OSS. Research on OSS adoption should focus on a few topics, borrow more support from related fields within software engineering and information systems research, and extend the foundation offered by this thesis. Research on software selection should put stronger emphasis on the situation the selection is conducted in and the rich (text) experience developers benefit from when selecting (OSS) components.

[1]  Bartel Van de Walle,et al.  Open source software for disaster management , 2007, Commun. ACM.

[2]  John Noll,et al.  What Constitutes Open Source? A Study of the Vista Electronic Medical Record Software , 2009, OSS.

[3]  Juho Lindman,et al.  Understanding Open Source in an Industrial Context , 2008, 2008 IEEE International Conference on Signal Image Technology and Internet Based Systems.

[4]  Sebastian Spaeth,et al.  Knowledge Reuse in Open Source Software: An Exploratory Study of 15 Open Source Projects , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[5]  Günther Ruhe,et al.  Intelligent Support for Selection of COTS Products , 2002, Web, Web-Services, and Database Systems.

[6]  Liguo Yu,et al.  Understanding component co-evolution with a study on Linux , 2007, Empirical Software Engineering.

[7]  B. Donnellan,et al.  Implementing an Open Source Knowledge Base , 2005, IEEE Softw..

[8]  Thomas Wieland,et al.  Evaluation criteria for free/open source software products based on project analysis , 2006, Softw. Process. Improv. Pract..

[9]  Cornelius Puschmann,et al.  DiPP and eLanguage: Two cooperative models for open access , 2007, First Monday.

[10]  Reidar Conradi,et al.  Adoption of Open Source in the Software Industry , 2008, OSS.

[11]  Wolf-Gideon Bleek,et al.  Ensuring Transparency-Migrating a Closed Software Development to an Open Source Software Project , 2005 .

[12]  David Hovemeyer,et al.  Using Static Analysis to Find Bugs , 2008, IEEE Software.

[13]  Tommi Mikkonen,et al.  Forging A Community - Not: Experiences On Establishing An Open Source Project , 2008, OSS.

[14]  Jingyue Li,et al.  Process Improvement and Risk Management in Off-The-Shelf Component-Based Development , 2006 .

[15]  M. Ochs,et al.  A method for efficient measurement-based COTS assessment and selection method description and evaluation results , 2001, Proceedings Seventh International Software Metrics Symposium.

[16]  Michael Jiang,et al.  Using Eclipse as a Tool-Integration Platform for Software Development , 2007, IEEE Software.

[17]  Andrea Bonaccorsi,et al.  Why profit-oriented companies enter the OS field? , 2005, ACM SIGSOFT Softw. Eng. Notes.

[18]  A.I. Wasserman,et al.  Evaluating Software Engineering Processes in Commercial and Community Open Source Projects , 2007, First International Workshop on Emerging Trends in FLOSS Research and Development (FLOSS'07: ICSE Workshops 2007).

[19]  Kevin Crowston,et al.  The social structure of free and open source software development , 2005, First Monday.

[20]  Gregorio Robles,et al.  Free/Libre and Open Source Software: Survey and Study - FLOSS FINAL REPORT , 2002 .

[21]  Marco Torchiano,et al.  Development with Off-the-Shelf Components: 10 Facts , 2009, IEEE Software.

[22]  Brian Fitzgerald,et al.  Open source application spaces , 2005 .

[23]  Philippe Kruchten,et al.  Putting the "engineering" into "software engineering" , 2004, 2004 Australian Software Engineering Conference. Proceedings..

[24]  Brian Fitzgerald,et al.  Commercial adoption of open source software: an empirical study , 2005, 2005 International Symposium on Empirical Software Engineering, 2005..

[25]  James D. Herbsleb,et al.  A case study of open source tools and practices in a commercial setting , 2005 .

[26]  Jesper Holck,et al.  Managerial and Technical Barriers to the Adoption of Open Source Software , 2005, ICCBSS.

[27]  Brian Fitzgerald,et al.  The Transformation of Open Source Software , 2006, MIS Q..

[28]  Walt Scacchi,et al.  Free and open source development practices in the game community , 2004, IEEE Software.

[29]  Sandeep Krishnamurthy,et al.  An Analysis of Open Source Business Models , 2005 .

[30]  R. W. Lucky,et al.  Free software [Reflections] , 1999 .

[31]  Bernard Golden,et al.  Succeeding with Open Source , 2004 .

[32]  Marvin V. Zelkowitz,et al.  Experimental Models for Validating Technology , 1998, Computer.

[33]  Sven Overhage,et al.  On Component Identification Approaches - Classification, State of the Art, and Comparison , 2009, CBSE.

[34]  Alfonso Fuggetta,et al.  Open source software - an evaluation , 2003, J. Syst. Softw..

[35]  C. Robson,et al.  Real World Research: A Resource for Social Scientists and Practitioner-Researchers , 1993 .

[36]  W. Scacchi Free/Open Source Software Development: Recent Research Results and Methods , 2007, Adv. Comput..

[37]  Walter F. Tichy,et al.  Summary of the Dagstuhl workshop on future directions in software engineering: February 17–21, 1992, Schloß Dagstuhl , 1993, SOEN.

[38]  Jim Waldo Alive and Well: Jini Technology Today , 2000, Computer.

[39]  M. Brian Blake,et al.  IGSTK: an open source software toolkit for image-guided surgery , 2006, Computer.

[40]  Eric S. Raymond,et al.  The cathedral and the bazaar - musings on Linux and Open Source by an accidental revolutionary , 2001 .

[41]  Robert G. Fichman,et al.  International Conference on Information Systems ( ICIS ) 1992 INFORMATION TECHNOLOGY DIFFUSION : A REVIEW OF EMPIRICAL RESEARCH , 2017 .

[42]  Paul Brebner,et al.  Rigorous Evaluation of COTS Middleware Technology , 2003, Computer.

[43]  Sandro Morasca,et al.  OpenBQR: a framework for the assessment of OSS , 2007, OSS.

[44]  Carlos Santos Understanding Partnerships between Corporations and the Open Source Community: A Research Gap , 2008, IEEE Software.

[45]  William B. Frakes,et al.  Software reuse research: status and future , 2005, IEEE Transactions on Software Engineering.

[46]  Michael Gschwind,et al.  An Open Source Environment for Cell Broadband Engine System Software , 2007, Computer.

[47]  Tore Dybå,et al.  Empirical studies of agile software development: A systematic review , 2008, Inf. Softw. Technol..

[48]  Robert L. Glass,et al.  Matching methodology to problem domain , 2004, CACM.

[49]  Norman E. Fenton,et al.  How effective are software engineering methods? , 1993, J. Syst. Softw..

[50]  Ann Westenholz,et al.  Institutional Entrepreneurs and the Bricolage of Intellectual Property Discourses , 2006, OSS.

[51]  Øyvind Hauge,et al.  Providing Commercial Open Source Software: Lessons Learned , 2009, OSS.

[52]  Netta Iivari,et al.  Usability in Company Open Source Software Context - Initial Findings from an Empirical Case Study , 2008, OSS.

[53]  Rahul De',et al.  Notice of Violation of IEEE Publication PrinciplesOpen source reuse in commercial firms , 2004, IEEE Software.

[54]  Marco Torchiano,et al.  An Empirical Study on Off-the-Shelf Component Usage in Industrial Projects , 2005, PROFES.

[55]  Victor R. Basili,et al.  The role of experimentation in software engineering: past, current, and future , 1996, Proceedings of IEEE 18th International Conference on Software Engineering.

[56]  G. Krogh Open-Source Software Development , 2003 .

[57]  Parastoo Mohagheghi,et al.  Impacts of Software Reuse and Incremental Development on the Quality of Large Systems , 2004 .

[58]  Alf Inge Wang,et al.  Debugging Integrated Systems: An Ethnographic Study of Debugging Practice , 2007, 2007 IEEE International Conference on Software Maintenance.

[59]  Pekka Mäki-Asiala,et al.  Quality Assurance of Open Source Components: Integrator Point of View , 2006, 30th Annual International Computer Software and Applications Conference (COMPSAC'06).

[60]  Eric A. von Hippel,et al.  How Open Source Software Works: 'Free' User-to-User Assistance? , 2000 .

[61]  Tore Dybå,et al.  The Future of Empirical Methods in Software Engineering Research , 2007, Future of Software Engineering (FOSE '07).

[62]  David Kelly,et al.  Developing Open Source Software: A Community-Based Analysis of Research , 2006, Social Inclusion.

[63]  Floyd J. Fowler,et al.  Survey Research Methods , 1984 .

[64]  Guest Editorial Open source software: investigating the software engineering, psychosocial and economic issues , 2001, Inf. Syst. J..

[65]  Luis Eduardo Mendoza,et al.  Quality Measurement Model for Analysis and Design Tools Based on FLOSS , 2008 .

[66]  Daniela E. Damian,et al.  Selecting Empirical Methods for Software Engineering Research , 2008, Guide to Advanced Empirical Software Engineering.

[67]  Alberto Sillitti,et al.  Selecting components in large COTS repositories , 2004, J. Syst. Softw..

[68]  So Young Sohn,et al.  A strategic analysis for successful open source software utilization based on a structural equation model , 2008, J. Syst. Softw..

[69]  Anslow Pm Training is important. , 1975 .

[70]  Brian Fitzgerald Formalized systems development methodologies: a critical perspective , 1996, Information Systems Journal.

[71]  Christof Ebert Guest Editor's Introduction: How Open Source Tools Can Benefit Industry , 2009, IEEE Softw..

[72]  Edsger W. Dijkstra,et al.  The humble programmer , 1972, CACM.

[73]  Timo Aaltonen,et al.  Influence in the Linux Kernel Community , 2007, OSS.

[74]  Sandro Morasca,et al.  Towards The Evaluation of OSS Trustworthiness: Lessons Learned From The Observation of Relevant OSS Projects , 2008, OSS.

[75]  Ioannis Stamelos,et al.  The SQO-OSS Quality Model: Measurement Based Open Source Software Evaluation , 2008, OSS.

[76]  Giancarlo Succi,et al.  Open Source Software and Open Data Standards as a form of Technology Adoption: a Case Study , 2007, OSS.

[77]  Mats Magnusson,et al.  How do firms make use of open source communities , 2008 .

[78]  Gregorio Robles,et al.  Impact of libre software tools and methods in the robotics field , 2005, ACM SIGSOFT Softw. Eng. Notes.

[79]  David A. E. Wall Software Technologies - Using Open Source for a Profitable Startup , 2001, Computer.

[80]  Michael W. Godfrey,et al.  “Cloning considered harmful” considered harmful: patterns of cloning in software , 2008, Empirical Software Engineering.

[81]  Kris Ven,et al.  The Impact of Ideology on the Organizational Adoption of Open Source Software , 2008, J. Database Manag..

[82]  Jean-Christophe Deprez,et al.  An Operational Approach for Selecting Open Source Components in a Software Development Project , 2008, EuroSPI.

[83]  Ketil Sandanger Velle,et al.  Open Source Software at Telenor IS , 2009 .

[84]  Brian Fitzgerald,et al.  Understanding open source software development , 2002 .

[85]  A. Bonaccorsi,et al.  Contributing to OS projects: a comparison between individual and firms , 2004, ICSE 2004.

[86]  Joel West,et al.  Contrasting Community Building in Sponsored and Community Founded Open Source Projects , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[87]  Björn Lundell,et al.  Commodification of Industrial Software: A Case for Open Source , 2009, IEEE Software.

[88]  Sandro Morasca,et al.  Quality of Open Source Software: The QualiPSo Trustworthiness Model , 2009, OSS.

[89]  Brian Fitzgerald,et al.  Developing an information systems infrastructure with open source software , 2004, IEEE Software.

[90]  Fatemeh Zahedi,et al.  Design, retrieval, and assembly in component-based software development , 2003, CACM.

[91]  R. Yin Case Study Research: Design and Methods , 1984 .

[92]  Reidar Conradi,et al.  Quality, productivity and economic benefits of software reuse: a review of industrial studies , 2007, Empirical Software Engineering.

[93]  Richard G. Dewar,et al.  A new research agenda for tool integration , 2007, J. Syst. Softw..

[94]  Ioannis Stamelos,et al.  Code quality analysis in open source software development , 2002, Inf. Syst. J..

[95]  Kevin Crowston,et al.  Self-organization of teams for free/libre open source software development , 2007, Inf. Softw. Technol..

[96]  Joel West,et al.  The Role of Participation Architecture in Growing Sponsored Open Source Communities , 2008 .

[97]  Peter Freeman,et al.  Classifying Software for Reusability , 1987, IEEE Software.

[98]  Joel West,et al.  How open is open enough?: Melding proprietary and open source platform strategies , 2003 .

[99]  Cornelia Boldyreff,et al.  Using Open Source Tools to Support Collaboration Within CALIBRE , 2005 .

[100]  Lars Mathiassen,et al.  A Conceptual MAP of Software Process Improvement , 2001, Scand. J. Inf. Syst..

[101]  Teresa S. Waring,et al.  Open Source Software implementation in the UK public sector: Evidence from the field and implications for the future , 2005, Int. J. Inf. Manag..

[102]  Mikko Välimäki,et al.  An empirical look at the problems of open source adoption in Finnish municipalities , 2005, ICEC '05.

[103]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A systematic literature review , 2009, Inf. Softw. Technol..

[104]  Brian Fitzgerald,et al.  Understanding Free/Open Source Software Development Processes , 2006, Softw. Process. Improv. Pract..

[105]  Ken Martin,et al.  An Open Source Approach to Developing Software in a Small Organization , 2007, IEEE Software.

[106]  Ola Hodne Titlestad,et al.  Networks of Open Source Health Care Action , 2006, OSS.

[107]  Maurizio Morisio,et al.  Diversity in Reuse Processes , 2000, IEEE Softw..

[108]  Dario Lorenzi,et al.  Assessing Innovation in the Software Sector: Proprietary vs. FOSS Production Mode. Preliminary Evidence from the Italian Case , 2008, OSS.

[109]  Martin Campbell-Kelly,et al.  Pragmatism, not ideology: Historical perspectives on IBM's adoption of open-source software , 2009, Inf. Econ. Policy.

[110]  Georg von Krogh,et al.  Special issue on open source software development , 2003 .

[111]  Tore Dybå,et al.  Evidence-based software engineering , 2004, Proceedings. 26th International Conference on Software Engineering.

[112]  Helen Sharp,et al.  The type of evidence produced by empirical software engineers , 2005, ACM SIGSOFT Softw. Eng. Notes.

[113]  James D. Herbsleb,et al.  Addressing Challenges to Open Source Collaboration With the Semantic Web , 2003 .

[114]  Kris Ven,et al.  Should You Adopt Open Source Software? , 2008, IEEE Software.

[115]  Alfonso Fuggetta,et al.  A classification of CASE technology , 1993, Computer.

[116]  Raphaël Semeteys,et al.  Method for Qualification and Selection of Open Source Software , 2008 .

[117]  Maurizio Morisio,et al.  Evidences in the evolution of OS projects through Changelog Analyses , 2003 .

[118]  Giulio Piancastelli,et al.  Context-Dependent Evaluation Methodology for Open Source Software , 2007, OSS.

[119]  Victor R. Basili,et al.  Experimentation in software engineering , 1986, IEEE Transactions on Software Engineering.

[120]  Giancarlo Succi,et al.  An empirical study of open-source and closed-source software products , 2004, IEEE Transactions on Software Engineering.

[121]  H. Chesbrough The Era of Open Innovation , 2003 .

[122]  Chen Wang,et al.  Open Source Software Adoption: A Status Report , 2001, IEEE Softw..

[123]  Richard T. Watson,et al.  The business of open source , 2008, CACM.

[124]  Georg von Krogh,et al.  Open Source Software and the "Private-Collective" Innovation Model: Issues for Organization Science , 2003, Organ. Sci..

[125]  E. Raymond A Brief History of Hackerdom , 2004 .

[126]  Brian Fitzgerald,et al.  Adopting Open Source Software Engineering (OSSE) Practices by Adopting OSSE Tools , 2007 .

[127]  Brian Randell,et al.  Software engineering : report on a conference sponsored by the NATO Science Committee, Garmisch, Germany, 7th to 11th October 1968 , 1969 .

[128]  Jeffrey S. Norris,et al.  Mission-critical development with open source software: lessons learned , 2004, IEEE Software.

[129]  Andrea Bonaccorsi,et al.  Why Open Source Software Can Succeed , 2003 .

[130]  Ali Mili,et al.  Reusing Software: Issues and Research Directions , 1995, IEEE Trans. Software Eng..

[131]  Liguo Yu,et al.  Self-organization process in open-source software: An empirical study , 2008, Inf. Softw. Technol..

[132]  Lucy Suchman Plans and situated actions: the problem of human-machine communication , 1987 .

[133]  Oyvind Hauge,et al.  An empirical study on selection of Open Source Software - Preliminary results , 2009, 2009 ICSE Workshop on Emerging Trends in Free/Libre/Open Source Software Research and Development.

[134]  Martin W. Wallin,et al.  A man on the inside: Unlocking communities as complementary assets , 2006 .

[135]  Giovanni Caire,et al.  To What Extent Does It Pay to Approach Open Source Software for a Big Telco Player? , 2008, OSS.

[136]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[137]  Cornelius Ncube,et al.  The Limitations of Current Decision-Making Techniques in the Procurement of COTS Software Components , 2002, ICCBSS.

[138]  Maurizio Morisio,et al.  COTS-based software development: Processes and open issues , 2002, J. Syst. Softw..

[139]  Andrea Bonaccorsi,et al.  How is it possible to profit from innovation in the absence of any appropriability? , 2006, OSS.

[140]  Tharam S. Dillon,et al.  Towards an Ontology for Open Source Software Development , 2006, OSS.

[141]  Venkataraman Ramesh,et al.  Research in software engineering: an analysis of the literature , 2002, Inf. Softw. Technol..

[142]  Sebastian G. Elbaum,et al.  Quality assurance under the open source development model , 2003, J. Syst. Softw..

[143]  Antonio Vallecillo,et al.  A Survey on the Quality Information Provided by Software Component Vendors , 2003 .

[144]  Stephane Lussier,et al.  New tricks: how open source changed the way my team works , 2004, IEEE Software.

[145]  Guido Hertel,et al.  Motivation of software developers in Open Source projects: an Internet-based survey of contributors to the Linux kernel , 2003 .

[146]  Walt Scacchi,et al.  Collaboration, Leadership, Control, and Conflict Negotiation and the Netbeans.org Open Source Software Development Community , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[147]  Arlene Fink,et al.  The Survey Handbook , 1995 .

[148]  Ari Jaaksi,et al.  Experiences on Product Development with Open Source Software , 2007, OSS.

[149]  Padmal Vitharana Risks and challenges of component-based software development , 2003, CACM.

[150]  Daniel Sundmark,et al.  Reuse with Software Components - A Survey of Industrial State of Practice , 2009, ICSR.

[151]  Reidar Conradi,et al.  Open Source Collaboration for Fostering Off-The-Shelf Components Selection , 2007, OSS.

[152]  Raed Shatnawi,et al.  The effectiveness of software metrics in identifying error-prone classes in post-release software evolution process , 2008, J. Syst. Softw..

[153]  Torgeir Dingsøyr,et al.  Postmortem: Never Leave a Project without It , 2002, IEEE Softw..

[154]  Grace A. Lewis,et al.  From System Requirements to COTS Evaluation Criteria , 2004, ICCBSS.

[155]  Karim R. Lakhani,et al.  Perspectives on Free and Open Source Software , 2005 .

[156]  Barry W. Boehm,et al.  Eight Lessons Learned during COTS-Based Systems Maintenance , 2003, IEEE Softw..

[157]  W. Swap,et al.  Resource allocation beyond firm boundaries: A multi-level model for Open Source innovation , 2004 .

[158]  Alejandra Cechich,et al.  Trends on COTS component identification , 2006, Fifth International Conference on Commercial-off-the-Shelf (COTS)-Based Software Systems (ICCBSS'05).

[159]  Giancarlo Succi,et al.  Open Source Development, Communities and Quality: IFIP 20th World Computer Congress, Working Group 2.3 on Open Source Software, September 7-10, 2008, ... in Information and Communication Technology) , 2011 .

[160]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[161]  D. L. Parnas,et al.  On the criteria to be used in decomposing systems into modules , 1972, Software Pioneers.

[162]  Daniela Cruzes,et al.  Risks and Risk Mitigation in Open Source Software Adoption: Bridging the Gap between Literature and Practice , 2010, OSS.

[163]  Maurizio Morisio,et al.  Characteristics of open source projects , 2003, Seventh European Conference onSoftware Maintenance and Reengineering, 2003. Proceedings..

[164]  Scott A. Hissam,et al.  Has Open Source Software a Future , 2007 .

[165]  Jean-Paul Van Belle,et al.  Critical Success Factors for Migrating to OSS-on-the-Desktop: Common Themes across Three South African Case Studies , 2006, OSS.

[166]  Di Wu,et al.  Empirical study of the effects of open source adoption on software development economics , 2007, J. Syst. Softw..

[167]  Ivica Crnkovic Component-based software engineering - new challenges in software development , 2001, Softw. Focus.

[168]  Björn Lundell,et al.  Perceptions and Uptake of Open Source in Swedish Organisations , 2006, OSS.

[169]  Walter F. Tichy,et al.  Status of Empirical Research in Software Engineering , 2006, Empirical Software Engineering Issues.

[170]  Tore Dybå,et al.  An empirical investigation of the key factors for success in software process improvement , 2005, IEEE Transactions on Software Engineering.

[171]  Tore Dybå,et al.  A systematic review of quasi-experiments in software engineering , 2009, Inf. Softw. Technol..

[172]  Torgeir Dingsøyr,et al.  Knowledge management in software engineering: A systematic review of studied concepts, findings and research methods used , 2008, Inf. Softw. Technol..

[173]  R A Risdon,et al.  Alive and well , 1988 .

[174]  Marco Torchiano,et al.  A State-of-the-Practice Survey of Off-the-Shelf Component-Based Development Processes , 2006, ICSR.

[175]  Grady Booch,et al.  Reusing Open-Source Software and Practices: The Impact of Open-Source on Commercial Vendors , 2002, ICSR.

[176]  Juho Lindman,et al.  Case study of company's relationship with open source community in open source software development , 2008 .

[177]  Jeremy Rose,et al.  Prescription, description, reflection: the shape of the software process improvement field , 2004, Int. J. Inf. Manag..

[178]  Michael Lewis,et al.  Game Engine Virtual Reality with CaveUT , 2005, Computer.

[179]  James D. Herbsleb,et al.  A case study of a corporate open source development model , 2006, ICSE.

[180]  Jose Mari Sarriegi,et al.  From proprietary to open source tools in information systems development , 2004, IEEE Software.

[181]  O. Dieste,et al.  Developing Search Strategies for Detecting Relevant Experiments for Systematic Reviews , 2007, First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007).

[182]  Colin Atkinson,et al.  Code Conjurer: Pulling Reusable Software out of Thin Air , 2008, IEEE Software.

[183]  James M. Bieman,et al.  The FreeBSD project: a replication case study of open source development , 2005, IEEE Transactions on Software Engineering.

[184]  Giuseppe Munda,et al.  Social multi-criteria evaluation: Methodological foundations and operational consequences , 2004, Eur. J. Oper. Res..

[185]  Christopher Podmore Information economics and policy: In the United States edited by Michael Rubin Libraries Unlimited, Littleton, CO 1983, 340 pp , 1984 .

[186]  Frank Hecker,et al.  Setting Up Shop: The Business of Open-Source Software , 1999, IEEE Softw..

[187]  Tore Dybå,et al.  Evidence-Based Software Engineering for Practitioners , 2005, IEEE Softw..

[188]  Paul Lukowicz,et al.  Experimental evaluation in computer science: A quantitative study , 1995, J. Syst. Softw..

[189]  Marco Torchiano,et al.  Reflections on conducting an international survey of software engineering , 2005, 2005 International Symposium on Empirical Software Engineering, 2005..

[190]  Kal Toth,et al.  Experiences with Open Source Software Engineering Tools , 2006, IEEE Software.

[191]  Rosalva E. Gallardo-Valencia,et al.  Internet-Scale Code Search , 2009, 2009 ICSE Workshop on Search-Driven Development-Users, Infrastructure, Tools and Evaluation.

[192]  Marco Torchiano,et al.  Overlooked aspects of COTS-based development , 2004, IEEE Software.

[193]  Lorraine Morgan,et al.  How Perceptions of Open Source Software Influence Adoption: An Exploratory Study , 2007, ECIS.

[194]  W. Stam When Does Community Participation Enhance the Performance of Open Source Software Companies? , 2008 .

[195]  Ioannis Stamelos,et al.  Understanding knowledge sharing activities in free/open source software projects: An empirical study , 2008, J. Syst. Softw..

[196]  Evangelia Berdou,et al.  Insiders and outsiders: paid contributors and the dynamics of cooperation in community led F/OS projects , 2006, OSS.

[197]  Giancarlo Succi,et al.  Open Source Development, Communities and Quality, IFIP 20th World Computer Congress, Working Group 2.3 on Open Source Software, OSS 2008, September 7-10, 2008, Milano, Italy , 2008, OSS.

[198]  Linus Dahlander,et al.  Relationships Between Open Source Software Companies and Communities: Observations from Nordic Firms , 2005 .

[199]  Juho Lindman,et al.  Applying Open Source Development Practices Inside a Company , 2008, OSS.

[200]  Jukka K. Nurminen,et al.  Reusing an open source application - practical experiences with a mobile CRM pilot , 2007, OSS.

[201]  Luigi Lavazza Beyond Total Cost of Ownership: Applying Balanced Scorecards to Open-Source Software , 2007, International Conference on Software Engineering Advances (ICSEA 2007).

[202]  Robert L. Glass,et al.  The software-research crisis , 1994, IEEE Software.

[203]  Juan Martínez-Romo,et al.  Using Social Network Analysis Techniques to Study Collaboration between a FLOSS Community and a Company , 2008, OSS.

[204]  Leonhard Dobusch,et al.  Migration Discourse Structures: Escaping Microsoft's Desktop Path , 2008, OSS.

[205]  Pascal Ravesteyn,et al.  Willingness to Cooperate Within the Open Source Software Domain , 2008, OSS.

[206]  Michael J. Ackerman,et al.  Open source software for medical image processing and visualization , 2005, CACM.

[207]  Andrea Fosfuri,et al.  The Penguin Has Entered the Building: The Commercialization of Open Source Software Products , 2008, Organ. Sci..

[208]  Dar-Biau Liu,et al.  A procurement-centric model for engineering component-based software systems , 1997, Proceedings Fifth International Symposium on Assessment of Software Tools and Technologies.

[209]  Jacco H. Wesselius,et al.  The Bazaar inside the Cathedral: Business Models for Internal Markets , 2008, IEEE Software.

[210]  Kris Ven,et al.  The Organizational Adoption of Open Source Server Software by Belgian Organizations , 2006, OSS.

[211]  Andrea Bonaccorsi,et al.  Intrinsic Motivations and Profit-Oriented Firms in Open Source Software: Do Firms Practise What They Preach? , 2005 .

[212]  Wilhelm Hasselbring,et al.  Introducing Version Control to Database-Centric Applications in a Small Enterprise , 2007, IEEE Software.

[213]  Nicholas Lesiecki Applyinq AspectJ to J2EE application development , 2006, IEEE Software.

[214]  Patrick Finnegan,et al.  Delivering the 'Whole Product': Business Model Impacts and Agility Challenges in a Network of Open Source Firms , 2008, J. Database Manag..

[215]  Marco Torchiano,et al.  Validation of New Theses on Off-the-Shelf Component Based Development , 2005, 11th IEEE International Software Metrics Symposium (METRICS'05).

[216]  Sigi Goode,et al.  Something for nothing: management rejection of open source software in Australia's top firms , 2005, Inf. Manag..

[217]  Georg von Krogh,et al.  The Promise of Research on Open Source Software , 2006, Manag. Sci..

[218]  Chris DiBona,et al.  Open Sources: Voices from the Open Source Revolution , 1999 .

[219]  Kevin Crowston,et al.  Hierarchy and centralization in free and open source software team communications , 2006 .

[220]  Clemens A. Szyperski,et al.  Component software - beyond object-oriented programming , 2002 .

[221]  Larry M. Augustin,et al.  Accelerating software development through collaboration , 2002, ICSE '02.

[222]  Per Kristian Schanke Going Open: Building the Platform to Reach Out , 2007 .

[223]  Audris Mockus,et al.  Why Not Improve Coordination in Distributed Software Development by Stealing Good Ideas from Open Source , 2002 .

[224]  Brian Fitzgerald,et al.  Open source application spaces: 5th workshop on open source software engineering , 2005, SOEN.

[225]  Jesús M. González-Barahona,et al.  Corporate Involvement of Libre Software: Study of Presence in Debian Code over Time , 2007, OSS.

[226]  Kris Ven,et al.  Challenges and strategies in the use of Open Source Software by Independent Software Vendors , 2008, Inf. Softw. Technol..

[227]  Mark Staples,et al.  Experiences using systematic review guidelines , 2006, J. Syst. Softw..

[228]  Gerald Bortis Experiences with Mirth , 2008, 2008 ACM/IEEE 30th International Conference on Software Engineering.

[229]  Neil C. Ramiller,et al.  The Organizing Vision in Information Systems Innovation , 1997 .

[230]  Shahron Williams van Rooij Open Source software in US higher education: Reality or illusion? , 2007, Education and Information Technologies.

[231]  Attilio Fiandrotti,et al.  A graphical installation system for the GNU/Linux Debian distribution , 2006, OSS.

[232]  Claes Wohlin,et al.  Empirical Research Methods in Software Engineering , 2003, ESERNET.

[233]  E. Rogers Diffusion of Innovations , 1962 .

[234]  A. Bonaccorsi,et al.  Comparing Motivations of Individual Programmers and Firms to Take Part in the Open Source Movement. From Community to Business , 2006 .

[235]  Burton Grad,et al.  A Personal Recollection: IBM's Unbundling of Software and Services , 2002, IEEE Ann. Hist. Comput..

[236]  J. Henkel Selective revealing in open innovation processes: the case of embedded Linux (gekürzte Version) , 2006 .

[237]  Pearl Brereton,et al.  Component-Based Systems: A Classification of Issues , 2000, Computer.

[238]  N. Hoffart Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory , 2000 .

[239]  P. D. Laat Copyright or copyleft?: An analysis of property regimes for software development , 2005 .

[240]  Sandeep Krishnamurthy,et al.  Cave or Community? An Empirical Examination of 100 Mature Open Source Projects , 2002, First Monday.

[241]  Austen Rainer,et al.  Open-source software in an occupational health application: the case of Heales Medical Ltd , 2005 .

[242]  Pearl Brereton,et al.  Presenting software engineering results using structured abstracts: a randomised experiment , 2008, Empirical Software Engineering.

[243]  Alberto Sillitti,et al.  Open Source Development, Adoption and Innovation , 2007 .

[244]  Alan W. Brown,et al.  The Current State , 2016 .

[245]  Brian Fitzgerald,et al.  Open Source Software Adoption: Anatomy of Success and Failure , 2009, Int. J. Open Source Softw. Process..

[246]  Tore Dybå,et al.  Strength of evidence in systematic reviews in software engineering , 2008, ESEM '08.

[247]  Lorraine Morgan,et al.  Benefits and Drawbacks of Open Source Software: An Exploratory Study of Secondary Software Firms , 2007, OSS.

[248]  Cristina V. Lopes,et al.  Archetypal Internet-Scale Source Code Searching , 2008, OSS.

[249]  Marina Marinela Gerea,et al.  Selection of Open Source Components - A Qualitative Survey in Norwegian IT Industry , 2007 .

[250]  M. Fink,et al.  The Business and Economics of Linux and Open Source , 2002 .

[251]  Cornelia Boldyreff,et al.  Adaptive reuse of libre software systems for supporting on-line collaboration , 2005, ACM SIGSOFT Softw. Eng. Notes.

[252]  Andrea Bonaccorsi,et al.  Entry Strategies Under Competing Standards: Hybrid Business Models in the Open Source Software Industry , 2006, Manag. Sci..

[253]  Budi Arief,et al.  focus developing with open source software The Many Meanings of Open Source , 2022 .

[254]  Ivica Crnkovic,et al.  COTS Selection Best Practices in Literature and in Industry , 2008, ICSR.

[255]  C. Jensen,et al.  Collaboration, leadership, control, and conflict negotiation in the Netbeans.org community , 2004, ICSE 2004.

[256]  T. R. Madanmohan Open Source Reuse in Commercial Firms Using Open Source Components Raises Many Issues, from Requirements Negotiation to Product Selection and Integration. a Recent Study of Projects Using Open Source Revealed Component Selection Criteria, Best Practices, and Other Related Issues , 2022 .

[257]  Laurence Brooks,et al.  Identifying and classifying processes (traditional and soft factors) that support COTS component selection: a case study , 2000, ECIS.

[258]  Cornelia Boldyreff,et al.  Communication and conflict issues in collaborative software research projects , 2004, ICSE 2004.

[259]  David G. Glance,et al.  Factors affecting the use of open source software in tertiary education institutions , 2004, First Monday.

[260]  Reidar Conradi,et al.  Challenges of the Open Source Component Marketplace in the Industry , 2009, OSS.

[261]  Shari Lawrence Pfleeger,et al.  Preliminary Guidelines for Empirical Research in Software Engineering , 2002, IEEE Trans. Software Eng..

[262]  Richard T. Watson,et al.  JBOSS: The Evolution of Professional Open Source Software , 2005, MIS Q. Executive.

[263]  Jean-Christophe Deprez,et al.  Comparing Assessment Methodologies for Free/Open Source Software: OpenBRR and QSOS , 2008, PROFES.

[264]  Marco Torchiano,et al.  An empirical study on decision making in off-the-shelf component-based development , 2006, ICSE '06.

[265]  Øyvind Hauge,et al.  Open Source Software in Software Intensive Industry - A Survey , 2007 .

[266]  Uros Jovanovic,et al.  Perceptions on F/OSS Adoption , 2007, OSS.

[267]  Detmar W. Straub,et al.  Information Technology Adoption Across Time: A Cross-Sectional Comparison of Pre-Adoption and Post-Adoption Beliefs , 1999, MIS Q..

[268]  Björn Johansson,et al.  Choosing Open Source ERP Systems: What Reasons Are There For Doing So? , 2009, OSS.

[269]  Agostino Poggi,et al.  JADE: A software framework for developing multi-agent applications. Lessons learned , 2008, Inf. Softw. Technol..

[270]  Janne Merilinna,et al.  State of the art and practice of open source component integration , 2006 .

[271]  David A. Wheeler,et al.  Why Open Source Software / Free Software (OSS/FS, FLOSS, or FOSS)? Look at the Numbers! , 2005 .

[272]  Barry Boehm,et al.  A view of 20th and 21st century software engineering , 2006, ICSE.

[273]  Paul Kavanagh,et al.  The Open Source Definition , 2004 .

[274]  Gabriella Dodero,et al.  Open source technologies for visually impaired people , 2007, OSS.

[275]  Michela Montesi,et al.  Software engineering article types: An analysis of the literature , 2008, J. Syst. Softw..

[276]  Janne Merilinna,et al.  State of the Art and Practice of OpenSource Component Integration , 2006, 32nd EUROMICRO Conference on Software Engineering and Advanced Applications (EUROMICRO'06).

[277]  Barry W. Boehm,et al.  COTS-Based Systems Top 10 List , 2001, Computer.

[278]  Daniel Knudsen B2B-Marketplace Value Creation, Conceptual Predictions and Empirical Findings , 2003 .

[279]  M. Merito,et al.  Business Firms' Engagement in Community Projects. Empirical Evidence and Further Developments of the Research , 2007, First International Workshop on Emerging Trends in FLOSS Research and Development (FLOSS'07: ICSE Workshops 2007).

[280]  Karim R. Lakhani,et al.  Why Hackers Do What They Do: Understanding Motivation and Effort in Free/Open Source Software Projects , 2003 .

[281]  Steven Weber,et al.  The Success of Open Source , 2004 .

[282]  Pankaj K. Garg,et al.  Progressive open source , 2002, ICSE '02.

[283]  Dragan Gasevic,et al.  Open Source Software: All You Do Is Put It Together , 2007, IEEE Software.

[284]  Sajjad Mahmood,et al.  Survey of component-based software development , 2007, IET Softw..

[285]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[286]  Wasif Afzal,et al.  A systematic review of search-based testing for non-functional system properties , 2009, Inf. Softw. Technol..

[287]  Reidar Conradi,et al.  An empirical study of variations in COTS-based software development processes in the Norwegian IT industry , 2004, 10th International Symposium on Software Metrics, 2004. Proceedings..

[288]  Claudia P. Ayala Systematic Construction of Goal-Oriented COTS Taxonomies , 2006, CAiSE.

[289]  Marvin V. Zelkowitz,et al.  An update to experimental models for validating computer technology , 2009, J. Syst. Softw..

[290]  Reidar Conradi,et al.  An empirical investigation of software reuse benefits in a large telecom product , 2008, TSEM.

[291]  Mariella Di Giacomo MySQL: Lessons Learned on a Digital Library , 2005, IEEE Softw..

[292]  Brian Fitzgerald,et al.  Why Hackers Do What They Do: Understanding Motivation and Effort in Free/Open Source Software Projects , 2007 .

[293]  Marco Torchiano,et al.  A State-of-the-Practice Survey of Risk Management in Development with Off-the-Shelf Software Components , 2008, IEEE Transactions on Software Engineering.

[294]  Linus Dahlander,et al.  Online Communities and Open Innovation , 2008 .

[295]  Amela Karahasanovic,et al.  A survey of controlled experiments in software engineering , 2005, IEEE Transactions on Software Engineering.

[296]  Giancarlo Succi,et al.  A study on the introduction of Open Source Software in the Public Administration , 2006, OSS.

[297]  Kris Ven,et al.  The use of open source software platforms by Independent Software Vendors: issues and opportunities , 2005, ACM SIGSOFT Softw. Eng. Notes.

[298]  Pearl Brereton,et al.  Lessons from applying the systematic literature review process within the software engineering domain , 2007, J. Syst. Softw..

[299]  Thomas Østerlie,et al.  A Critical Review of Software Engineering Research on Open Source Software Development , 2007 .

[300]  B. Kitchenham,et al.  Case Studies for Method and Tool Evaluation , 1995, IEEE Softw..

[301]  Richard Hawkins,et al.  The economics of open source software for a competitive firm , 2004 .

[302]  Uday R. Kulkarni,et al.  Strategies for Software Reuse: A Principal Component Analysis of Reuse Practices , 2003, IEEE Trans. Software Eng..

[303]  Gabriella Dodero,et al.  Comparing macro development for personal productivity tools: an experience in validating accessibility of Talking Books , 2006, OSS.

[304]  Alain Abran,et al.  The Guide to the Software Engineering Body of Knowledge , 1999, IEEE Softw..

[305]  Veikko Seppänen,et al.  COTS component acquisition in an emerging market , 2004, IEEE Software.

[306]  J.-M. Dalle Toward collaborative open-source technology transfer , 2004, ICSE 2004.

[307]  Karl Fogel,et al.  Producing open source software - how to run a successful free software project , 2005 .

[308]  Alton Yeow-Kuan Chua,et al.  Evaluating open source portals , 2008, J. Libr. Inf. Sci..

[309]  Olivier Berger,et al.  Why and how to contribute to libre software when you integrate them into an in-house application ? , 2005 .

[310]  Colin Potts,et al.  Software-engineering research revisited , 1993, IEEE Software.

[311]  J. Herbsleb,et al.  Two case studies of open source software development: Apache and Mozilla , 2002, TSEM.

[312]  Barry W. Boehm,et al.  Value-based processes for COTS-based applications , 2005, IEEE Software.

[313]  Carl-Fredrik Sørensen,et al.  Surveying Industrial Roles in Open Source Software Development , 2007, OSS.

[314]  Venkataraman Ramesh,et al.  Research in Information Systems: An Empirical Study of Diversity in the Discipline and Its Journals , 2002, J. Manag. Inf. Syst..

[315]  Magne Jørgensen,et al.  A Systematic Review of Software Development Cost Estimation Studies , 2007 .

[316]  Diomidis Spinellis Global software development in the freeBSD project , 2006, GSD '06.

[317]  Claudia Patricia,et al.  Systematic construction of goal-oriented COTS taxonomies , 2008 .

[318]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[319]  Pär J. Ågerfalk,et al.  Assessing the role of open source software in the European secondary software sector: a voice from industry , 2005 .

[320]  W.-F. Bleek Migrating a development project to open source software development , 2004, ICSE 2004.

[321]  Pär J. Ågerfalk,et al.  Outsourcing to an Unknown Workforce: Exploring Opensourcing as a Global Sourcing Strategy , 2008, MIS Q..

[322]  Tor Erik Eide Study of the Release Process of Open Source Software : Case Study , 2007 .

[323]  Lawrence Rosen,et al.  Open Source Licensing: Software Freedom and Intellectual Property Law , 2004 .

[324]  Armin Eberlein,et al.  COTS Selection: Past, Present, and Future , 2007, 14th Annual IEEE International Conference and Workshops on the Engineering of Computer-Based Systems (ECBS'07).

[325]  Tore Dybå,et al.  Applying Systematic Reviews to Diverse Study Types: An Experience Report , 2007, ESEM 2007.

[326]  Reidar Conradi,et al.  An empirical study on software development with open source components in the chinese software industry , 2008 .

[327]  Leon J. Osterweil,et al.  A Future for Software Engineering? , 2007, Future of Software Engineering (FOSE '07).

[328]  Pearl Brereton,et al.  Objectivity in Research: Challenges from the Evidence-Based Paradigm , 2009, 2009 Australian Software Engineering Conference.

[329]  Liguo Yu Indirectly predicting the maintenance effort of open-source software: Research Articles , 2006 .

[330]  Magnus Mähring,et al.  Lost and Gained in Translation: Adoption of Open Source Software Development at Hewlett-Packard , 2008, OSS.

[331]  Alton Yeow-Kuan Chua,et al.  A checklist for evaluating open source digital library software , 2006, Online Inf. Rev..

[332]  Björn Lundell,et al.  Communication, coordination and control in distributed development : an OSS case study , 2005 .

[333]  Muhammad Ali Babar,et al.  Reporting Empirical Research in Open Source Software: The State of Practice , 2009, OSS.

[334]  Pekka Abrahamsson,et al.  Is Open Source Software Development Essentially an Agile Method , 2003 .

[335]  Karim R. huff,et al.  High Noon at OS Corral: Duels and Shoot-Outs in Open Source Discourse , 2007 .

[336]  Barry W. Boehm,et al.  A Method for Compatible COTS Component Selection , 2005, ICCBSS.

[337]  Jason E. Robbins Adopting Open Source Software Engineering (OSSE) Practices by Adopting OSSE Tools , 2003 .

[338]  Even-André Karlsson,et al.  Software reuse: a holistic approach , 1995 .

[339]  Hans Christian von Baeyer Up from Alchemy , 1993 .

[340]  Pearl Brereton,et al.  Lessons learnt Undertaking a Large-scale Systematic Literature Review , 2008, EASE.