Finding Open options; An Open Source software evaluation model with a case study on Course Management Systems

This Master thesis was written as part of the Information Management and Science program at Tilburg University. The thesis defence will take place on the 23rd of August, 2005 in room B834 at Tilburg University. Summary The Open Source software market is getting more and more attention. Large IT corporations such as IBM and Novell are investing in Open Source software. Open Source software development is very different from traditional proprietary software. In order to understand Open Source software better, this thesis offers a model for Open Source software evaluation, which can be used as a tool to find the right software package to meet the user's needs. The goal was to get a better understanding of Open Source software and to make the Open Source software process more understandable for those who evaluate this type of software. An introduction to Open Source software is followed by the Open Source software evaluation model, using the criteria found in Open Source literature. Community – the driving force behind an Open Source project Release Activity – showing the progress made by the developers Longevity – how long the product has been around License – is one of the general Open Source licenses used Support – from the community as well as paid support options Documentation – user manuals and tutorials, developer documentation Security – responding to vulnerabilities Functionality – testing against functional requirements Integration – standards, modularity and collaboration with other products Goal and Origin – why was the project started and what is the current goal These criteria form the key terms of the model. The evaluation process is described using these criteria. The practical part of the model consists of two steps. In the first step selection on the candidate list is performed, using four of the above criteria: Functionality, Community, Release Activity and Longevity. These criteria were selected because they can be evaluated quickly for each candidate in order to eliminate non-viable candidates and select the best ones. This step results in a 'short list' of candidates that can be evaluated in depth in the second step, taking a closer look at the software and the project using all ten criteria. In order to test this model on real Open Source software, a case study was performed on Course Management Systems. In this case study the model is applied on a candidate list of 36 systems, and evaluation is …

[1]  Alexander Hars,et al.  Working for free? Motivations of participating in open source projects , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[2]  Kevin Crowston,et al.  Towards a Portfolio of FLOSS Project Success Measures , 2004, ICSE 2004.

[3]  Magnus Bergquist,et al.  The power of gifts: organizing social relationships in open source communities , 2001, Inf. Syst. J..

[4]  Giampaolo Garzarelli,et al.  THE PURE CONVERGENCE OF KNOWLEDGE AND RIGHTS IN ECONOMIC ORGANIZATION: THE CASE OF OPEN SOURCE SOFTWARE DEVELOPMENT , 2002 .

[5]  Richard N. Taylor,et al.  Supporting Distributed and Decentralized Projects: Drawing Lessons from the Open Source Community , 2003 .

[6]  Audris Mockus,et al.  A case study of open source software development: the Apache server , 2000, Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium.

[7]  Chris Coppola,et al.  Open source - opens learning: Why open source makes sense for education , 2004 .

[8]  Steven Weber,et al.  The Success of Open Source , 2004 .

[9]  Eric S. Raymond,et al.  Homesteading the Noosphere , 1998, First Monday.

[10]  CRISPIN COWAN,et al.  Software Security for Open-Source Systems , 2003, IEEE Secur. Priv..

[11]  Guido Hertel,et al.  Motivation of software developers in Open Source projects: an Internet-based survey of contributors to the Linux kernel , 2003 .

[12]  Christian Payne,et al.  On the security of open source software , 2002, Inf. Syst. J..

[13]  Evan E. Anderson,et al.  Choice Models for the Evaluation and Selection of Software Packages , 1990, J. Manag. Inf. Syst..

[14]  Bernard Golden,et al.  Succeeding with Open Source , 2004 .

[15]  Brian Fitzgerald,et al.  Collaboration, conflict and control: the 4th workshop on open source software engineering , 2004, Proceedings. 26th International Conference on Software Engineering.

[16]  The Commonwealth of Learning , 1989, Environmental Conservation.

[17]  Peter Charles Taylor,et al.  Moodle: Using Learning Communities to Create an Open Source Course Management System , 2003 .

[18]  Walt Scacchi,et al.  Understanding the requirements for developing open source software systems , 2002, IEE Proc. Softw..

[19]  J. Herbsleb,et al.  Two case studies of open source software development: Apache and Mozilla , 2002, TSEM.

[20]  Robert L. Glass A sociopolitical look at open source , 2003, CACM.