Assessing Free / Open Source Software Quality

According to its proponents, one of the most acclaimed advantages of Free/Open Source Software (F/OSS) is its superior quality. However, this suggestion is an open issue, since there is little concrete evidence to justify whether F/OSS quality is indeed better or worse than that of proprietary software products. The general perspective of this article is to discuss the current status of F/OSS quality and to assess its performance in various aspects of quality, based on existing literature. Specifically, this article will provide some answers to various questions raised by the assertion concerning the quality of F/OSS. In this regard issues addressed in this article include the quality framework, through which F/OSS quality should be investigated and the performance of F/OSS in various quality factors within this quality framework. Answers to these issues are given by providing evidence from various research papers, empirical studies and reports based on experience about the quality of F/OSS products. The overall results seem to indicate that F/OSS has achieved an acceptable level of quality, although there is more to be done in order to outperform proprietary software.

[1]  Chris DiBona,et al.  Open Sources: Voices from the Open Source Revolution , 1999 .

[2]  Arthur J. Riel,et al.  Object-Oriented Design Heuristics , 1996 .

[3]  Daniel Plakosh,et al.  Trust and vulnerability in open source software , 2002, IEE Proc. Softw..

[4]  Stefan Koch,et al.  Results from software engineering research into open source development projects using public data , 2000 .

[5]  David M. Nichols,et al.  Usability and open source software. , 2002 .

[6]  Maurice H. Halstead,et al.  Elements of software science , 1977 .

[7]  Brian Fitzgerald,et al.  A framework analysis of the open source software development paradigm , 2000, ICIS.

[8]  Shari Lawrence Pfleeger,et al.  Software Metrics : A Rigorous and Practical Approach , 1998 .

[9]  Stephen R. Schach,et al.  Maintainability of the Linux kernel , 2002, IEE Proc. Softw..

[10]  David M. Nichols,et al.  The Usability of Open Source Software , 2003, First Monday.

[11]  Budi Arief,et al.  Dependability Issues in Open Source Software - DIRC Project Activity 5 Final Report , 2002 .

[12]  Shari Lawrence Pfleeger,et al.  Software Quality: The Elusive Target , 1996, IEEE Softw..

[13]  Douglas C. Schmidt,et al.  Leveraging Open-Source Communities To Improve the Quality & Performance of Open-Source Software , 2001 .

[14]  Bev Littlewood,et al.  Advantages of open source processes for reliability: clarifying the issues , 2002 .

[15]  Brian Fitzgerald,et al.  Understanding open source software development , 2002 .

[16]  J. Herbsleb,et al.  Two case studies of open source software development: Apache and Mozilla , 2002, TSEM.

[17]  Natalia Juristo Juzgado,et al.  Usability basics for software developers , 2001, IEEE Software.

[18]  Ben Shneiderman,et al.  Introduction to Special Issue on Usability Engineering , 1999, Empirical Software Engineering.