Measuring the Quality of Open Source Software Ecosystems Using QuESo

Open source software has witnessed an exponential growth in the last two decades and it is playing an increasingly important role in many companies and organizations leading to the formation of open source software ecosystems. In this paper we present a quality model that will allow the evaluation of those ecosystems in terms of their relevant quality characteristics such as health or activeness. To design this quality model we started by analysing the quality measures found during the execution of a systematic literature review on open source software ecosystems and, then, we classified and reorganized the set of measures in order to build a solid quality model. Finally, we test the suitability of the constructed quality model using the GNOME ecosystem.

[1]  Raúl García-Castro,et al.  Extending Software Quality Models - A Sample In The Domain of Semantic Technologies , 2011, SEKE.

[2]  Klaus Marius Hansen,et al.  Software ecosystems - A systematic literature review , 2013, J. Syst. Softw..

[3]  Marcus Ciolkowski,et al.  The QualOSS open source assessment model measuring the performance of open source communities , 2009, ESEM 2009.

[4]  Klaus Marius Hansen,et al.  Reviewing the Health of Software Ecosystems - A Conceptual Framework Proposal , 2013, IWSECO@ICSOB.

[5]  Ivar Jacobson,et al.  Object-oriented software engineering - a use case driven approach , 1993, TOOLS.

[6]  H. Haken,et al.  Synergetics , 1988, IEEE Circuits and Devices Magazine.

[7]  Dolors Costal,et al.  Protocol for a systematic literature review on open source-software ecosystems Technical report , 2014 .

[8]  M. Iansiti,et al.  Keynotes and Dominators: Framing Operating and Technology Strategy in a Business Ecosystem , 2002 .

[9]  Slinger Jansen,et al.  Defining software ecosystems: a survey of software platforms and business network governance , 2012 .

[10]  Slinger Jansen,et al.  Ecosystem Health of Cloud PaaS Providers , 2013, ICSOB.

[11]  Tommi Mikkonen,et al.  From proprietary to open source - Growing an open source ecosystem , 2012, J. Syst. Softw..

[12]  Anita Sarma,et al.  The onion patch: migration in open source ecosystems , 2011, ESEC/FSE '11.

[13]  Olavo Barbosa,et al.  A Systematic Mapping Study on Software Ecosystems , 2011, IWSECO@ICSOB.

[14]  Tom Mens,et al.  A framework for analysing and visualising open source software ecosystems , 2010, IWPSE-EVOL '10.

[15]  Walt Scacchi,et al.  Free/open source software development: recent research results and emerging opportunities , 2007, ESEC-FSE companion '07.

[16]  Srini Ramaswamy,et al.  Entropy-Based Study of Components in Open-Source Software Ecosystems , 2015 .

[17]  Jonas Gamalielsson,et al.  Exploring health within OSS ecosystems , 2009 .

[18]  Tom Mens,et al.  Analysing the evolution of social aspects of open source software ecosystems , 2011, IWSECO@ICSOB.

[19]  Michele Lanza,et al.  Telling stories about GNOME with Complicity , 2011, 2011 6th International Workshop on Visualizing Software for Understanding and Analysis (VISSOFT).

[20]  Slinger Jansen,et al.  Influences on developer participation in the Debian software ecosystem , 2011, MEDES.

[21]  George Kuk,et al.  Mapping Collaboration in Open Source Geospatial Ecosystem , 2012, Trans. GIS.

[22]  Michele Lanza,et al.  Visualizing Gnome with the Small Project Observatory , 2009, 2009 6th IEEE International Working Conference on Mining Software Repositories.

[23]  Mathieu Goeminne,et al.  Analyzing ecosystems for open source software developer communities , 2013 .

[24]  Slinger Jansen,et al.  Measuring the health of open source software ecosystems: Beyond the scope of project health , 2014, Inf. Softw. Technol..

[25]  Jonas Gamalielsson,et al.  The Nagios Community: An Extended Quantitative Analysis , 2010, OSS.

[26]  Erik den Hartigh,et al.  Measuring the health of a business ecosystem , 2013 .

[27]  Walt Scacchi,et al.  Understanding the role of licenses and evolution in open architecture software ecosystems , 2012, J. Syst. Softw..

[28]  Slinger Jansen,et al.  Steering Insight: An Exploration of the Ruby Software Ecosystem , 2011, ICSOB.

[29]  Mathieu Goeminne,et al.  Analyzing ecosystems for open source software developer communities: Analyzing and Managing Business Networks in the Software Industry , 2013 .

[30]  Slinger Jansen,et al.  Software Ecosystems: Analyzing and Managing Business Networks in the Software Industry , 2013 .

[31]  Xavier Franch,et al.  Using Quality Models in Software Package Selection , 2003, IEEE Softw..

[32]  Mohammad Kazem Akbari,et al.  Customizing ISO 9126 quality model for evaluation of B2B applications , 2009, Inf. Softw. Technol..

[33]  Björn Lundell,et al.  Commodification of Industrial Software: A Case for Open Source , 2009, IEEE Software.

[34]  Qiang Li,et al.  Research on the Evaluation of Business Ecosystem Health , 2013 .

[35]  Kenichi Sakamoto,et al.  Systems and Software Quality : 4. A Quality Evaluation of System and Software - Introduction of Actual Application of ISO/IEC 25000 (SQuaRE) - , 2013 .

[36]  Roel Wieringa,et al.  Design science as nested problem solving , 2009, DESRIST.

[37]  Slinger Jansen,et al.  Shades of gray: Opening up a software producing organization with the open software enterprise model , 2012, J. Syst. Softw..

[38]  Pär J. Ågerfalk,et al.  Outsourcing to an Unknown Workforce: Exploring Opensourcing as a Global Sourcing Strategy , 2008, MIS Q..

[39]  Slinger Jansen,et al.  Quality review and approval methods for extensions in software ecosystems , 2013 .

[40]  Tom Mens,et al.  A historical dataset for the Gnome ecosystem , 2013, 2013 10th Working Conference on Mining Software Repositories (MSR).

[41]  Slinger Jansen,et al.  Defining Software Ecosystems: A Survey of Software Platforms and Business Network Governance , 2013, IWSECO@ICSOB.

[42]  Ioannis Stamelos,et al.  The SQO-OSS Quality Model: Measurement Based Open Source Software Evaluation , 2008, OSS.

[43]  Romain Robbes,et al.  The Small Project Observatory: Visualizing software ecosystems , 2010, Sci. Comput. Program..

[44]  Michael Weiss,et al.  Economics of collectives , 2011, SPLC '11.

[45]  Forrest Shull,et al.  Creating Software Process Capability/Maturity Models , 2010, IEEE Software.

[46]  James A. Narus,et al.  Business Market Management: Understanding, Creating, and Delivering Value (Управление бизнес-рынками: понимание, создание и донесение ценности) , 1998 .