Mapping and Analysis of Open Source Software (OSS) Usability for Sustainable OSS Product

The increase in the number of open source software (OSS) users have drawn attention to improving usability. Usability is a clear concept that encompassing both task and user characteristics as well as functionality. Usability is an essential factor that affects user acceptance and OSS sustainability, which is considered as the key to the success of the OSS. To some extent, usability is one concern of the larger issue of system acceptability and sustainability. Therefore, usability is an important factor that needs to be considered since the software that is not usable is not going to be sustainable. The objective of this paper is to review researchers’ efforts to improve, investigate, and evaluate the usability factor that may affect the OSS acceptability and sustainability and map the research scenery from the articles into a comprehensible structured taxonomy, which would help the researchers to identify different research gaps of this field. A survey of the usability in OSS conducted and 6033 studies identified by a search in four scholarly databases using a query that includes the keywords (usability or learnability or efficiency or satisfaction) and (open source software or OSS). A total of 46 studies are selected. By manually searching in ACM, Springer, and Google Scholar five other studies identified, and thus a total of 51 studies were the final set that includes in this paper. Based on research topics, a taxonomy created and divided into four principal categories which improve OSS usability, analyze OSS usability, evaluate OSS usability, and select and adopt OSS. A comprehensive overview and synthesis of these categories are presented as well. This paper contributes to identifying the possible opportunities and gaps for enabling the participation of interested researchers in this research area. And give possibilities for extending the use of usability research and practices to create more sustainable software. Also, helps in selecting suitable OSS among the alternatives.

[1]  Luiz Fernando Capretz,et al.  Users’ perception of open source usability: an empirical study , 2011, Engineering with Computers.

[2]  Mads Bødker,et al.  Enabling User Centered Design Processes in Open Source Communities , 2007, HCI.

[3]  Netta Iivari,et al.  Traditional Usability Costs and Benefits: Fitting them into Open Source Software Development , 2010, ECIS.

[4]  Görkem Çetin,et al.  A Measurement Based Framework for Assessment of Usability-Centricness of Open Source Software Projects , 2008, 2008 IEEE International Conference on Signal Image Technology and Internet Based Systems.

[5]  Luiz Fernando Capretz,et al.  An Empirical Study of Open Source Software Usability: The Industrial Perspective , 2015, Int. J. Open Source Softw. Process..

[6]  Noraini Che Pa,et al.  Open source software selection using an analytical hierarchy process (AHP) , 2014 .

[7]  Daniel Schwartz,et al.  Integrating user experience into free/libre open source software: CHI 2009 special interest group , 2009, CHI Extended Abstracts.

[8]  Evangelos Vlachogiannis,et al.  Major HCI Challenges for Open Source Software Adoption and Development , 2007, HCI.

[9]  Netta Iivari,et al.  Examining Usability Work and Culture in OSS , 2015, OSS.

[10]  Denis Lalanne,et al.  A Usability Refactoring Process for Large-Scale Open Source Projects: The ILIAS Case Study , 2017, CHI Extended Abstracts.

[11]  Netta Iivari,et al.  Open Source and Human Computer Interaction Philosophies in Open Source Projects: Incompatible or Co-Existent? , 2013, MindTrek.

[12]  John Grundy,et al.  Analysis of the Textual Content of Mined Open Source Usability Defect Reports , 2017, 2017 24th Asia-Pacific Software Engineering Conference (APSEC).

[13]  Ahmed Alzaghoul,et al.  Usability Degree for Arabized Open Source Software: Php My Bibli Integrated Library System as a Case Study , 2015, 2015 IEEE European Modelling Symposium (EMS).

[14]  Mohamed Sarrab,et al.  Empirical study of open source software selection for adoption, based on software quality characteristics , 2014, Adv. Eng. Softw..

[15]  Silvia T. Acuña,et al.  Applying a Usability Technique in the Open Source Software Development Process: Experiences from the Trenches , 2018 .

[16]  Amir Hossein Ghapanchi,et al.  Predicting software future sustainability: A longitudinal perspective , 2015, Inf. Syst..

[17]  José L. Verdegay,et al.  Fuzzy Multi-criteria Decision Making Methods Applied to Usability Software Assessment: An Annotated Bibliography , 2018 .

[18]  A. A. Zaidan,et al.  An evaluation and selection problems of OSS-LMS packages , 2016, SpringerPlus.

[19]  Fadi P. Deek,et al.  Exploratory inspection - a user-based learning method for improving open source software usability , 2010, J. Softw. Maintenance Res. Pract..

[20]  Sihem Ben Sassi,et al.  Exploring information from OSS repositories and platforms to support OSS selection decisions , 2018, Inf. Softw. Technol..

[21]  John Grundy,et al.  Reporting Usability Defects: Limitations of Open Source Defect Repositories and Suggestions for Improvement , 2015, ASWEC.

[22]  Alessio Maria Braccini,et al.  USERS' PERCEPTION OF OPEN SOURCE E-LEARNING PLATFORM QUALITY: THE CASE OF MOODLE , 2011 .

[23]  Silvia Teresita Acuña,et al.  A pilot empirical study of applying a usability technique in an open source software project , 2019, Inf. Softw. Technol..

[24]  Görkem Çetin,et al.  Assessing usability readiness of collaborative projects , 2011, Comput. Syst. Sci. Eng..

[25]  Netta Iivari,et al.  Non-response, Social Exclusion, and False Acceptance: Gatekeeping Tactics and Usability Work in Free-Libre Open Source Software Development , 2015, INTERACT.

[26]  Hoda Baytiyeh.  Work in progress — Open source usability evaluation: The case of Moodle , 2011, 2011 Frontiers in Education Conference (FIE).

[27]  John C. Grundy,et al.  Preliminary Evaluation of a Guided Usability Defect Report Form , 2018, 2018 25th Australasian Software Engineering Conference (ASWEC).

[28]  Netta Iivari.  Usability in Open Source Software Development: An Interpretive Case Study , 2008, ECIS.

[29]  Edmund Laugasson,et al.  Free Software User Interfaces: Usability and Aesthetics , 2015, HCI.

[30]  Luiz Fernando Capretz,et al.  An open source usability maturity model (OS-UMM) , 2012, Comput. Hum. Behav..

[31]  Thamer A. Alrawashdeh.  Evaluating Open Source Software Usability Using a Multistage Fuzzy Model Approach , 2015 .

[32]  Silvia Teresita Acuña,et al.  Adapting usability techniques for application in open source Software: A multiple case study , 2019, Inf. Softw. Technol..

[33]  Matthew Kay,et al.  Perceptions and practices of usability in the free/open source software (FoSS) community , 2010, CHI.

[34]  Netta Iivari,et al.  Usability Innovations in OSS Development - Examining User Innovations in an OSS Usability Discussion Forum , 2010, OSS.

[35]  Silvia Teresita Acuña,et al.  Adoption of the Personas Technique in the Open Source Software Development Process , 2016, Interacción.

[36]  Sime Arsenovski,et al.  Evaluating usability in learning management system moodle , 2008, ITI 2008 - 30th International Conference on Information Technology Interfaces.

[37]  B. B. Zaidan,et al.  Multi-criteria analysis for OS-EMR software selection problem: A comparative study , 2015, Decis. Support Syst..

[38]  Luiz Fernando Capretz,et al.  Do open source software developers listen to their users? , 2012, First Monday.

[39]  R. Ramli,et al.  e-RUE : A cheap possible solution for usability evaluation , 2008, 2008 International Symposium on Information Technology.

[40]  João Saraiva,et al.  Towards a catalog of usability smells , 2015, SAC.

[41]  William Jones,et al.  Managing open source contributions for software project sustainability , 2010, PICMET 2010 TECHNOLOGY MANAGEMENT FOR GLOBAL ECONOMIC GROWTH.

[42]  S. M. Zabed Ahmed,et al.  Usability testing for an open-source integrated library system: A task-based study of the Koha OPAC interface , 2018, Electron. Libr..

[43]  B. B. Zaidan,et al.  Open source EMR software: Profiling, insights and hands-on analysis , 2014, Comput. Methods Programs Biomed..

[44]  Netta Iivari,et al.  Introducing usability activities into open source software development projects: a participative approach , 2012, NordiCHI.

[45]  Netta Iivari,et al.  Encouraging for Enculturation – An Enquiry on the Effort of Usability Specialists Entering OSS Projects , 2014 .

[46]  Netta Iivari,et al.  Usability in Company Open Source Software Context - Initial Findings from an Empirical Case Study , 2008, OSS.

[47]  Yusmadi Yah Jusoh,et al.  The selection criteria of open source software adoption in Malaysia , 2012 .

[48]  B. B. Zaidan,et al.  Evaluation and selection of open-source EMR software packages based on integrated AHP and TOPSIS , 2015, J. Biomed. Informatics.

[49]  Mohamed Sarrab,et al.  Selection criteria of open source software: First stage for adoption , 2013 .

[50]  Dawid Weiss,et al.  Introducing Usability Practices to OSS: The Insiders' Experience , 2007, OSS.

[51]  Netta Iivari,et al.  'Configuring the User and the Designer' - A Critical Inquiry on Usability Work in the Company Open Source Software Development Context , 2013, SCIS.

[52]  Celeste Lyn Paul.  A Survey of Usability Practices in Free/Libre/Open Source Software , 2009, OSS.

[53]  Netta Iivari,et al.  Power, Empowerment and Open Source Usability , 2015, CHI.

[54]  Görkem Çetin,et al.  An Analysis of Involvement of HCI Experts in Distributed Software Development: Practical Issues , 2007, HCI.

[55]  Sumeet Gupta,et al.  Measuring open source software success , 2009 .

[56]  N. Iivari,et al.  Assuring quality and usability in open source software development , 2007, First International Workshop on Emerging Trends in FLOSS Research and Development (FLOSS'07: ICSE Workshops 2007).

[57]  Silvia Teresita Acuña,et al.  Adoption of the Focus Groups Technique in the Open Source Software Development Process , 2017, HCI.

[58]  John W. Castro,et al.  Poster: Adoption of the Visual Brainstorming Technique in the Open Source Software Development Process , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering: Companion (ICSE-Companion).

[59]  Luiz Fernando Capretz,et al.  Usability bugs in open-source software and online forums , 2012, IET Softw..