Introducing Usability Activities into Open Source Software Development Projects – Searching for a Suitable Approach

Abstract Usability is an important quality characteristic of software products and systems. Different approaches for introducing usability activities into SW development have not yet been evaluated with respect to open source software (OSS). This paper tests the introduction of usability activities through four empirical case studies in the OSS development context. Case studies were carried out using four OSS projects that were not commercially supported. Empirical analysis suggests that usability specialists should become members of the OSS community, but, at the same time, should keep an objective view. The usability activities had substantially more impact when specialists introduced and carried them out as fellow members of the OSS community than as usability consultants from outside the community. The importance of management commitment for usability activities is discussed in the OSS context. The challenge of adapting usability and OSS development philosophies together should be researched further. Keywords: usability, open source software INTRODUCTION This paper examines four case studies in which usability activities are introduced into open source software (OSS) development. The specific research question examined in the paper is: How should usability activities be introduced into OSS development? OSS development has gained increasing interest in information systems (IS) research during recent years (see, e.g., Fitzgerald 2006, Niederman et al. 2006), and OSS development has been argued to be highly influential in the software landscape of the future (Fitzgerald 2006). Estimating the number of users and the market share of OSS solutions is difficult because OSS can usually be downloaded freely and from numerous mirror sites and peer-to-peer networks. One of the most well-known Web-based repositories is SourceForge, a leading resource for OSS development and distribution. It has about 2.7 million developers, over 260.000 OSS development projects, a total number of users in all projects estimated at more than 46 million, and more than two million downloads from project repositories every day (SourceForge.net). At least twenty other source code repositories and resources also exist for OSS development and distribution. The size of an OSS development project can range from a single developer working alone to code and use the application to massive OSS development projects that span years and involve hundreds of developers, e.g., Linux and OpenOffice.org. The latest version of the OpenOffice.org office application suite has an estimated 15-20 percent market share. In 2009, OpenOffice.org announced that the latest version had recorded one hundred million downloads within a year from their main download site, and this did not include downloads from mirror sites and peer-to-peer networks (OpenOffice.org). The Firefox Web browser has been downloaded over one billion times and has a 23 percent worldwide usage share for Web browsers (Mozilla.com). The Apache Web server software serves 55 percent of all websites in the world and has reached the 100 millionth website milestone (Apache.org). Therefore, the OSS phenomenon clearly is highly influential in the current software landscape (cf. Fitzgerald 2006). The term open source software refers to software for which source code is freely available for everyone to read and modify. The fundamental idea of OSS is to enable software to evolve outside of commercial company restrictions by exploiting the participation of technically oriented contributors and users in the outside community (cf. Raymond 1999, Ye and Kishida 2003). Traditionally, software development is carried out in closed settings as closed source software development, where only few people can access the code. In traditional software development, the endusers can see and use only the binary form of the software. In contrast, OSS development makes it possible for the end-users to adapt software to their personal needs and to fix defects (Raymond 1999). …

[1]  Michael E. Atwood,et al.  What is gained and lost when using evaluation methods other than empirical testing , 1993 .

[2]  Deborah J. Mayhew,et al.  A basic framework for costs-justifying usability engineering , 1994 .

[3]  Karen Holtzblatt,et al.  Contextual design , 1997, INTR.

[4]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[5]  Francesco Rullani,et al.  Skills and Openness of OSS Projects : implications for performance , 2005 .

[6]  Netta Iivari,et al.  Traditional Usability Costs and Benefits: Fitting them into Open Source Software Development , 2010, ECIS.

[7]  Deborah J. Mayhew,et al.  The usability engineering lifecycle , 1999, CHI Extended Abstracts.

[8]  E. Quah,et al.  Cost-Benefit Analysis , 1972 .

[9]  Kim Halskov,et al.  Cooperative usability practices , 1999, CACM.

[10]  Mary Beth Rosson,et al.  Usability Engineering: Scenario-based Development of Human-Computer Interaction , 2001 .

[11]  Arlene F. Aucella.  Ensuring success with usability engineering , 1997, INTR.

[12]  Anthony F. Hutchings,et al.  Creating products customers demand , 1995, CACM.

[13]  Charles L. Mauro.  Usability Science: Tactical and Strategic Cost Justifications in Large Corporate Applications , 2005 .

[14]  John M. Carroll,et al.  FLOSS UX Design: An Analysis of User Experience Design in Firefox and OpenOffice.org , 2009, OSS.

[15]  Netta Iivari,et al.  Usability Cost-Benefit Analysis: How Usability Became a Curse Word? , 2007, INTERACT.

[16]  David M. Nichols,et al.  Usability and open-source software development , 2001, CHINZ '01.

[17]  Salvatore T. March,et al.  Design and natural science research on information technology , 1995, Decis. Support Syst..

[18]  Robin Jeffries,et al.  Applying cognitive walkthroughs to more complex user interfaces: experiences, issues, and recommendations , 1992, CHI.

[19]  Alan R. Hevner,et al.  A Fitness-Utility Model for Design Science Research , 2011, DESRIST.

[20]  Alan Cooper,et al.  About Face 3: the essentials of interaction design , 1995 .

[21]  Netta Iivari,et al.  Usability in Company Open Source Software Context - Initial Findings from an Empirical Case Study , 2008, OSS.

[22]  Leslie G. Tudor.  Human factors: does your management hear you? , 1998, INTR.

[23]  E. Rogers,et al.  Diffusion of Innovations, 5th Edition , 2003 .

[24]  Fred Niederman,et al.  A Research Agenda for Studying Open Source I: A Multi-Level Framework , 2006, Commun. Assoc. Inf. Syst..

[25]  Jan Stage,et al.  Usability in open source software development: opinions and practice , 2006 .

[26]  Eric S. Raymond,et al.  The Cathedral & the Bazaar , 1999 .

[27]  Antonio Pflüger,et al.  Executive Summary. , 2012, Journal of the ICRU.

[28]  Fadi P. Deek,et al.  Improving Open Source Software Usability , 2005, AMCIS.

[29]  Pär J. Ågerfalk,et al.  Outsourcing to an Unknown Workforce: Exploring Opensourcing as a Global Sourcing Strategy , 2008, MIS Q..

[30]  David M. Nichols,et al.  Exploring Usability Discussions in Open Source Development , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[31]  David M. Nichols,et al.  Usability processes in open source projects , 2006, Softw. Process. Improv. Pract..

[32]  Joseph F. Dumas,et al.  A Practical Guide to Usability Testing , 1993 .

[33]  Jacob Buur,et al.  The design collaboratorium: a place for usability design , 2002, TCHI.

[34]  Karel Vredenburg,et al.  A survey of user-centered design practice , 2002, CHI.

[35]  Alan R. Hevner,et al.  Design Research in Information Systems , 2010 .

[36]  Sarah A. Bloomer,et al.  Pitching usability to your organization , 1997, INTR.

[37]  Samir Chatterjee,et al.  A Design Science Research Methodology for Information Systems Research , 2008 .

[38]  Mikko Rajanen.  Different Approaches to Usability Cost-Benefit Analysis , 2006 .

[39]  Leela Damodaran,et al.  User involvement in the systems design process-a practical guide for users , 1996, Behav. Inf. Technol..

[40]  Matthias Müller-Prove,et al.  Professional usability in open source projects: GNOME, OpenOffice.org, NetBeans , 2004, CHI EA '04.

[41]  Thomas Müller-Bohn,et al.  Cost-Benefit Analysis , 2015 .

[42]  John Karat,et al.  Evolving the scope of user-centered design , 1997, CACM.

[43]  Jeffrey Rubin,et al.  Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests , 1994 .

[44]  Görkem Çetin,et al.  An Analysis of Involvement of HCI Experts in Distributed Software Development: Practical Issues , 2007, HCI.

[45]  Eric Lease Morgan,et al.  Review of The Cathedral & the Bazaar: Musings on Linux and Open Source by an Accidental Revolutionary by Eric S. Raymond, Sebastopol, Calif.: O'Reilly, 1999 , 2000 .

[46]  Brian Fitzgerald,et al.  The Transformation of Open Source Software , 2006, MIS Q..

[47]  Mark Aberdour.  A people-focused , 2022 .

[48]  Jan Gulliksen,et al.  Key principles for user-centred systems design , 2003, Behav. Inf. Technol..

[49]  Mads Bødker,et al.  Enabling User Centered Design Processes in Open Source Communities , 2007, HCI.

[50]  Jonathan Grudin,et al.  Systematic Sources of Suboptimal Interface Design in Large Product Development Organizations , 1991, Hum. Comput. Interact..

[51]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[52]  Carola B. Fellenz.  Introducing usability into smaller organizations , 1997, INTR.

[53]  Fadi P. Deek,et al.  Exploratory inspection: a learning model for improving open source software usability , 2006, CHI EA '06.

[54]  Kouichi Kishida,et al.  Toward an understanding of the motivation of open source software developers , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[55]  Eric A. von Hippel,et al.  How Open Source Software Works: 'Free' User-to-User Assistance? , 2000 .

[56]  Pär J. Ågerfalk,et al.  The Mysteries of Open Source Software: Black and White and Red All Over? , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[57]  Alan R. Hevner,et al.  The Three Cycle View of Design Science , 2007, Scand. J. Inf. Syst..

[58]  Alex Eiser,et al.  Leveraging open-source software in the design and development process , 2009, CHI Extended Abstracts.

[59]  K. R. Ohnemus.  Incorporating human factors in the system development life cycle: marketing and management approaches , 1996, IPCC 96: Communication on the Fast Track. IPCC 96 Proceedings.

[60]  John M. Carroll,et al.  Designers wanted: participation and the user experience in open source software development , 2009, CHI.

[61]  Stephanie Rosenbaum,et al.  A toolkit for strategic usability: results from workshops, panels, and surveys , 2000, CHI.

[62]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[63]  Netta Iivari,et al.  Understanding the work of an HCI practitioner , 2006, NordiCHI '06.

[64]  Netta Iivari,et al.  Product development , 2006, Nature.

[65]  Nick Hammond,et al.  Comparing Usability Evaluation Principles with Heuristics: Problem Instances vs. Problem Types , 1999, INTERACT.

[66]  Kate Ehrlich,et al.  Cost justification of usability engineering: a vendors's perspective , 1994 .

[67]  Heather Desurvire,et al.  Using heuristics to evaluate the playability of games , 2004, CHI EA '04.

[68]  Jan Gulliksen,et al.  Management perspectives on usability in a public authority: a case study , 2006, NordiCHI '06.

[69]  David M. Nichols,et al.  The Usability of Open Source Software , 2003, First Monday.

[70]  Eric Schaffer,et al.  Institutionalization of Usability: A Step-By-Step Guide , 2004 .

[71]  Linus Dahlander,et al.  Relationships Between Open Source Software Companies and Communities: Observations from Nordic Firms , 2005 .

[72]  Melissa A. Federoff,et al.  HEURISTICS AND USABILITY GUIDELINES FOR THE CREATION AND EVALUATION OF FUN IN VIDEO GAMES , 2002 .

[73]  Clare-Marie Karat,et al.  A Business Case Approach to Usability Cost Justification for the Web , 1994 .

[74]  George M. Donahue.  Usability and the Bottom Line , 2001, IEEE Softw..

[75]  Nancy J. Frishberg,et al.  Getting to know you: open source development meets usability , 2002, CHI Extended Abstracts.

[76]  B. Schneirdeman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[77]  Deborah J. Mayhew.  Business: Strategic development of the usability engineering function , 1999, INTR.

[78]  C. Dennis Allen.  Succeeding as a clandestine change agent , 1995, CACM.

[79]  Michael D. Myers,et al.  A Set of Principles for Conducting and Evaluating Interpretive Field Studies in Information Systems , 1999, MIS Q..