Collaborative Usability Testing to Facilitate Stakeholder Involvement

Stakeholder involvement is an essential part of Value-Based Software Engineering. A critical part of the software engineering life cycle concerns usability testing. System usability refers to the effectiveness, efficiency, and satisfaction with which users can use the system for their relevant tasks. Unfortunately stakeholder involvement in usability testing is costly and challenging to organize. This chapter presents a repeatable collaborative usability testing process supported by a Group Support System that was developed and evaluated in a series of workshops involving a real system. The results show that the collaborative usability testing process facilitates stakeholder involvement through stakeholder expectation management, visualization and tradeoff analysis, prioritization of usability action items, the use of advanced groupware tools, and a simple business case analysis. Furthermore, the process can be considered productive and stakeholders reported substantial levels of satisfaction with it.

[1]  A. Adam.  Whatever happened to information systems ethics? Caught between the devil and the deep blue sea , 2004 .

[2]  Stefan Biffl,et al.  An empirical study on groupware support for software inspection meetings , 2003, 18th IEEE International Conference on Automated Software Engineering, 2003. Proceedings..

[3]  Clarence A. Ellis,et al.  Groupware: some issues and experiences , 1991, CACM.

[4]  Barry W. Boehm.  Value-based software engineering: reinventing , 2003, SOEN.

[5]  Jay F. Nunamaker,et al.  Lessons from a Dozen Years of Group Support Systems Research: A Discussion of Lab and Field Findings , 1996, J. Manag. Inf. Syst..

[6]  Jay F. Nunamaker,et al.  Enabling the Effective Involvement of Multiple Users: Methods and Tools for Collaborative Software Engineering , 1997, J. Manag. Inf. Syst..

[7]  Deborah J. Mayhew,et al.  The usability engineering lifecycle , 1998, CHI Conference Summary.

[8]  Stuart E. Madnick,et al.  Special Section: Assuring Information Quality , 2004, J. Manag. Inf. Syst..

[9]  Robert M. Davison,et al.  How a silver bullet may lose its shine , 2003, CACM.

[10]  Miles MacLeod,et al.  Usability measurement in context , 1994, Behav. Inf. Technol..

[11]  Robert O. Briggs,et al.  A theory and measurement of meeting satisfaction , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[12]  Ortrun Zuber-Skerritt,et al.  Action Research for Change and Development , 2021 .

[13]  Fabio Paternò,et al.  Automatic Support for Usability Evaluation , 1998, IEEE Trans. Software Eng..

[14]  Mark A. Fuller,et al.  Facilitator Influence in Group Support Systems: Intended and Unintended Effects , 1998, Inf. Syst. Res..

[15]  Michael J. Muller,et al.  Methods & tools: participatory heuristic evaluation , 1998, INTR.

[16]  Douglas R. Vogel,et al.  Using Group Support Systems for Software Inspections , 2001, IEEE Softw..

[17]  Ivar Jacobson,et al.  Object-oriented software engineering - a use case driven approach , 1993, TOOLS.

[18]  Starr Roxanne Hiltz,et al.  An Assessment of Group Support Systems Experimental Research: Methodology and Results , 1998, J. Manag. Inf. Syst..

[19]  Stefan Biffl,et al.  Integrating Collaborative Processes and Quality Assurance Techniques: Experiences from Requirements Negotiation , 2004, J. Manag. Inf. Syst..

[20]  Brad Quinn Post,et al.  A Business Case Framework for Group Support Technology , 1992, J. Manag. Inf. Syst..

[21]  Fred Niederman,et al.  Issues and Concerns About Computer-Supported Meetings: The Facilitator's Perspective , 1996, MIS Q..

[22]  Paul Weiler,et al.  Remote usability testing , 1994, INTR.

[23]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[24]  Tom L. Roberts,et al.  Improving the Usability Evaluation Technique, Heuristic Evaluation, through the Use of Collaborative Software , 2005, AMCIS.

[25]  Mik Lamming,et al.  Interactive system design , 1995 .

[26]  J. Nielsen,et al.  Teaching user interface design based on usability engineering , 1989, SGCH.

[27]  Peter Checkland,et al.  Systems Thinking, Systems Practice , 1981 .

[28]  Robert M. Davison,et al.  GSS for presentation support , 2000, CACM.

[29]  Gary Dickson,et al.  Using GSS to Design Organizational Processes and Information Systems: An Action Research Study on Collaborative Business Engineering , 2000 .

[30]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[31]  Barry W. Boehm,et al.  Value-based software engineering: reinventing , 2003, SOEN.

[32]  Gert-Jan de Vreede,et al.  Exploring the Boundaries of Successful GSS Application: Supporting Inter-Organizational Policy Networks , 1999, HICSS.

[33]  Jay F. Nunamaker,et al.  Electronic meeting systems , 1991, CACM.

[34]  Jay F. Nunamaker,et al.  Implementing Electronic Meeting Systems at IBM: Lessons Learned and Success Factors , 1990, MIS Q..

[35]  Barry W. Boehm,et al.  Developing Groupware for Requirements Negotiation: Lessons Learned , 2001, IEEE Softw..

[36]  Jay F. Nunamaker,et al.  Collaboration Engineering with ThinkLets to Pursue Sustained Success with Group Support Systems , 2003, J. Manag. Inf. Syst..

[37]  John Dowell,et al.  A framework for human factors evaluation , 1991 .

[38]  Robert O. Briggs,et al.  Collaboration Engineering: Designing Repeatable Processes for High-Value Collaborative Tasks , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.