Evaluating Groupware Prototypes with Discount Methods

Evaluating a prototype is necessary to user-centered software design, but evaluating groupware systems prior to full deployment can be challenging and costly. Existing groupware evaluation methods focus on individual users, expert inspections, or require the system to be rolled out. We describe a method -- based on Gutwin and Greenberg's mechanics of collaboration (MoC) framework -- for evaluating prototype groupware systems that have not yet been deployed with the minimum number of users needed to be truly functional. We believe this is a valuable method for evaluating early prototype groupware.

[1]  Mary Beth Rosson,et al.  Scenario-based design , 2002 .

[2]  Carl Gutwin,et al.  A comparison of usage evaluation and inspection methods for assessing groupware usability , 2001, GROUP.

[3]  Julie A. Kientz,et al.  A web-based collaborative translation management system for public health workers , 2013, CHI Extended Abstracts.

[4]  Katrin Kirchhoff,et al.  Modeling workflow to design machine translation applications for public health practice , 2015, J. Biomed. Informatics.

[5]  Jakob Nielsen,et al.  Guerrilla HCI: using discount usability engineering to penetrate the intimidation barrier , 1994 .

[6]  Sandeep Purao,et al.  Situating evaluation in scenarios of use , 2004, CSCW.

[7]  Flávia Maria Santoro,et al.  A conceptual framework for designing and conducting groupware evaluations , 2004, Int. J. Comput. Appl. Technol..

[8]  Wendy E. Mackay,et al.  CHI '13 Extended Abstracts on Human Factors in Computing Systems , 2013, CHI 2013.

[9]  Mary Beth Rosson,et al.  Evaluating computer-supported cooperative work: models and frameworks , 2004, CSCW.

[10]  Anne M Turner,et al.  A Resource Management Tool for Public Health Continuity of Operations During Disasters , 2013, Disaster Medicine and Public Health Preparedness.

[11]  Carl Gutwin,et al.  The mechanics of collaboration: developing low cost usability evaluation methods for shared workspaces , 2000, Proceedings IEEE 9th International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises (WET ICE 2000).

[12]  Daniel Capurro,et al.  Local Health Department Translation Processes: Potential of Machine Translation Technologies to Help Meet Needs , 2013, AMIA.

[13]  Jean Scholtz,et al.  Evaluation for collaborative systems , 1999, CSUR.