Complex systems, cooperative work, and usability

Modern operating systems are increasingly complex and require a large number of individual subsystems and procedures; operators also must cooperate to make them function. In this paper the authors consider usability from a broad perspective based on this understanding, recognizing the challenges a team of operators, complex subsystems, and other technical aspects pose as they work together. It seeks to expand usability by adding insights from Computer-Supported Cooperative Work (CSCW)-based fieldwork in offshore operations. To contribute to the current usability literature, we investigated and analyzed through a network-based approach how operators, ship bridge hardware and software, and other physical environments work together. We propose a process for evaluating the usability of complex systems: field observation and interviews to determine how work is organized and executed by human and nonhuman actors and to identify whether additional artifacts are being used to supplement the nonhuman components. The use of those artifacts often identifies usability issues in complex systems.

[1]  Mark D. Dunlop,et al.  Dynamic positioning systems: usability and interaction styles , 2008, NordiCHI.

[2]  B. Latour On actor-network theory : A few clarifications , 1996 .

[3]  Jean Scholtz,et al.  Evaluation metrics and methodologies for user-centered evaluation of intelligent systems , 2006, Interact. Comput..

[4]  M. Callon Some Elements of a Sociology of Translation: Domestication of the Scallops and the Fishermen of St Brieuc Bay , 1984 .

[5]  John Law,et al.  Notes on the theory of the actor-network: Ordering, strategy, and heterogeneity , 1992 .

[6]  D. Papachristos,et al.  Usability Evaluation at the Ship ’ s Bridge : A Multi-Method Approach , 2012 .

[7]  A. Spicer,et al.  Is Actor Network Theory Critique? , 2008 .

[8]  Jeanette Blomberg,et al.  An ethnographic approach to design , 2002 .

[9]  Paula Savioja,et al.  Systems usability framework for evaluating tools in safety–critical work , 2013, Cognition, Technology & Work.

[10]  Diana E. Forsythe,et al.  “It's Just a Matter of Common Sense”: Ethnography as Invisible Work , 1999, Computer Supported Cooperative Work (CSCW).

[12]  Jacob O. Wobbrock,et al.  Understanding usability practices in complex domains , 2010, CHI.

[13]  B. Latour On Actor-Network Theory. A Few Clarifications, Plus More Than a Few Complications , 2017 .

[14]  Kjeld Schmidt,et al.  Cooperative Work and its Articulation: Requirements for Computer Support , 1994 .

[15]  Pål Sørgaard A Cooperative Work Perspective on Use and Development of Computer Artifacts , 1987 .

[16]  Jean Scholtz,et al.  Beyond Usability: Evaluation Aspects of Visual Analytic Environments , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[17]  J. Hassard,et al.  Actor Network Theory and After , 1999 .

[18]  Mari-Klara Oja Designing for collaboration: improving usability of complex software systems , 2010, CHI EA '10.

[19]  Kjeld Schmidt,et al.  The Problem with `Awareness': Introductory Remarks on `Awareness in CSCW' , 2002, Computer Supported Cooperative Work (CSCW).

[20]  Carl Gutwin,et al.  A Descriptive Framework of Workspace Awareness for Real-Time Groupware , 2002, Computer Supported Cooperative Work (CSCW).

[21]  Jean Scholtz,et al.  Implementation of a situation awareness assessment tool for evaluation of human-robot interfaces , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[22]  Andrew Sears and Julie A. Jacko The human-computer interaction handbook , 2013 .

[23]  Daniel J. Garland,et al.  Situation Awareness Analysis and Measurement , 2009 .

[24]  Yngve Sundblad,et al.  Usability and interaction design – new challenges for the Scandinavian tradition , 2008, Behav. Inf. Technol..

[25]  Charles Perrow,et al.  Normal accidents : living with high-risk technologies : with a new afterword and a postscript on the Y2K problem , 2011 .

[26]  Dag Svanæs,et al.  Interaction design for and with the lived body: Some implications of merleau-ponty's phenomenology , 2013, TCHI.

[27]  Kjeld Schmidt,et al.  Taking CSCW Seriously: Supporting Articulation Work * , 1992 .

[28]  Tomas Sokoler,et al.  AROMA: abstract representation of presence supporting mutual awareness , 1997, CHI.

[29]  Stella Mills,et al.  Designing Usable Marine Interfaces: Some Issues and Constraints , 2005, Journal of Navigation.

[30]  Mica R. Endsley,et al.  Theoretical Underpinnings of Situation Awareness, A Critical Review , 2000 .

[31]  Jean Scholtz,et al.  Evaluation of a human-robot interface: development of a situational awareness methodology , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[32]  Janice Ginny Redish,et al.  Expanding usability testing to evaluate complex systems , 2007 .

[33]  James D. Hollan,et al.  Distributed cognition: toward a new foundation for human-computer interaction research , 2000, TCHI.

[34]  Michael Greer,et al.  Innovation and Collaboration in Product Development: Creating a New Role for Usability Studies in Educational Publishing , 2010 .

[35]  J. Røyrvik,et al.  Towards the Gigantic: Entification and Standardization as Technologies of Control , 2013 .

[36]  Antonio Cordella,et al.  Actor network theory and after: what's new for IS research? , 2003, ECIS.

[37]  Victor Kaptelinin,et al.  Interaction Design Beyond the Product: Creating Technology-Enhanced Activity Spaces , 2011, Hum. Comput. Interact..

[38]  Bonnie Kaplan,et al.  Qualitative Research Methods for Evaluating Computer Information Systems , 2005 .

[39]  Lucy Suchman,et al.  Human-Machine Reconfigurations: Plans and Situated Actions , 2006 .

[40]  Carl Gutwin,et al.  Group task analysis for groupware usability evaluations , 2001, Proceedings Tenth IEEE International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises. WET ICE 2001.

[41]  Mary Beth Rosson,et al.  Usability Engineering: Scenario-based Development of Human-Computer Interaction , 2001 .