How video informs cognitive systems engineering: making experience count

Cognitive systems engineering (CSE) requires perspectives that demand users and teams be understood in relation to the context they act in. Situated problems that emerge in the context of use are frequently distributed across people, information and artefacts (distributed cognition) that characterise the temporal emergence of activities. Current tools and capabilities within the digital video revolution make it possible to actively capture, record, explore and analyse video streams to assist in understanding distributed cognition and the implications it has for envisioned designs. Yet, there are research issues and questions to address. The Living Laboratory Framework is described and posited as one way to systematically integrate video into CSE to enhance the reliability and validity of design artefacts in practice. Case examples (Jasper and NeoCITIES simulations) are explored to provide specific ways of understanding different kinds of video representation and analysis within CSE.

[1]  David Woods,et al.  Commentary Designs are hypotheses about how artifacts shape cognition and collaboration , 1998 .

[2]  Lauren B. Resnick,et al.  Shared cognition: Thinking as social practice , 1991, Perspectives on socially shared cognition.

[3]  John D. Bransford,et al.  The Jasper Project: Lessons in Curriculum, Instruction, Assessment, and Professional Development , 1997 .

[4]  Michael D. McNeese,et al.  Collaborative Design Technology: Tools and Techniques for Improving Collaborative Design. , 1995 .

[5]  Michael D. McNeese,et al.  Testing the Effects of Team Processes on Team Member Schema Similarity and Team Performance: Examination of the Team Member Schema Similarity Model , 1998 .

[6]  Gavan Lintern,et al.  Cognitive work analysis for air defense applications in Australia , 2002 .

[7]  Lucy A. Suchman,et al.  A framework for studying research collaboration , 1986, CSCW '86.

[8]  K. J. Vicente,et al.  Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work , 1999 .

[9]  Michael D. McNeese,et al.  Qualitative modeling of complex systems for cognitive engineering , 1999, Defense, Security, and Sensing.

[10]  G. Stasser,et al.  Information salience and the discovery of hidden profiles by decision-making groups: A “thought experiment”☆ , 1992 .

[11]  Michael D. McNeese,et al.  Using Fuzzy Cognitive Maps to Define the Search Space in Problem Solving , 1997, HCI.

[12]  Michael D. McNeese,et al.  Group Interfaces: A Profile and a Prototype. , 1995 .

[13]  Lucy Suchman.  Plans and situated actions: the problem of human-machine communication , 1987 .

[14]  Charles E Kimble,et al.  Emergent Leadership and Team Effectiveness on a Team Resource Allocation Task , 1987 .

[15]  A.R. Wellens,et al.  Effects of telecommunication media upon information sharing and team performance: some theoretical and empirical observations , 1989, IEEE Aerospace and Electronic Systems Magazine.

[16]  Michael D. McNeese,et al.  Distributed Cognition in Shared Information Spaces , 2002 .

[17]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[18]  Erik Hollnagel,et al.  Cognitive Systems Engineering: New wine in new bottles , 1999, Int. J. Hum. Comput. Stud..

[19]  Michael D. McNeese,et al.  What is Command and Control Coming to? Examining Socio-Cognitive Mediators That Expand the Common Ground of Teamwork , 1999 .

[20]  Michael D. McNeese,et al.  Capturing multiple perspectives: a user-centered approach to knowledge and design acquisition , 1993 .

[21]  Penelope M. Sanderson,et al.  Handling complex real-world data with two cognitive engineering tools: COGENT and MacSHAPA , 1994 .

[22]  J. Long,et al.  A conception of the cognitive engineering design problem , 1998 .

[23]  John D. Bransford,et al.  Teaching thinking and problem solving: Research foundations. , 1986 .

[24]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[25]  Michael D. McNeese,et al.  AKADAM: Eliciting user knowledge to support participatory ergonomics , 1995 .

[26]  Michael D. McNeese,et al.  Advancing Socio-Technical Systems Design Via the Living Laboratory , 2000 .

[27]  Michael D. McNeese,et al.  A Framework for Cognitive Field Studies , 1999 .

[28]  John Long,et al.  Target Paper Conception of the cognitive engineering design problem , 1998 .

[29]  Tom Johnston,et al.  MacSHAPA and the enterprise of exploratory sequential data analysis (ESDA) , 1994, Int. J. Hum. Comput. Stud..

[30]  Kjeld Schmidt.  Cooperative Work: Towards a Conceptual Foundation for CSCW Systems Design , 1997, HCI.

[31]  M. E. Gomes,et al.  A human factors evaluation using tools for automated knowledge engineering , 1993, Proceedings of the IEEE 1993 National Aerospace and Electronics Conference-NAECON 1993.