Information fusion in practice: A distributed cognition perspective on the active role of users

Traditionally, the focus of most information fusion research has been on computational aspects, as illustrated by, for example, different versions of the JDL data fusion model. Consequently, the human user has mainly been conceived as a relatively passive recipient of fused information. However, the importance of understanding the active role of human information processing in information fusion is gaining increasing recognition, as also reflected in discussions of a ''level 5'' in the JDL model. This paper presents a case study of the interaction between human and machine information processing in a maritime surveillance control room. A detailed analysis of cognitive processes and information flows involved in identifying and tracking moving vessels illustrates how machines and human operators collaboratively perform fusion in a highly distributed fashion. The theoretical framework of distributed cognition provides an alternative or complementary way of analysing information fusion systems/processes that more clearly reveals the actual complexities of the interaction between human and machine information processing in practice.

[1]  Erik Blasch,et al.  JDL level 5 fusion model: user refinement issues and applications in group tracking , 2002, SPIE Defense + Commercial Sensing.

[2]  CHRISTINE A. HALVERSON,et al.  Activity Theory and Distributed Cognition: Or What Does CSCW Need to DO with Theories? , 2002, Computer Supported Cooperative Work (CSCW).

[3]  James Llinas,et al.  Handbook of Multisensor Data Fusion : Theory and Practice, Second Edition , 2008 .

[4]  Gavan Lintern,et al.  The role of cognitive systems engineering in the systems engineering design process , 2010, Syst. Eng..

[5]  Tom Ziemke,et al.  Formalising Distributed Cognition into a Tool to Capture Information Fusion Processes , 2008 .

[6]  Erik Blasch,et al.  Issues and Challenges in Situation Assessment (Level 2 Fusion) , 2006, J. Adv. Inf. Fusion.

[7]  Alan N. Steinberg,et al.  A Systems Engineering Approach for Implementing Data Fusion Systems , 2001 .

[8]  Erik Blasch,et al.  Level 5 (User Refinement) issues supporting Information Fusion Management , 2006, 2006 9th International Conference on Information Fusion.

[9]  Tom Ziemke,et al.  Rethinking Level 5: Distributed Cognition and Information Fusion , 2006, 2006 9th International Conference on Information Fusion.

[10]  Edwin Hutchins,et al.  How a Cockpit Remembers Its Speeds , 1995, Cogn. Sci..

[11]  Mary Jane Hall,et al.  Removing the HCI Bottleneck: How the Human-Computer Interface (HCI) Affects the Performance of Data Fusion Systems* , 2001 .

[12]  Muhammad F. Walji,et al.  Human-centered design of a distributed knowledge management system , 2005, J. Biomed. Informatics.

[13]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[14]  Joel U. Eden.  Distributed cognitive walkthrough (DCW): a walkthrough-style usability evaluation method based on theories of distributed cognition , 2007, C&C '07.

[15]  Ramkrishnan V. Tenkasi,et al.  Designing Information Technology to Support Distributed Cognition Ceo Publication G 93-16 (236) Designing Information Technology to Support Distributed Cognition Designing Information Technology to Support Distributed Cognition , 1994 .

[16]  William S. Griffith,et al.  Critique , 1976 .

[17]  D. L. Hall,et al.  Mathematical Techniques in Multisensor Data Fusion , 1992 .

[18]  Bob Fields,et al.  ANALYSING HUMAN-COMPUTER INTERACTION AS DISTRIBUTED COGNITION: THE RESOURCES MODEL , 1999 .

[19]  Gary Klein,et al.  The role of cognitive systems engineering in the systems engineering design process , 2010 .

[20]  Tim Grant,et al.  Unifying planning and control using an OODA-based architecture , 2005 .

[21]  Michael Hinman,et al.  Building a Framework for Situation Awareness , 2004 .

[22]  Mica R. Endsley,et al.  Theoretical Underpinnings of Situation Awareness, A Critical Review , 2000 .

[23]  Mark Perry,et al.  Process, representation and taskworld. Distributed cognition and the organisation of information , 1999 .

[24]  Guy H. Walker,et al.  Human Factors Methods: A Practical Guide for Engineering and Design , 2012 .

[25]  David B. Kaber,et al.  Cognitive Engineering and Decision Making: An Overview and Future Course , 2007 .

[26]  Jason Scholz,et al.  A Dialectic for Network Centric Warfare , 2005 .

[27]  James D. Hollan,et al.  Distributed cognition: toward a new foundation for human-computer interaction research , 2000, TCHI.

[28]  John Millar Carroll.  HCI Models, Theories, and Frameworks: Toward a Multidisciplinary Science , 2003 .

[29]  Brian Hazlehurst,et al.  Distributed cognition in the heart room: How situation awareness arises from coordinated communications during cardiac surgery , 2007, J. Biomed. Informatics.

[30]  Johan F. Hoorn,et al.  Distributed cognition , 2005, Cognition, Technology & Work.

[31]  Josep Maria Monguet,et al.  MAIA: a methodology for applying Distributed Cognition to the management of learning systems. , 2007 .

[32]  Alan N. Steinberg,et al.  Revisions to the JDL data fusion model , 1999, Defense, Security, and Sensing.

[33]  Berndt Brehmer,et al.  The Dynamic OODA Loop : Amalgamating Boyd ’ s OODA Loop and the Cybernetic Approach to Command and Control ASSESSMENT , TOOLS AND METRICS , 2005 .

[34]  Ann Blandford,et al.  DiCoT: A Methodology for Applying Distributed Cognition to the Design of Teamworking Systems , 2005, DSV-IS.

[35]  Richard Breton,et al.  The M-OODA: A Model Incorporating Control Functions And Teamwork In The OODA Loop. , 2004 .

[36]  Dale A. Lambert,et al.  A blueprint for higher-level fusion systems , 2009, Inf. Fusion.

[37]  P. Martí,et al.  The Choice of the Unit of Analysis for Modelling Real Work Settings , 2000, Cognition, Technology & Work.

[38]  Brian Hazlehurst,et al.  Distributed cognition: An alternative model of cognition for medical informatics , 2008, Int. J. Medical Informatics.

[39]  Edward Allen Smith.  Effects Based Operations: Applying Network Centric Warfare in Peace, Crisis, and War , 2002 .

[40]  Bonnie A. Nardi,et al.  Coda and Response to Christine Halverson , 2002, Computer Supported Cooperative Work (CSCW).

[41]  Catherine M. Burns,et al.  Lessons From a Comparison of Work Domain Models: Representational Choices and Their Implications , 2004, Hum. Factors.

[42]  Jean Hartley,et al.  Case study research , 2004 .

[43]  Éloi Bossé,et al.  Modeling and simulation in support of the design of a data fusion system , 2000, Inf. Fusion.

[44]  M. Agar.  The professional stranger : an informal introduction to ethnography , 1981 .

[45]  Christine Halverson,et al.  Organizational Memory as Objects, Processes, and Trajectories: An Examination of Organizational Memory in Use , 2004, Computer Supported Cooperative Work (CSCW).

[46]  R. E. Fields,et al.  Air Traffic Control as a Distributed Cognitive System : a study of external representations , 1998 .

[47]  Odile Papini,et al.  Information Fusion , 2014, Computer Vision, A Reference Guide.

[48]  Erik Hollnagel,et al.  Joint Cognitive Systems: Foundations of Cognitive Systems Engineering , 2005 .

[49]  Ann M. Bisantz,et al.  On the Integration of Cognitive Work Analysis within a Multisource Information Fusion Development Methodology , 2004 .

[50]  Stephanie M. Wilson,et al.  A method for determining information flow breakdown in clinical systems , 2007, Int. J. Medical Informatics.

[51]  David J Bryant,et al.  Critique, Explore, Compare, and Adapt (CECA): A New Model for Command Decision Making , 2003 .

[52]  Yvonne Rogers,et al.  NEW THEORETICAL APPROACHES FOR HCI , 2004 .

[53]  James Llinas,et al.  Revisiting the JDL Data Fusion Model II , 2004 .

[54]  Tom Ziemke,et al.  Extracting rules from expert operators to support situation awareness in maritime surveillance , 2008, 2008 11th International Conference on Information Fusion.

[55]  Hubert L. Dreyfus,et al.  What computers still can't do - a critique of artificial reason , 1992 .

[56]  M. Patton.  Qualitative research & evaluation methods , 2002 .

[57]  Jean Roy,et al.  Concepts, Models, and Tools for Information Fusion , 2007 .

[58]  Tom Ziemke,et al.  Implications of a Weickian perspective on decision making for information fusion research and practice , 2007, 2007 10th International Conference on Information Fusion.

[59]  S. Fagerhaugh,et al.  Participant Observation , 1979 .

[60]  James Llinas,et al.  Handbook of Multisensor Data Fusion , 2001 .

[61]  Richard I. Cook,et al.  Using cognitive artifacts to understand distributed cognition , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[62]  K. DeWalt,et al.  Participant Observation: A Guide for Fieldworkers , 2001 .