Measuring Situational Awareness through Analysis of Communications: A Preliminary Exercise

Abstract : Network centric warfare promises to increase information sharing and allow distribution of decision making. This will improve military effectiveness, but only if the situational awareness (SA) of warfighters is correctly aligned. Modern natural language processing techniques, such as Network Text Analysis (Carley, 1993), are designed to infer the cognitive states of individuals and groups engaged in cognitive collaboration and measure group SA by exploiting data on the information that team members access and generate. An integrated software application, IMAGES, utilizes AutoMap (Diesner & Carley, 2004) as the primary analysis engine to take advantage of the large amounts of communication and report text that naturally occur in collaborative environments. The text generated in the normal course of work is collected and changed into forms that can be compared and analyzed. A comparison of networks based on text from several individuals or groups yields information about the similarity of their respective mental models. Differences among maps may reflect misalignments of SA, which can be remedied by information sharing and targeted communication. An exercise was conducted to assess the potential of NTA as implemented in AutoMap and IMAGES. The results indicate that NTA will allow analysts to effectively assess SA through passive means.

[1]  W. Kintsch.  The role of knowledge in discourse comprehension: a construction-integration model. , 1988, Psychological review.

[2]  Elliot E. Entin,et al.  Adaptive Team Coordination , 1999, Hum. Factors.

[3]  Harald Klein.  Classification of Text Analysis Software , 1997 .

[4]  Steven R. Corman,et al.  Studying Complex Discursive Systems: Centering Resonance Analysis of Communication. , 2002 .

[5]  S. Mohammed,et al.  Team Mental Model: Construct or Metaphor? , 1994 .

[6]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[7]  Kathleen M. Carley.  Smart Agents and Organizations of the Future , 2001 .

[8]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[9]  Roel Popping,et al.  Computer-assisted text analysis , 2000 .

[10]  Kathleen M. Carley,et al.  DyNetML: Interchange Format for Rich Social Network Data , 2004 .

[11]  A P Banks,et al.  Running shared mental models as a distributed cognitive process. , 2000, British journal of psychology.

[12]  Shawn A. Weil,et al.  New Approaches to Overcoming E-Mail Overload , 2004 .

[13]  S. Mohammed,et al.  The Measurement of Team Mental Models: We Have No Shared Schema , 2000 .

[14]  Norman W. Warner,et al.  Collaborative Knowledge in Asynchronous Collaboration (CASC) , 2003 .

[15]  Rocky Ross,et al.  Mental models , 2004, SIGA.

[16]  Nancy J. Cooke,et al.  Measuring Team Knowledge , 2000, Hum. Factors.

[17]  Kathleen M. Carley,et al.  Extracting, Representing, and Analyzing Mental Models , 1992 .

[18]  H. H. Clark,et al.  References in Conversation Between Experts and Novices , 1987 .

[19]  Kathleen M. Carley.  Extracting team mental models through textual analysis , 1997 .

[20]  Kathleen M. Carley,et al.  AutoMap 1.2 : extract, analyze, represent, and compare mental models from texts , 2004 .

[21]  J. Mathieu,et al.  The influence of shared mental models on team process and performance. , 2000, The Journal of applied psychology.

[22]  Kathleen M. Carley.  Dynamic Network Analysis , 2003 .

[23]  W B Stevenson,et al.  Information processing and problem solving: the migration of problems through formal positions and networks of ties. , 1991, Academy of Management journal. Academy of Management.

[24]  Kathleen M. Carley,et al.  ORA: Organization Risk Analyzer , 2004 .

[25]  Roel Popping,et al.  Knowledge Graphs and Network Text Analysis , 2003 .

[26]  John F. Sowa,et al.  Conceptual Structures: Information Processing in Mind and Machine , 1983 .

[27]  Kathleen M. Carley.  Formalizing the Social Expert's Knowledge , 1988 .

[28]  William M. Jones,et al.  Situation Awareness Information Dominance & Information Warfare. , 1997 .

[29]  Thomas Seeger,et al.  Grundlagen der praktischen Information und Dokumentation : ein Handbuch zur Einführung in die fachliche Informationsarbeit , 1996 .

[30]  N. M. Morris,et al.  On Looking into the Black Box: Prospects and Limits in the Search for Mental Models , 1986 .

[31]  Kathleen M. Carley,et al.  A PCANS Model of Structure in Organizations , 1998 .

[32]  Richard E. Hayes,et al.  Power to the Edge: Command, Control in the Information Age , 2003 .

[33]  A. Wirth,et al.  Analyzing shared and team mental models , 2001 .

[34]  R. Popping,et al.  Network Approaches in Text Analysis , 1997 .

[35]  Emilie M. Roth,et al.  Can We Ever Escape from Data Overload? A Cognitive Systems Diagnosis , 1999, Cognition, Technology & Work.

[36]  Michael R. Macedonia,et al.  Power from the Edge , 2005, Computer.

[37]  Kathleen M. Carley.  Coding Choices for Textual Analysis: A Comparison of Content Analysis and Map Analysis , 1993 .

[38]  Norman W. Warner,et al.  The Cognitive Processes Used in Team Collaboration During Asynchronous, Distributed Decision Making , 2004 .

[39]  Jan Kleinnijenhuis,et al.  Reasoning in Economic Discourse: An application of the Network Approach in Economic Discourse , 1995 .

[40]  William B. Rouse,et al.  The role of mental models in team performance in complex systems , 1992, IEEE Trans. Syst. Man Cybern..

[41]  Ronald A. Moore,et al.  Knowledge Engineering for Command and Control Transformation at United States European Command (USEUCOM) , 2003 .

[42]  W. Kintsch,et al.  The role of understanding in solving word problems , 1988, Cognitive Psychology.

[43]  Kathleen M. Carley,et al.  Revealing Social Structure from Texts: Meta-Matrix Text Analysis as a Novel Method for Network Text Analysis , 2005 .