Markers for enhancing team cognition in complex environments: the power of team performance diagnosis.

Team cognition has been identified as a key component to achieve mission goals in dynamic, team-based, stressful, distributed and multicultural operations. Effective team performance in complex environments requires that team members hold a shared understanding of the task, their equipment, and their teammates. So, many of the simulation-based training (SBT) systems and programs have been designed (partly) to enhance shared/team cognition. However, these simulation systems lack the sufficient robustness in their performance assessment tools or capabilities (if they have any) to allow for a rich and deep understanding of team cognition. Therefore, the purpose of this article is fourfold: I) to present a brief account of team cognition; 2) to develop the concept of performance diagnosis and present SBT as an approach to the performance diagnosis of team cognition; 3) to present a set of illustrative behavioral markers of team cognition; and 4) to explicate how these elements (performance diagnosis, team cognition, and SBT) can be leveraged to increase training effectiveness through the development of performance profiles--a rich, detailed, and informative set of metrics--and cognitive and behavioral indicators or illustrative markers of team cognition. Research needs are discussed in terms of realizing the potential of this approach in operational and embedded training contexts.

[1]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[2]  N. Denzin The research act: A theoretical introduction to sociological methods , 1977 .

[3]  John R. Hayes,et al.  The Complete Problem Solver , 1981 .

[4]  H. P. Sims,et al.  The Thinking Organization: Dynamics of Organizational Social Cognition. , 1988 .

[5]  B. Kanki,et al.  Communication indices of crew coordination. , 1989, Aviation, space, and environmental medicine.

[6]  Eduardo Salas,et al.  Toward a Definition of Teamwork: An Analysis of Critical Team Behaviors , 1989 .

[7]  D Schwartz,et al.  TRAINING FOR SITUATIONAL AWARENESS , 1991 .

[8]  E. Salas,et al.  Toward an understanding of team performance and training. , 1992 .

[9]  G. Klein,et al.  A recognition-primed decision (RPD) model of rapid decision making. , 1993 .

[10]  J. R. Larson,et al.  Groups as problem‐solving units: Toward a new meaning of social cognition , 1993 .

[11]  E. Salas,et al.  Team decision making in complex environments. , 1993 .

[12]  E. Salas,et al.  Shared mental models in expert team decision making. , 1993 .

[13]  Harold F. O'Neil,et al.  Policy and validity prospects for performance-based assessment. , 1993 .

[14]  Eduardo Salas,et al.  TRAINING AND RESEARCH FOR TEAMWORK IN THE MILITARY AIRCREW. , 1993 .

[15]  R. Hall,et al.  Members of great teams think alike: A model of team effectiveness and schema similarity among team members. , 1994 .

[16]  Norman E. Lane,et al.  Improving the Measurement of Team Performance: The TARGETs Methodology , 1994 .

[17]  Kip Smith,et al.  Situational Awareness in Complex Systems , 1994 .

[18]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[19]  Eduardo Salas,et al.  The Measurement of Team Process , 1995, Hum. Factors.

[20]  Eduardo Salas,et al.  Situation Awareness in Team Performance: Implications for Measurement and Training , 1995, Hum. Factors.

[21]  Stellan Ohlsson,et al.  Learning from Performance Errors. , 1996 .

[22]  Verlin B. Hinsz,et al.  The emerging conceptualization of groups as information processors. , 1997, Psychological bulletin.

[23]  Eduardo Salas,et al.  Team Performance Assessment and Measurement: Theory, Methods, and Applications. Series in Applied Psychology. , 1997 .

[24]  E. Salas,et al.  A Framework for Developing Team Performance Measures in Training , 1997 .

[25]  Eduardo Salas,et al.  Analyzing Communication Sequences for Team Training Needs Assessment , 1998, Hum. Factors.

[26]  A. Hollingshead Retrieval processes in transactive memory systems , 1998 .

[27]  R. Arvey,et al.  Performance evaluation in work settings. , 1998, Annual review of psychology.

[28]  Jennifer E. Fowlkes,et al.  Event-based approach to training (EBAT). , 1998 .

[29]  Jennifer E. Fowlkes,et al.  EVENT-BASED APPROACH TO TRAINING , 1998 .

[30]  Mica R. Endsley,et al.  Shared Mental Models and Shared Displays: An Empirical Evaluation of Team Performance , 1999 .

[31]  William R. Howse,et al.  Use and Management of Digital Information by Army Aviation Battalion Battle Staff Members , 1999 .

[32]  Elliot E. Entin,et al.  Adaptive Team Coordination , 1999, Hum. Factors.

[33]  Nancy J. Cooke,et al.  Measuring Team Knowledge , 2000, Hum. Factors.

[34]  J. Mathieu,et al.  The influence of shared mental models on team process and performance. , 2000, The Journal of applied psychology.

[35]  S. Mohammed,et al.  The Measurement of Team Mental Models: We Have No Shared Schema , 2000 .

[36]  S. Kozlowski,et al.  Multilevel Theory, Research, a n d M e t h o d s i n Organizations Foundations, Extensions, and New Directions , 2022 .

[37]  Nancy J. Cooke,et al.  Measuring Team Knowledge During Skill Acquisition of a Complex Task , 2001 .

[38]  E. Salas,et al.  Reflections on shared cognition , 2001 .

[39]  S. Mohammed,et al.  Team mental models in a team knowledge framework: expanding theory and measurement across disciplinary boundaries , 2001 .

[40]  E. Salas,et al.  Taking stock of naturalistic decision making , 2001 .

[41]  Eduardo Salas,et al.  Addressing Limitations of the Measurement of Team Cognition , 2002 .

[42]  Peter W. Foltz,et al.  Some Promising Results of Communication-Based Automatic Measures of Team Cognition , 2002 .

[43]  Peter W. Foltz,et al.  Automated Speech Recognition for Modeling Team Performance , 2003 .

[44]  John R. Austin Transactive memory in organizational groups: the effects of content, consensus, specialization, and accuracy on group performance. , 2003, The Journal of applied psychology.

[45]  Nancy J. Cooke,et al.  Measuring Team Knowledge: A Window to the Cognitive Underpinnings of Team Performance , 2003 .

[46]  Nancy J. Cooke,et al.  Advances in Measuring Team Cognition , 2003 .

[47]  Daniel R. Ilgen,et al.  Backing up behaviors in teams: the role of personality and legitimacy of need. , 2003, The Journal of applied psychology.

[48]  James Ness,et al.  The Science and Simulation of Human Performance , 2004 .

[49]  J. Alberto Espinosa,et al.  Explicit versus implicit coordination mechanisms and task dependencies: One size does not fit all. , 2004 .

[50]  Cleotilde Gonzalez,et al.  Shared Mental Models in Military Command and Control Organizations: Effect of Social Network Distance , 2004 .

[51]  E. Salas,et al.  Team cognition : understanding the factors that drive process and performance , 2004 .

[52]  Eduardo Salas,et al.  Why team cognition? An overview. , 2004 .

[53]  M. Marks,et al.  The Influence of Team Monitoring on Team Processes and Performance , 2004 .

[54]  E. Entin,et al.  Communication overhead: The hidden cost of team cognition. , 2004 .

[55]  E. Salas,et al.  MEASURING TEAM PERFORMANCE: REVIEW OF CURRENT METHODS AND CONSIDERATION OF FUTURE NEEDS , 2004 .

[56]  Stephen M. Fiore,et al.  Process mapping and shared cognition: Teamwork and the development of shared problem models. , 2004 .

[57]  K. R. Milner,et al.  A multiple-goal, multilevel model of feedback effects on the regulation of individual and team performance. , 2004, The Journal of applied psychology.

[58]  Denise Nicholson,et al.  Augmented Cognition Technologies Applied to Training: A Roadmap for the Future , 2005 .

[59]  Paul J. Feltovich,et al.  Common Ground and Coordination in Joint Activity , 2005 .

[60]  Dana E. Sims,et al.  Is there a “Big Five” in Teamwork? , 2005 .

[61]  Barrett S Caldwell Multi-team dynamics and distributed expertise in imission operations. , 2005, Aviation, space, and environmental medicine.

[62]  Applied Measurement: Practical Issues and Challenges. , 2006 .

[63]  Jane Fielding,et al.  Triangulation and integration: processes, claims and implications , 2006 .

[64]  Karel Brookhuis,et al.  Handbook of Human Factors and Ergonomics Methods , 2009 .