Mental model metrics and team adaptability: A multi-facet multi-method examination

This paper empirically examines the convergent, discriminant, and predictive validity of three team mental model measurement approaches. Specifically, this study measures the similarity (MM-similarity) and quality (MM-quality) facets of team strategyfocused mental models using structural networks, priority rankings, and importance ratings. The convergent and divergent relationships among the three mental model metrics are then examined via a multi-facet multi-method matrix. Finally, the relative utility of each metric for understanding the relationships between team mental models, team adaptability, and decision effectiveness are compared. The study was conducted in a laboratory setting, modeling 56 four-person decision-making teams. Results indicate little convergent and extensive discriminant validity across the three mental model metrics. In addition, only mental models measured using the structural networks metric were found to have predictive validity in relation to team adaptation and performance. The quality and similarity of team structural networks were found to have interactive effects in relation to adaptation such that mental model quality was most strongly related to adaptation for teams with low mental model similarity and unrelated to adaptation for teams with high similarity. In turn, adaptation was critical for team decision effectiveness.

[1]  Gwendolyn E. Campbell,et al.  Measuring teamwork mental models to support training needs assessment, development, and evaluation: two empirical studies† , 2001 .

[2]  S. Mohammed,et al.  Team Mental Model: Construct or Metaphor? , 1994 .

[3]  C. Gibson,et al.  Team Implicit Coordination Processes: A Team Knowledge–Based Approach , 2008 .

[4]  Stephanie C. Payne,et al.  Enhancing Team Mental Model Measurement with Performance Appraisal Practices , 2000 .

[5]  Eduardo Salas,et al.  Planning, Shared Mental Models, and Coordinated Performance: An Empirical Link Is Established , 1999, Hum. Factors.

[6]  Dennis A. Gioia,et al.  Mapping Strategic Thought. , 1992 .

[7]  Roger W. Schvaneveldt,et al.  Pathfinder associative networks: studies in knowledge organization , 1990 .

[8]  M. S. Wogalter,et al.  Application of a mental models approach to MSDS design , 2007 .

[9]  J. Mathieu,et al.  The influence of shared mental models on team process and performance. , 2000, The Journal of applied psychology.

[10]  Kevin C. Stagl,et al.  Understanding team adaptation: a conceptual analysis and model. , 2006, The Journal of applied psychology.

[11]  Janice Langan-Fox,et al.  Team Mental Models: Techniques, Methods, and Analytic Approaches , 2000, Hum. Factors.

[12]  Jessica Mesmer-Magnus,et al.  Measuring Shared Team Mental Models: A Meta-Analysis , 2010 .

[13]  S. Floyd,et al.  The Lack of Consensus About Strategic Consensus: Advancing Theory and Research , 2005 .

[14]  N. M. Morris,et al.  On Looking into the Black Box: Prospects and Limits in the Search for Mental Models , 1986 .

[15]  E. Salas,et al.  Reflections on shared cognition , 2001 .

[16]  S. Mohammed,et al.  The Measurement of Team Mental Models: We Have No Shared Schema , 2000 .

[17]  S. Mohammed,et al.  Metaphor No More: A 15-Year Review of the Team Mental Model Construct , 2010 .

[18]  E. Salas,et al.  Shared mental models in expert team decision making. , 1993 .

[19]  Christian J. Resick,et al.  Team Composition, Cognition, and Effectiveness: Examining Mental Model Similarity and Accuracy , 2010 .

[20]  Tom R. Burns,et al.  The Management of Innovation. , 1963 .

[21]  Randall S. Peterson,et al.  Leading and managing people in the dynamic organization , 2003 .

[22]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[23]  J. Mathieu,et al.  Performance implications of leader briefings and team-interaction training for team adaptation to novel environments. , 2000, The Journal of applied psychology.

[24]  H. P. Sims,et al.  Top management team diversity, group process, and strategic consensus , 1999 .

[25]  Eric Anthony Day,et al.  Relationships among team ability composition, team mental models, and team performance. , 2006, The Journal of applied psychology.

[26]  J. A. Lepine,et al.  Team adaptation and postchange performance: effects of team composition in terms of members' cognitive ability and personality. , 2003, The Journal of applied psychology.

[27]  Stephen M. Fiore,et al.  Development of Shared Mental Models for Submarine Officers , 2004 .

[28]  C. Burke,et al.  The impact of cross-training on team effectiveness. , 2002, The Journal of applied psychology.

[29]  Ajay Mehra,et al.  Top Management-Team Diversity and Firm Performance: Examining the Role of Cognitions , 2000 .

[30]  J. Mathieu,et al.  Scaling the quality of teammates' mental models: equifinality and normative comparisons , 2005 .

[31]  Greg Kramer.  SimCity 4: Deluxe Edition , 2003 .

[32]  Kimberly A. Smith-Jentsch,et al.  Measuring team-related cognition: The devil is in the details. , 2008 .

[33]  James L. Szalma,et al.  The Vigilance Decrement Reflects Limitations in Effortful Attention, Not Mindlessness , 2003, Hum. Factors.

[34]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[35]  Lisette Roman,et al.  Naval Submarine Medical Research Laboratory , 2011 .

[36]  Eduardo Salas,et al.  Guided Team Self-Correction , 2008 .

[37]  Joan R. Rentsch,et al.  Cognitions in organizations and teams: What is the meaning of cognitive similarity? , 2008 .

[38]  Leslie A. DeChurch,et al.  The cognitive underpinnings of effective teamwork: a meta-analysis. , 2010, The Journal of applied psychology.

[39]  Eduardo Salas,et al.  Team Effectiveness in Complex Organizations: Cross-Disciplinary Perspectives and Approaches , 2008 .