Shared Mental Model Processing in Visualization Technologies: A Review of Fundamental Concepts and a Guide to Future Research in Human-Computer Interaction

This paper presents a review of fundamental concepts behind the shared mental model and its processes. Shared mental model has two properties which are similarity and accuracy where both of these properties have different emphasis. Types of shared mental model refers to four (4) different ways on what type of cognitive process is being shared in team, which includes task-specific knowledge, task-related knowledge, knowledge of teammates and attitude or beliefs. These four (4) types of shared mental model are grouped into two (2) major content domains, i.e. task-work and team-work. It further describe the aspects of shared mental model on how cognitive process is being shared, includes shared vs. overlapping, similar vs. identical, compatible vs. complimentary and distributed. Shared mental model has to be evaluated using three (3) aspects of characteristics in order to show its operationalization: elicitation method, structure representation, and representation of emergence. A specific evaluation technique called cognitive task analysis that focuses on the analysis of difficulties in cognitive structures is introduced in evaluating shared mental model. This paper also discusses Collaborative Visualisation as technological approach in shared mental model, which includes the benefit of user participation in the aspects of joining or leaving, floor control, privacy and global view. Specific areas on big data, visual analytics, multimedia interface, mobility, disability, awareness and learning analytics that can benefit from the shared mental model approach is discussed.

[1]  Hans Hagen,et al.  Collaborative visualization: Definition, challenges, and research agenda , 2011, Inf. Vis..

[2]  S. Mohammed,et al.  The Measurement of Team Mental Models: We Have No Shared Schema , 2000 .

[3]  Fred Popowich,et al.  Mixed-Initiative for Big Data: The Intersection of Human + Visual Analytics + Prediction , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[4]  Christoph Lattemann,et al.  Shared Mental Models in Creative Virtual Teamwork , 2017, HICSS.

[5]  Paul Craig.  Interactive animated mobile information visualisation , 2015, SIGGRAPH Asia Mobile Graphics and Interactive Applications.

[6]  Nancy Staggers,et al.  Mental Models: Concepts for Human-Computer Interaction Research , 1993, Int. J. Man Mach. Stud..

[7]  Richard I. Cook,et al.  Using cognitive artifacts to understand distributed cognition , 2004, IEEE Trans. Syst. Man Cybern. Part A.

[8]  Xin Huang,et al.  The Mobile Tree Browser: A Space Filling Information Visualization for Browsing Labelled Hierarchies on Mobile Devices , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[9]  Valerie J. Shute,et al.  State-of-the-art review of cognitive task analysis techniques , 2000 .

[10]  Gary Klein,et al.  Working Minds: A Practitioner's Guide to Cognitive Task Analysis , 2006 .

[11]  Gavriel Salvendy,et al.  The cognitive task analysis methods for job and task design: review and reappraisal , 2004, Behav. Inf. Technol..

[12]  John Whittington,et al.  SBAR: a shared mental model for improving communication between clinicians. , 2006, Joint Commission journal on quality and patient safety.

[13]  Yu Liu,et al.  A Vision for Pervasive Information Visualisation to Support Passenger Navigation in Public Metro Networks , 2019, 2019 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[14]  Aleš Ruda,et al.  Cartographic visualization of outputs for spatial decision-making in regional development , 2015 .

[15]  Carlos T. Formoso,et al.  Model for Devising Visual Management Systems on Construction Sites , 2019, Journal of Construction Engineering and Management.

[16]  Xavier Ochoa,et al.  Towards a visual guide for communicating uncertainty in Visual Analytics , 2019, J. Comput. Lang..

[17]  Siti Salwah Salim,et al.  Social-based versus shared situation awareness-based approaches to the understanding of team cognitive research in HCI , 2014, 2014 3rd International Conference on User Science and Engineering (i-USEr).

[18]  Shiyao Zhang,et al.  Pervasive Information Visualization: Toward an Information Visualization Design Methodology for Multi-device Co-located Synchronous Collaboration , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[19]  Feng Wei,et al.  An Optimization to CHARM Algorithm for Mining Frequent Closed Itemsets , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[20]  Christian J. Resick,et al.  Team Composition, Cognition, and Effectiveness: Examining Mental Model Similarity and Accuracy , 2010 .

[21]  Nancy J. Cooke,et al.  On Teams, Teamwork, and Team Performance: Discoveries and Developments , 2008, Hum. Factors.

[22]  Ken Brodlie,et al.  Distributed and Collaborative Visualization , 2004, Comput. Graph. Forum.

[23]  Deborah A. Middleton.  Seeking Cognitive Convergence: Small Group Collaborative Visualization in the Library Learning Commons , 2019 .

[24]  Nancy J. Cooke,et al.  Varieties of knowledge elicitation techniques , 1994, Int. J. Hum. Comput. Stud..

[25]  Sethuraman Panchanathan,et al.  Enriching social situational awareness in remote interactions: insights and inspirations from disability focused research , 2010, ACM Multimedia.

[26]  Elliot E. Entin,et al.  Assessing Team Situation Awareness in Simulated Military Missions , 2000 .

[27]  Michael J. McCloskey,et al.  Cognitive Requirements for Small Unit Leaders in Military Operations in Urban Terrain , 1998 .

[28]  E. Salas,et al.  Reflections on shared cognition , 2001 .

[29]  Menno-Jan Kraak,et al.  Enabling collaborative GeoVisual analytics: Systems, techniques, and research challenges , 2018, Trans. GIS.

[30]  Daniel D. Suthers,et al.  Collaborative Knowledge Construction through Shared Representations , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[31]  John C. Nesbit,et al.  Dashboards for Computer-Supported Collaborative Learning , 2020, Machine Learning Paradigms.

[32]  J. Mathieu,et al.  The influence of shared mental models on team process and performance. , 2000, The Journal of applied psychology.

[33]  Samer Faraj,et al.  What whiteboards in a trauma center operating suite can teach us about emergency department communication. , 2007, Annals of emergency medicine.

[34]  Gary Klein,et al.  4. Some guidelines for conducting a cognitive task analysis , 2001 .

[35]  S. Mohammed,et al.  Mental models in design teams: a valid approach to performance in design collaboration? , 2007 .

[36]  Valerie L. Shalin,et al.  Cognitive task analysis , 2000 .

[37]  G. Goldschmidt.  To see eye to eye: the role of visual representations in building shared mental models in design teams , 2007 .

[38]  Johannes Wacker,et al.  Interactions of team mental models and monitoring behaviors predict team performance in simulated anesthesia inductions. , 2011, Journal of experimental psychology. Applied.

[39]  Guy H. Walker,et al.  Human Factors Methods: A Practical Guide for Engineering and Design , 2012 .

[40]  S. Mohammed,et al.  Metaphor No More: A 15-Year Review of the Team Mental Model Construct , 2010 .

[41]  Niklas Elmqvist,et al.  Branch-explore-merge: facilitating real-time revision control in collaborative visual exploration , 2012, ITS.

[42]  Willemien Visser,et al.  The Cognitive Artifacts of Designing , 2006 .

[43]  S. Payne.  MENTAL MODELS IN HUMAN-COMPUTER INTERACTION , 2007 .

[44]  Gerhard Fischer,et al.  Transcending the individual human mind—creating shared understanding through collaborative design , 2000, TCHI.

[45]  Sharon L. Oviatt,et al.  Perceptual user interfaces: multimodal interfaces that process what comes naturally , 2000, CACM.

[46]  Wing Bun Lee,et al.  A study of the similarity in mental models and team performance , 2010 .

[47]  Sharon L. Oviatt,et al.  Taming recognition errors with a multimodal interface , 2000, CACM.

[48]  L. Thompson,et al.  Socially Shared Cognition, Affect, and Behavior: A Review and Integration , 1999, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[49]  Yu Liu,et al.  Coordinating User Selections in Collaborative Smart-Phone Large-Display Multi-device Environments , 2018, CDVE.

[50]  Mica R. Endsley,et al.  Situation Awareness Oriented Design: From User's Cognitive Requirements to Creating Effective Supporting Technologies , 2003 .

[51]  Siti Salwah Salim,et al.  A systematic review of shared visualisation to achieve common ground , 2015, J. Vis. Lang. Comput..

[52]  C. Burke,et al.  The impact of cross-training on team effectiveness. , 2002, The Journal of applied psychology.

[53]  Nick Sevdalis,et al.  Teamwork in the operating theatre: cohesion or confusion? , 2006, Journal of evaluation in clinical practice.

[54]  David W. Walker,et al.  Collaborative visualization: a review and taxonomy , 2005, Ninth IEEE International Symposium on Distributed Simulation and Real-Time Applications.

[55]  Michael D. McNeese.  How video informs cognitive systems engineering: making experience count , 2004, Cognition, Technology & Work.

[56]  Leslie A. DeChurch,et al.  The cognitive underpinnings of effective teamwork: a meta-analysis. , 2010, The Journal of applied psychology.

[57]  Salman Z. Alharthi.  Forming, Measuring, Optimizing, Human Capital with Enhancement Concerning Dynamic Capability: Update on Theoretical Framework , 2016 .