Building Multiple Coordinated Spaces for Effective Immersive Analytics through Distributed Cognition

Multiple Coordinated Views (MCV) has been widely used in visualization. This work explores Multiple Coordinated Spaces (MCS), a 3D version of MCV, in order to integrate various 2D displays in a large physical environment as a unified analysis workspace. Built upon the rich background of distributed and embodied cognition, MCS supports interactive analysis in a connected, distributed set of subspaces. For MCS, we have developed visualization and interactive techniques for coordinating augmented reality devices together with classical WIMP GUIs systems. We also demonstrate the usages of MCS using a multivariate, geo-spatial biodiversity application. The major advantage of MCS is a flexible coordination framework for creating new immersive analytics methods by mixing visualizations from different devices, and mixing physical and virtual operations from different environments.

[1]  Daniel Vogel,et al.  Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users , 2004, UIST '04.

[2]  E. Hutchins.  Cognition in the wild , 1995 .

[3]  M. Sheelagh T. Carpendale,et al.  VisLink: Revealing Relationships Amongst Visualizations , 2007, IEEE Transactions on Visualization and Computer Graphics.

[4]  Maximilian Scherr,et al.  Multiple and Coordinated Views in Information Visualization , 2009 .

[5]  Niklas Elmqvist,et al.  Munin: A Peer-to-Peer Middleware for Ubiquitous Analytics and Visualization Spaces , 2015, IEEE Transactions on Visualization and Computer Graphics.

[6]  David Kirsh,et al.  The Intelligent Use of Space , 1995, Artif. Intell..

[7]  Chris North,et al.  Move to improve: promoting physical navigation to increase user performance with large displays , 2007, CHI.

[8]  Chris North,et al.  Effects of tiled high-resolution display on basic visualization and navigation tasks , 2005, CHI Extended Abstracts.

[9]  Bob Fields,et al.  Developing a Model of Distributed Sensemaking: A Case Study of Military Analysis , 2015, Informatics.

[10]  James D. Hollan,et al.  Distributed cognition: toward a new foundation for human-computer interaction research , 2000, TCHI.

[11]  Mikkel Rønne Jakobsen,et al.  Information Visualization and Proxemics: Design Opportunities and Empirical Findings , 2013, IEEE Transactions on Visualization and Computer Graphics.

[12]  Yvonne Rogers,et al.  Distributed cognition: an alternative framework for analysing and explaining collaborative working , 1994, J. Inf. Technol..

[13]  Matthias Klapperstück,et al.  Immersive Analytics , 2015, 2015 Big Data Visual Analytics (BDVA).

[14]  Tobias Höllerer,et al.  Stereoscopic Highlighting: 2D Graph Visualization on Stereo Displays , 2011, IEEE Transactions on Visualization and Computer Graphics.

[15]  J.C. Roberts,et al.  State of the Art: Coordinated & Multiple Views in Exploratory Visualization , 2007, Fifth International Conference on Coordinated and Multiple Views in Exploratory Visualization (CMV 2007).

[16]  M. Sheelagh T. Carpendale,et al.  Beyond Mouse and Keyboard: Expanding Design Considerations for Information Visualization Interactions , 2012, IEEE Transactions on Visualization and Computer Graphics.

[17]  Bianchi Serique Meiguins,et al.  WebPrisma: An Interactive Web-Based Tool for Exploratory Visualization Using Multiple Coordinated Views , 2009, 2009 13th International Conference Information Visualisation.

[18]  Fabien Picarougne,et al.  Beyond the classical monoscopic 3D in graph analytics: An experimental study of the impact of stereoscopy , 2014, 2014 IEEE VIS International Workshop on 3DVis (3DVis).

[19]  Peter J. Rodgers,et al.  A Model and Software System for Coordinated and Multiple Views in Exploratory Visualization , 2003, Inf. Vis..

[20]  William Ribarsky,et al.  How Visualization Layout Relates to Locus of Control and Other Personality Factors , 2013, IEEE Transactions on Visualization and Computer Graphics.

[21]  Mikkel Rønne Jakobsen,et al.  An exploratory study of how abundant display space may support data analysis , 2012, NordiCHI.

[22]  Jonathan C. Roberts,et al.  On encouraging multiple views for visualization , 1998, Proceedings. 1998 IEEE Conference on Information Visualization. An International Conference on Computer Visualization and Graphics (Cat. No.98TB100246).

[23]  Colin Ware,et al.  Visualizing graphs in three dimensions , 2008, TAP.

[24]  Paul Dourish,et al.  Where the action is , 2001 .

[25]  Chris North,et al.  A Taxonomy of Multiple Window Coordinations , 1998 .

[26]  Marina Basu.  The Embodied Mind: Cognitive Science and Human Experience , 2004 .

[27]  Bruce H. Thomas,et al.  Immersive Collaborative Analysis of Network Connectivity: CAVE-style or Head-Mounted Display? , 2017, IEEE Transactions on Visualization and Computer Graphics.

[28]  G. Lakoff,et al.  Where mathematics comes from : how the embodied mind brings mathematics into being , 2002 .

[29]  J. Zlatev.  What's in a schema? Bodily mimesis and the grounding of language , 2005 .

[30]  Kwan-Liu Ma,et al.  A Study of Layout, Rendering, and Interaction Methods for Immersive Graph Visualization , 2016, IEEE Transactions on Visualization and Computer Graphics.

[31]  Bianchi Serique Meiguins,et al.  Coordinated and Multiple Views in Augmented Reality Environment , 2007, 2007 11th International Conference Information Visualization (IV '07).

[32]  Raimund Dachselt,et al.  GraSp: Combining Spatially‐aware Mobile Devices and a Display Wall for Graph Visualization and Interaction , 2017, Comput. Graph. Forum.

[33]  H. Levkowitz,et al.  Coordinated views to assist exploration of spatio-temporal data: a case study , 2004, Proceedings. Second International Conference on Coordinated and Multiple Views in Exploratory Visualization, 2004..

[34]  Niklas Elmqvist,et al.  Visfer: Camera-based visual data transfer for cross-device visualization , 2019, Inf. Vis..

[35]  Analyst's Workspace: An embodied sensemaking environment for large, high-resolution displays , 2012, 2012 IEEE Conference on Visual Analytics Science and Technology (VAST).

[36]  Christopher Andrews,et al.  Space to think: large high-resolution displays for sensemaking , 2010, CHI.

[37]  N. Andrienko,et al.  Coordinated Multiple Views: a Critical View , 2007, Fifth International Conference on Coordinated and Multiple Views in Exploratory Visualization (CMV 2007).

[38]  Bianchi Serique Meiguins,et al.  An Information Visualization Tool with Multiple Coordinated Views for Network Traffic Analysis , 2008, 2008 12th International Conference Information Visualisation.

[39]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[40]  G. Lakoff,et al.  Conceptual Metaphor in Everyday Language , 1980, Shaping Entrepreneurship Research.

[41]  John T. Stasko,et al.  Mental Models, Visual Reasoning and Interaction in Information Visualization: A Top-down Perspective , 2010, IEEE Transactions on Visualization and Computer Graphics.

[42]  John T. Stasko,et al.  Distributed Cognition as a Theoretical Framework for Information Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[43]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[44]  Bianchi Serique Meiguins,et al.  Using Augmented Reality for Multidimensional Data Visualization , 2006, Tenth International Conference on Information Visualisation (IV'06).

[45]  Allison Woodruff,et al.  Guidelines for using multiple views in information visualization , 2000, AVI '00.

[46]  Jiajie Zhang,et al.  Representations in Distributed Cognitive Tasks , 1994, Cogn. Sci..

[47]  Frank M. Shipman,et al.  Spatial hypertext: an alternative to navigational and semantic links , 1999, CSUR.

[48]  Dieter Schmalstieg,et al.  Collaborative distributed cognition using a seamless desktop infrastructure , 2016, 2016 Workshop on Immersive Analytics (IA).

[49]  Celestine A. Ntuen.  Cognitive Constructs and the Sensemaking Process , 2006 .