Semantic Interaction for Sensemaking: Inferring Analytical Reasoning for Model Steering

Visual analytic tools aim to support the cognitively demanding task of sensemaking. Their success often depends on the ability to leverage capabilities of mathematical models, visualization, and human intuition through flexible, usable, and expressive interactions. Spatially clustering data is one effective metaphor for users to explore similarity and relationships between information, adjusting the weighting of dimensions or characteristics of the dataset to observe the change in the spatial layout. Semantic interaction is an approach to user interaction in such spatializations that couples these parametric modifications of the clustering model with users' analytic operations on the data (e.g., direct document movement in the spatialization, highlighting text, search, etc.). In this paper, we present results of a user study exploring the ability of semantic interaction in a visual analytic prototype, ForceSPIRE, to support sensemaking. We found that semantic interaction captures the analytical reasoning of the user through keyword weighting, and aids the user in co-creating a spatialization based on the user's reasoning and intuition.

[1]  Alexander W. Skaburskis,et al.  The Sandbox for analysis: concepts and methods , 2006, CHI.

[2]  Richards J. Heuer,et al.  Psychology of Intelligence Analysis , 1999 .

[3]  Analyst's Workspace: An embodied sensemaking environment for large, high-resolution displays , 2012, 2012 IEEE Conference on Visual Analytics Science and Technology (VAST).

[4]  John T. Stasko,et al.  Dust & Magnet: Multivariate Information Visualization Using a Magnet Metaphor , 2005, Inf. Vis..

[5]  Christopher Andrews,et al.  Space to think: large high-resolution displays for sensemaking , 2010, CHI.

[6]  Chris North,et al.  Semantic interaction for visual text analytics , 2012, CHI.

[7]  Frank M. Shipman,et al.  Formality Considered Harmful: Experiences, Emerging Themes, and Directions on the Use of Formal Representations in Interactive Systems , 1999, Computer Supported Cooperative Work (CSCW).

[8]  Ye Zhao,et al.  STREAMIT: Dynamic visualization and interactive exploration of text streams , 2011, 2011 IEEE Pacific Visualization Symposium.

[9]  Stuart K. Card,et al.  Information foraging in information access environments , 1995, CHI '95.

[10]  William Ribarsky,et al.  Building and Applying a Human Cognition Model for Visual Analytics , 2009, Inf. Vis..

[11]  Chris North,et al.  Shaping the Display of the Future: The Effects of Display Size and Curvature on User Performance and Insights , 2009, Hum. Comput. Interact..

[12]  Christopher Andrews,et al.  Information visualization on large, high-resolution displays: Issues, challenges, and opportunities , 2011, Inf. Vis..

[13]  John T. Stasko,et al.  Jigsaw: Supporting Investigative Analysis through Interactive Visualization , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[14]  Frank M. Shipman,et al.  Emergent Structure in Analytic Workspaces: Design and Use of the Visual Knowledge Builder , 2001, INTERACT.

[15]  Chris North,et al.  The semantics of clustering: analysis of user-generated spatializations of text documents , 2012, AVI.

[16]  James J. Thomas,et al.  Visualizing the non-visual: spatial analysis and interaction with information from text documents , 1995, Proceedings of Visualization 1995 Conference.

[17]  André Skupin,et al.  A cartographic approach to visualizing conference abstracts , 2002 .

[18]  Christopher Andrews Space to Think: Sensemaking and Large, High-Resolution Displays , 2011 .

[19]  Edward M. Reingold,et al.  Graph drawing by force‐directed placement , 1991, Softw. Pract. Exp..

[20]  John T. Stasko,et al.  The Science of Interaction , 2009, Inf. Vis..

[21]  William Ribarsky,et al.  Recovering Reasoning Processes from User Interactions , 2009, IEEE Computer Graphics and Applications.

[22]  Robert R. Korfhage,et al.  Visualization of a Document Collection: The VIBE System , 1993, Inf. Process. Manag..

[23]  Augustin J. Calapristi,et al.  Analytic Steering: Inserting Context into the Information Dialog , 2011 .

[24]  Niklas Elmqvist,et al.  Fluid interaction for information visualization , 2011, Inf. Vis..

[25]  Chris North,et al.  Unifying the Sensemaking Loop with Semantic Interaction , 2011 .

[26]  John T. Stasko,et al.  Characterizing the intelligence analysis process: Informing visual analytics design through a longitudinal field study , 2011, 2011 IEEE Conference on Visual Analytics Science and Technology (VAST).

[27]  Chris North,et al.  Move to improve: promoting physical navigation to increase user performance with large displays , 2007, CHI.

[28]  Frank M. Shipman,et al.  VIKI: spatial hypertext supporting emergent structure , 1994, ECHT '94.

[29]  Christopher Andrews,et al.  ChairMouse: leveraging natural chair rotation for cursor navigation on large, high-resolution displays , 2011, CHI Extended Abstracts.

[30]  Christopher Andrews,et al.  Designing large high-resolution display workspaces , 2012, AVI.

[31]  Chris North,et al.  Observation-level interaction with statistical models for visual analytics , 2011, 2011 IEEE Conference on Visual Analytics Science and Technology (VAST).