Semantic Interaction: Coupling Cognition and Computation through Usable Interactive Analytics

The success of visual analytics is predicated on the ability of users to interactively explore information. Humans think about their data through interactive visual exploration, including testing hypotheses, exploring anomalies, and other cognitive processes of building understanding from data. The claim that these insights are generated as a result of the interaction led the attendees at the Pacific Northwest National Laboratory (PNNL) workshop on "Semantic Interaction: Coupling Cognition and Computation through Usable Interactive Analytics" to posit that user interaction must play a more central role in visual analytics systems, serving as the method for coupling cognition and computation. The claims and design principles discussed in this workshop report present research directions to advance visual analytics via a user interaction approach called semantic interaction.

[1]  Chris North,et al.  Beyond Control Panels: Direct Manipulation for Visual Analytics , 2013, IEEE Computer Graphics and Applications.

[2]  Alex Endert,et al.  Finding Waldo: Learning about Users from their Interactions , 2014, IEEE Transactions on Visualization and Computer Graphics.

[3]  Chris North,et al.  Semantic interaction for visual text analytics , 2012, CHI.

[4]  Chris North,et al.  Semantic Interaction for Sensemaking: Inferring Analytical Reasoning for Model Steering , 2012, IEEE Transactions on Visualization and Computer Graphics.

[5]  John T. Stasko,et al.  The Science of Interaction , 2009, Inf. Vis..

[6]  William Ribarsky,et al.  Recovering Reasoning Processes from User Interactions , 2009, IEEE Computer Graphics and Applications.

[7]  Chris North,et al.  Observation-level interaction with statistical models for visual analytics , 2011, 2011 IEEE Conference on Visual Analytics Science and Technology (VAST).

[8]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.

[9]  Chris North,et al.  Move to improve: promoting physical navigation to increase user performance with large displays , 2007, CHI.

[10]  Carla E. Brodley,et al.  Dis-function: Learning distance functions interactively , 2012, 2012 IEEE Conference on Visual Analytics Science and Technology (VAST).

[11]  Christopher Collins,et al.  DimpVis: Exploring Time-varying Information Visualizations by Direct Manipulation , 2014, IEEE Transactions on Visualization and Computer Graphics.

[12]  Michelle X. Zhou,et al.  KnowMe and ShareMe: understanding automatically discovered personality traits from social media and user sharing preferences , 2014, CHI.

[13]  Matthias Scheutz,et al.  Brainput: enhancing interactive systems with streaming fnirs brain input , 2012, CHI.

[14]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[15]  Krzysztof Z. Gajos,et al.  Improving the performance of motor-impaired users with automatically-generated, ability-based interfaces , 2008, CHI.