The Science of Interaction

There is a growing recognition within the visual analytics community that interaction and inquiry are inextricable. It is through the interactive manipulation of a visual interface–the analytic discourse–that knowledge is constructed, tested, refined and shared. This article reflects on the interaction challenges raised in the visual analytics research and development agenda and further explores the relationship between interaction and cognition. It identifies recent exemplars of visual analytics research that have made substantive progress toward the goals of a true science of interaction, which must include theories and testable premises about the most appropriate mechanisms for human–information interaction. Seven areas for further work are highlighted as those among the highest priorities for the next 5 years of visual analytics research: ubiquitous, embodied interaction; capturing user intentionality; knowledge-based interfaces; collaboration; principles of design and perception; interoperability; and interaction evaluation. Ultimately, the goal of a science of interaction is to support the visual analytics and human–computer interaction communities through the recognition and implementation of best practices in the representation and manipulation of visual displays.

[1]  I. V. Ramakrishnan,et al.  Toward a Multi-Analyst, Collaborative Framework for Visual Analytics , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[2]  C. Peirce,et al.  The Fixation of Belief , 2011, Philosophy after Darwin.

[3]  James R. Eagan,et al.  Low-level components of analytic activity in information visualization , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..

[4]  M. Sheelagh T. Carpendale,et al.  Grounded evaluation of information visualizations , 2008, BELIV.

[5]  David S. Ebert,et al.  Visual Analytics on Mobile Devices for Emergency Response , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[6]  H. Gadamer,et al.  Truth and Method , 1960 .

[7]  Jeffrey Heer,et al.  Graphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[8]  David Kirshner,et al.  Situated cognition : social, semiotic, and psychological perspectives , 2009 .

[9]  John T. Stasko,et al.  Distributed Cognition as a Theoretical Framework for Information Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[10]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[11]  Michael Gertz,et al.  A Model and Framework for Visualization Exploration , 2007, IEEE Transactions on Visualization and Computer Graphics.

[12]  D. Medin,et al.  Concepts do more than categorize , 1999, Trends in Cognitive Sciences.

[13]  John T. Stasko,et al.  Low-level components of analytic activity in information visualization , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..

[14]  Petra Isenberg,et al.  Collaborative Brushing and Linking for Co‐located Visual Analytics of Document Collections , 2009, Comput. Graph. Forum.

[15]  William J. Clancey,et al.  Situated cognition: how representations are created and given meaning , 1993, Lessons from Learning.

[16]  Pat Hanrahan,et al.  Show Me: Automatic Presentation for Visual Analysis , 2007, IEEE Transactions on Visualization and Computer Graphics.

[17]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[18]  Sean White,et al.  SiteLens: situated visualization techniques for urban site visits , 2009, CHI.

[19]  Robert Kosara,et al.  The Shaping of Information by Visual Metaphors , 2008, IEEE Transactions on Visualization and Computer Graphics.

[20]  Chris North,et al.  User Interaction with Scatterplots on Small Screens - A Comparative Evaluation of Geometric-Semantic Zoom and Fisheye Distortion , 2006 .

[21]  Chris North,et al.  The Perceptual Scalability of Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[22]  Jean Scholtz,et al.  Visual Analytics Technology Transition Progress , 2009, Inf. Vis..

[23]  Lyndsey Franklin,et al.  The Scalable Reasoning System: Lightweight visualization for distributed analytics , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[24]  Michelle X. Zhou,et al.  Characterizing Users' Visual Analytic Activity for Insight Provenance , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[25]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[26]  David Kirsh,et al.  Distributed cognition: a methodological note , 2006 .

[27]  Daniel Kolb Critique of Judgment , 1988 .

[28]  Jean-Daniel Fekete,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS , 2022 .

[29]  Alan M. MacEachren,et al.  A Distributed Spatiotemporal Cognition Approach to Visualization in Support of Coordinated Group Activity , 2006 .

[30]  John Stasko,et al.  BEST PAPER: A Knowledge Task-Based Framework for Design and Evaluation of Information Visualizations , 2004 .

[31]  William Ribarsky,et al.  Defining Insight for Visual Analytics , 2009, IEEE Computer Graphics and Applications.

[32]  Jarke J. van Wijk,et al.  Supporting the analytical reasoning process in information visualization , 2008, CHI.

[33]  Harald Reiterer,et al.  User Interaction with Scatterplots on Small Screens - A Comparative Evaluation of Geometric-Semantic Zoom and Fisheye Distortion , 2006, IEEE Transactions on Visualization and Computer Graphics.

[34]  Jeffrey Heer,et al.  Design Considerations for Collaborative Visual Analytics , 2008, Inf. Vis..

[35]  Heidi Lam,et al.  A Framework of Interaction Costs in Information Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[36]  William Ribarsky,et al.  Visual analytics for complex concepts using a human cognition model , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[37]  Pat Hanrahan,et al.  Enhancing Visual Analysis of Network Traffic Using a Knowledge Representation , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[38]  William Ribarsky,et al.  Recovering Reasoning Processes from User Interactions , 2009, IEEE Computer Graphics and Applications.

[39]  Catherine Plaisant,et al.  The challenge of information visualization evaluation , 2004, AVI.

[40]  Anthony C. Robinson,et al.  Collaborative synthesis of visual analytic results , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[41]  John T. Stasko,et al.  Toward a Deeper Understanding of the Role of Interaction in Information Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.

[42]  Cláudio T. Silva,et al.  Provenance for Visualizations: Reproducibility and Beyond , 2007, Computing in Science & Engineering.

[43]  Desney S. Tan,et al.  FacetMap: A Scalable Search and Browse Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[44]  Paul Dourish,et al.  Where the action is , 2001 .