Multiple Coordinated Views at Large Displays for Multiple Users: Empirical Findings on User Behavior, Movements, and Distances

Interactive wall-sized displays benefit data visualization. Due to their sheer display size, they make it possible to show large amounts of data in multiple coordinated views (MCV) and facilitate collaborative data analysis. In this work, we propose a set of important design considerations and contribute a fundamental input vocabulary and interaction mapping for MCV functionality. We also developed a fully functional application with more than 45 coordinated views visualizing a real-world, multivariate data set of crime activities, which we used in a comprehensive qualitative user study investigating how pairs of users behave. Most importantly, we found that flexible movement is essential and—depending on user goals—is connected to collaboration, perception, and interaction. Therefore, we argue that for future systems interaction from the distance is required and needs good support. We show that our consistent design for both direct touch at the large display and distant interaction using mobile phones enables the seamless exploration of large-scale MCV at wall-sized displays. Our MCV application builds on design aspects such as simplicity, flexibility, and visual consistency and, therefore, supports realistic workflows. We believe that in the future, many visual data analysis scenarios will benefit from wall-sized displays presenting numerous coordinated visualizations, for which our findings provide a valuable foundation.

[1]  Wendy E. Mackay,et al.  Effects of display size and navigation type on a classification task , 2014, CHI.

[2]  Jonathan C. Roberts,et al.  Visualization beyond the Desktop--the Next Big Thing , 2014, IEEE Computer Graphics and Applications.

[3]  Anastasia Bezerianos,et al.  Perception of Visual Variables on Tiled Wall-Sized Displays for Information Visualization Applications , 2012, IEEE Transactions on Visualization and Computer Graphics.

[4]  Chris North,et al.  The Perceptual Scalability of Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[5]  Mikkel Rønne Jakobsen,et al.  Up close and personal: Collaborative work on a high-resolution multitouch wall display , 2014, TCHI.

[6]  Nicolas Roussel,et al.  1 € filter: a simple speed-based low-pass filter for noisy input in interactive systems , 2012, CHI.

[7]  Christopher Andrews,et al.  Visual encodings that support physical navigation on large displays , 2011, Graphics Interface.

[8]  Paul Johns,et al.  Understanding Pen and Touch Interaction for Data Exploration on Interactive Whiteboards , 2012, IEEE Transactions on Visualization and Computer Graphics.

[9]  Fabrice Matulic,et al.  BodyLenses: Embodied Magic Lenses and Personal Territories for Wall Displays , 2015, ITS.

[10]  Zening Qu,et al.  Keeping Multiple Views Consistent: Constraints, Validations, and Exceptions in Visualization Authoring , 2019, IEEE Transactions on Visualization and Computer Graphics.

[11]  Niklas Elmqvist,et al.  When David Meets Goliath: Combining Smartwatches with a Large Vertical Display for Visual Data Exploration , 2018, CHI.

[12]  Niklas Elmqvist,et al.  Supporting visual exploration for multiple users in large display environments , 2016, 2016 IEEE Conference on Visual Analytics Science and Technology (VAST).

[13]  George Chin,et al.  Exploring the analytical processes of intelligence analysts , 2009, CHI.

[14]  Kori Inkpen Quinn,et al.  The proximity factor: impact of distance on co-located collaboration , 2005, GROUP.

[15]  Aniket Kittur,et al.  Kinetica: naturalistic multi-touch data visualization , 2014, CHI.

[16]  John T. Stasko,et al.  Orko: Facilitating Multimodal Interaction for Visual Exploration and Analysis of Networks , 2018, IEEE Transactions on Visualization and Computer Graphics.

[17]  M. Sheelagh T. Carpendale,et al.  Understanding Researchers' Use of a Large, High-Resolution Display Across Disciplines , 2015, ITS.

[18]  Pierre Dragicevic,et al.  An Interaction Model for Visualizations Beyond The Desktop , 2013, IEEE Transactions on Visualization and Computer Graphics.

[19]  E. Hall,et al.  The Hidden Dimension , 1970 .

[20]  Niklas Elmqvist,et al.  Visfer: Camera-based visual data transfer for cross-device visualization , 2019, Inf. Vis..

[21]  Chris North,et al.  Realizing embodied interaction for visual analytics through large displays , 2007, Comput. Graph..

[22]  Graham J. Wills Selection: 524,288 ways to say "this is interesting" , 1996, Proceedings IEEE Symposium on Information Visualization '96.

[23]  Christian Müller-Tomfelde,et al.  Supporting interaction and collaboration on large displays using tablet devices , 2012, AVI.

[24]  Ricardo Langner,et al.  VisTiles: Coordinating and Combining Co-located Mobile Devices for Visual Data Exploration , 2018, IEEE Transactions on Visualization and Computer Graphics.

[25]  M. Sheelagh T. Carpendale,et al.  Territoriality in collaborative tabletop workspaces , 2004, CSCW.

[26]  Chris North,et al.  Move to improve: promoting physical navigation to increase user performance with large displays , 2007, CHI.

[27]  Heidrun Schumann,et al.  Fisheye Tree Views and Lenses for Graph Visualization , 2006, Tenth International Conference on Information Visualisation (IV'06).

[28]  Steven K. Feiner,et al.  Virtual projection: exploring optical projection as a metaphor for multi-device interaction , 2012, CHI.

[29]  Olivier Chapuis,et al.  CoReach: Cooperative Gestures for Data Manipulation on Wall-sized Displays , 2017, CHI.

[30]  Mary Czerwinski,et al.  An exploratory study of co-located collaborative visual analytics around a tabletop display , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[31]  Yang Li,et al.  Gesturemote: interacting with remote displays through touch gestures , 2014, AVI.

[32]  John T. Stasko,et al.  Expanding Selection for Information Visualization Systems on Tablet Devices , 2016, ISS.

[33]  Michael E. Papka,et al.  Effects of Display Size and Resolution on User Behavior and Insight Acquisition in Visual Exploration , 2015, CHI.

[34]  Olivier Chapuis,et al.  Evaluating Multi-User Selection for Exploring Graph Topology on Wall-Displays , 2017, IEEE Transactions on Visualization and Computer Graphics.

[35]  M. Sheelagh T. Carpendale,et al.  A comparison of ray pointing techniques for very large displays , 2010, Graphics Interface.

[36]  Tobias Isenberg,et al.  Integrating 2D mouse emulation with 3D manipulation for visualizations on a multi-touch table , 2010, ITS '10.

[37]  Christopher Andrews,et al.  Space to think: large high-resolution displays for sensemaking , 2010, CHI.

[38]  Mikkel Rønne Jakobsen,et al.  Information Visualization and Proxemics: Design Opportunities and Empirical Findings , 2013, IEEE Transactions on Visualization and Computer Graphics.

[39]  Ricardo Langner,et al.  Content Sharing Between Spatially-Aware Mobile Phones and Large Vertical Displays Supporting Collaborative Work , 2016, Collaboration Meets Interactive Spaces.

[40]  Edward Lank,et al.  Creating Your Bubble: Personal Space On and Around Large Public Displays , 2016, CHI.

[41]  Raimund Dachselt,et al.  GIAnT: Visualizing Group Interaction at Large Wall Displays , 2017, CHI.

[42]  M. Sheelagh T. Carpendale,et al.  Lark: Coordinating Co-located Collaboration with Information Visualization , 2009, IEEE Transactions on Visualization and Computer Graphics.

[43]  Daniel Vogel,et al.  Territoriality and behaviour on and around large vertical publicly-shared displays , 2012, DIS '12.

[44]  Petra Isenberg,et al.  Collaborative Brushing and Linking for Co‐located Visual Analytics of Document Collections , 2009, Comput. Graph. Forum.

[45]  Anastasia Bezerianos,et al.  Smarties: an input system for wall display development , 2014, CHI.

[46]  Heidrun Schumann,et al.  Physical Navigation to Support Graph Exploration on a Large High-Resolution Display , 2011, ISVC.

[47]  Celeste Lyn Paul,et al.  Size matters: the effects of interactive display size on interaction zone expectations , 2018, AVI.

[48]  Christopher Andrews,et al.  Information visualization on large, high-resolution displays: Issues, challenges, and opportunities , 2011, Inf. Vis..

[49]  M. Sheelagh T. Carpendale,et al.  Beyond Mouse and Keyboard: Expanding Design Considerations for Information Visualization Interactions , 2012, IEEE Transactions on Visualization and Computer Graphics.

[50]  Saul Greenberg,et al.  Cross-device interaction via micro-mobility and f-formations , 2012, UIST.

[51]  Charles Perin,et al.  MyBrush: Brushing and Linking with Personal Agency , 2018, IEEE Transactions on Visualization and Computer Graphics.

[52]  Mikkel Rønne Jakobsen,et al.  Is Moving Improving?: Some Effects of Locomotion in Wall-Display Interaction , 2015, CHI.

[53]  Monica M. C. Schraefel,et al.  TouchViz: a case study comparing two interfaces for data analytics on tablets , 2013, CHI.

[54]  Olivier Chapuis,et al.  Trade-offs Between a Vertical Shared Display and Two Desktops in a Collaborative Path-Finding Task , 2017, Graphics Interface.

[55]  J.C. Roberts,et al.  State of the Art: Coordinated & Multiple Views in Exploratory Visualization , 2007, Fifth International Conference on Coordinated and Multiple Views in Exploratory Visualization (CMV 2007).

[56]  Stacey D. Scott,et al.  Regional undo/redo techniques for large interactive surfaces , 2012, CHI.

[57]  Chris North,et al.  VisPorter: facilitating information sharing for collaborative sensemaking on multiple displays , 2014, Personal and Ubiquitous Computing.

[58]  Chris North,et al.  A multiscale interaction technique for large, high-resolution displays , 2009, 2009 IEEE Symposium on 3D User Interfaces.

[59]  Olivier Chapuis,et al.  Shared Interaction on a Wall-Sized Display in a Data Manipulation Task , 2016, CHI.

[60]  M. Sheelagh T. Carpendale,et al.  TouchWave: kinetic multi-touch manipulation for hierarchical stacked graphs , 2012, ITS.

[61]  Keith Andrews,et al.  Interaction Concepts for Collaborative Visual Analysis of Scatterplots on Large Vertically-Mounted High-Resolution Multi-Touch Displays , 2017, Forum Media Technology.

[62]  Edward Lank,et al.  Pointing at a Distance with Everyday Smart Devices , 2018, CHI.

[63]  Uta Hinrichs,et al.  SpiderEyes: designing attention- and proximity-aware collaborative interfaces for wall-sized displays , 2014, IUI.

[64]  Raimund Dachselt,et al.  Still looking: investigating seamless gaze-supported selection, positioning, and manipulation of distant targets , 2013, CHI.

[65]  M. Sheelagh T. Carpendale,et al.  Exploring the design space of interactive link curvature in network diagrams , 2012, AVI.

[66]  Heidrun Schumann,et al.  Interactive Lenses for Visualization: An Extended Survey , 2017, Comput. Graph. Forum.

[67]  Dominik Schmidt PhoneTouch: a technique for direct phone interaction on surfaces , 2010, ITS '10.

[68]  Raimund Dachselt,et al.  GraSp: Combining Spatially‐aware Mobile Devices and a Display Wall for Graph Visualization and Interaction , 2017, Comput. Graph. Forum.

[69]  Daniel J. Wigdor,et al.  Conductor: enabling and understanding cross-device interaction , 2014, CHI.

[70]  Desney S. Tan,et al.  Effects of Visual Separation and Physical Discontinuities when Distributing Information across Multiple Displays , 2003, INTERACT.

[71]  M. Sheelagh T. Carpendale,et al.  Getting practical with interactive tabletop displays: designing for dense data, "fat fingers," diverse interactions, and face-to-face collaboration , 2009, ITS '09.

[72]  Ricardo Langner,et al.  SleeD: Using a Sleeve Display to Interact with Touch-sensitive Display Walls , 2014, ITS '14.

[73]  M. Sheelagh T. Carpendale,et al.  Collaborative coupling over tabletop displays , 2006, CHI.

[74]  Pierre Dragicevic,et al.  Tangible remote controllers for wall-size displays , 2012, CHI.

[75]  John T. Stasko,et al.  Designing and implementing an interactive scatterplot visualization for a tablet computer , 2014, AVI.

[76]  Raimund Dachselt,et al.  Elasticcon: Elastic Controllers for Casual Interaction , 2015, MobileHCI.

[77]  Camilla Forsell,et al.  Interaction Support for Visual Comparison Inspired by Natural Behavior , 2012, IEEE Transactions on Visualization and Computer Graphics.

[78]  Sebastian Boring,et al.  Should I Stay or Should I Go? Selecting Between Touch and Mid-Air Gestures for Large-Display Interaction , 2015, INTERACT.