Uplift: A Tangible and Immersive Tabletop System for Casual Collaborative Visual Analytics

Collaborative visual analytics leverages social interaction to support data exploration and sensemaking. These processes are typically imagined as formalised, extended activities, between groups of dedicated experts, requiring expertise with sophisticated data analysis tools. However, there are many professional domains that benefit from support for short 'bursts' of data exploration between a subset of stakeholders with a diverse breadth of knowledge. Such 'casual collaborative' scenarios will require engaging features to draw users' attention, with intuitive, 'walk-up and use' interfaces. This paper presents Uplift, a novel prototype system to support 'casual collaborative visual analytics' for a campus microgrid, co-designed with local stakeholders. An elicitation workshop with key members of the building management team revealed relevant knowledge is distributed among multiple experts in their team, each using bespoke analysis tools. Uplift combines an engaging 3D model on a central tabletop display with intuitive tangible interaction, as well as augmented-reality, mid-air data visualisation, in order to support casual collaborative visual analytics for this complex domain. Evaluations with expert stakeholders from the building management and energy domains were conducted during and following our prototype development and indicate that Uplift is successful as an engaging backdrop for casual collaboration. Experts see high potential in such a system to bring together diverse knowledge holders and reveal complex interactions between structural, operational, and financial aspects of their domain. Such systems have further potential in other domains that require collaborative discussion or demonstration of models, forecasts, or cost-benefit analyses to high-level stakeholders.

[1]  Mishal Dholakia,et al.  Dataspace: A Reconfigurable Hybrid Reality Environment for Collaborative Information Analysis , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[2]  Hiroshi Ishii,et al.  Augmented urban planning workbench: overlaying drawings, physical models and digital simulation , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[3]  Pierre Dragicevic,et al.  Embedded Data Representations , 2017, IEEE Transactions on Visualization and Computer Graphics.

[4]  Martin Wattenberg,et al.  ManyEyes: a Site for Visualization at Internet Scale , 2007, IEEE Transactions on Visualization and Computer Graphics.

[5]  Ali Mazalek,et al.  Combining Mobile, Tangible and Virtual World Platforms to Support Participatory Campus Planning , 2016, ISS.

[6]  Jeffrey Heer,et al.  Design Considerations for Collaborative Visual Analytics , 2008, Inf. Vis..

[7]  Raimund Dachselt,et al.  Use your head: tangible windows for 3D information spaces in a tabletop environment , 2012, ITS.

[8]  Harald Reiterer,et al.  Clusters, Trends, and Outliers: How Immersive Technologies Can Facilitate the Collaborative Analysis of Multidimensional Data , 2018, CHI.

[9]  Valeriy Vyatkin,et al.  Virtual Power Plant for Grid Services Using IEC 61850 , 2016, IEEE Transactions on Industrial Informatics.

[10]  Valérie Maquil,et al.  Towards Understanding the Design Space of Tangible User Interfaces for Collaborative Urban Planning , 2016, Interact. Comput..

[11]  M. Sheelagh T. Carpendale,et al.  Interface Currents: Supporting Fluent Collaboration on Tabletop Displays , 2005, Smart Graphics.

[12]  Olivier Chapuis,et al.  Evaluating Multi-User Selection for Exploring Graph Topology on Wall-Displays , 2017, IEEE Transactions on Visualization and Computer Graphics.

[13]  Dick de Waard,et al.  A simple procedure for the assessment of acceptance of advanced transport telematics , 1997 .

[14]  Mary Czerwinski,et al.  Co-Located Collaborative Visual Analytics around a Tabletop Display , 2012, IEEE Transactions on Visualization and Computer Graphics.

[15]  M. Sheelagh T. Carpendale,et al.  Lark: Coordinating Co-located Collaboration with Information Visualization , 2009, IEEE Transactions on Visualization and Computer Graphics.

[16]  Daniel Mendes,et al.  VRRRRoom: Virtual Reality for Radiologists in the Reading Room , 2017, CHI.

[17]  Derek F. Reilly,et al.  Grab This, Swipe That: Combining Tangible and Gestural Interaction in Multiple Display Collaborative Gameplay , 2016, ISS.

[18]  Joaquim A. Jorge,et al.  Mockup builder: direct 3D modeling on and above the surface in a continuous interaction space , 2012, Graphics Interface.

[19]  M. Sheelagh T. Carpendale,et al.  The bohemian bookshelf: supporting serendipitous book discoveries through information visualization , 2012, CHI.

[20]  Arnaud Prouzeau,et al.  Scaptics and Highlight-Planes: Immersive Interaction Techniques for Finding Occluded Features in 3D Scatterplots , 2019, CHI.

[21]  Luis Alonso,et al.  CityScope: A Data-Driven Interactive Simulation Tool for Urban Design. Use Case Volpe , 2018 .

[22]  Steven K. Feiner,et al.  Cross-dimensional gestural interaction techniques for hybrid immersive environments , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[23]  Pierre Dragicevic,et al.  Tangible remote controllers for wall-size displays , 2012, CHI.

[24]  Martin Hachet,et al.  Toucheo: multitouch and stereo combined in a seamless workspace , 2011, UIST.

[25]  Ali Mazalek,et al.  From big data to insights: opportunities and challenges for TEI in genomics , 2013, TEI '13.

[26]  John T. Stasko,et al.  Jigsaw: Supporting Investigative Analysis through Interactive Visualization , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[27]  Paul Dourish,et al.  Where the action is , 2001 .

[28]  Markus Löchtefeld,et al.  Analysing the effect of tangibile user interfaces on spatial memory , 2017, SUI.

[29]  Tim Dwyer,et al.  Design space for spatio-data coordination: Tangible interaction devices for immersive information visualisation , 2017, 2017 IEEE Pacific Visualization Symposium (PacificVis).

[30]  Pieter Jan Stappers,et al.  Probes, toolkits and prototypes: three approaches to making in codesigning , 2014 .

[31]  Carl Gutwin,et al.  A Descriptive Framework of Workspace Awareness for Real-Time Groupware , 2002, Computer Supported Cooperative Work (CSCW).

[32]  Alexander Kulik,et al.  Multi-Window 3D Interaction for Collaborative Virtual Reality , 2020, IEEE Transactions on Visualization and Computer Graphics.

[33]  Pieter Jan Stappers,et al.  Co-creation and the new landscapes of design , 2008 .

[34]  Mishal Dholakia,et al.  Immersive Insights: A Hybrid Analytics System forCollaborative Exploratory Data Analysis , 2019, VRST.

[35]  Sara Jones,et al.  A Framework for Creative Visualization-Opportunities Workshops , 2018, IEEE Transactions on Visualization and Computer Graphics.

[36]  Mary Czerwinski,et al.  An exploratory study of co-located collaborative visual analytics around a tabletop display , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[37]  Tim Dwyer,et al.  Embodied Axes: Tangible, Actuated Interaction for 3D Augmented Reality Data Spaces , 2020, CHI.

[38]  Raimund Dachselt,et al.  DesignAR: Immersive 3D-Modeling Combining Augmented Reality with Interactive Displays , 2019, ISS.

[39]  Kellogg S. Booth,et al.  UD Co-Spaces: A Table-Centred Multi-Display Environment for Public Engagement in Urban Design Charrettes , 2016, ISS.

[40]  Bernd Fröhlich,et al.  The cubic mouse: a new device for three-dimensional input , 2000, CHI.

[41]  Bruce H. Thomas,et al.  Immersive Collaborative Analysis of Network Connectivity: CAVE-style or Head-Mounted Display? , 2017, IEEE Transactions on Visualization and Computer Graphics.

[42]  Olivier Chapuis,et al.  Awareness Techniques to Aid Transitions between Personal and Shared Workspaces in Multi-Display Environments , 2018, ISS.

[43]  Bruce H. Thomas,et al.  ImAxes: Immersive Axes as Embodied Affordances for Interactive Multivariate Data Visualisation , 2017, UIST.

[44]  Ehud Sharlin,et al.  Seamless mixed reality tracking in tabletop reservoir engineering interaction , 2012, AVI.

[45]  Faisal Taher,et al.  Exploring Interactions with Physically Dynamic Bar Charts , 2015, CHI.

[46]  Steven K. Feiner,et al.  Balloon Selection: A Multi-Finger Technique for Accurate Low-Fatigue 3D Selection , 2007, 2007 IEEE Symposium on 3D User Interfaces.

[47]  Anastasia Bezerianos,et al.  Collaborative Immersive Analytics , 2018, Immersive Analytics.

[48]  Jae Yeol Lee,et al.  CAPTIVE: a cube with augmented physical tools , 2014, CHI Extended Abstracts.

[49]  Teddy Seyed,et al.  Envisioning the Emergency Operations Centre of the Future , 2016, Collaboration Meets Interactive Spaces.

[50]  M. Sheelagh T. Carpendale,et al.  Data Changes Everything: Challenges and Opportunities in Data Visualization Design Handoff , 2019, IEEE Transactions on Visualization and Computer Graphics.

[51]  HeerJeffrey,et al.  D3 Data-Driven Documents , 2011 .

[52]  Ali Mazalek,et al.  Active Pathways: Using Active Tangibles and Interactive Tabletops for Collaborative Modeling in Systems Biology , 2016, ISS.

[53]  Johanna Beyer,et al.  The Hologram in My Hand: How Effective is Interactive Exploration of 3D Visualizations in Immersive Tangible Augmented Reality? , 2018, IEEE Transactions on Visualization and Computer Graphics.

[54]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[55]  Raimund Dachselt,et al.  PaperLens: advanced magic lens interaction above the tabletop , 2009, ITS '09.

[56]  Jonathan C. Roberts,et al.  Visualization beyond the Desktop--the Next Big Thing , 2014, IEEE Computer Graphics and Applications.

[57]  Emmanuel Pietriga,et al.  TouchTokens: Guiding Touch Patterns with Passive Tokens , 2016, CHI.

[58]  Anthony Tang Interstitial Space in MDEs for Data Analysis , 2011 .

[59]  Niklas Elmqvist,et al.  There Is No Spoon: Evaluating Performance, Space Use, and Presence with Expert Domain Users in Immersive Analytics , 2019, IEEE Transactions on Visualization and Computer Graphics.