Dataspace: A Reconfigurable Hybrid Reality Environment for Collaborative Information Analysis

Immersive environments have gradually become standard for visualizing and analyzing large or complex datasets that would otherwise be cumbersome, if not impossible, to explore through smaller scale computing devices. However, this type of workspace often proves to possess limitations in terms of interaction, flexibility, cost and scalability. In this paper we introduce a novel immersive environment called Dataspace, which features a new combination of heterogeneous technologies and methods of interaction towards creating a better team workspace. Dataspace provides 15 high-resolution displays that can be dynamically reconfigured in space through robotic arms, a central table where information can be projected, and a unique integration with augmented reality (AR) and virtual reality (VR) headsets and other mobile devices. In particular, we contribute novel interaction methodologies to couple the physical environment with AR and VR technologies, enabling visualization of complex types of data and mitigating the scalability issues of existing immersive environments. We demonstrate through four use cases how this environment can be effectively used across different domains and reconfigured based on user requirements. Finally, we compare Dataspace with existing technologies, summarizing the trade-offs that should be considered when attempting to build better collaborative workspaces for the future.

[1]  Falko Kuester,et al.  The StarCAVE, a third-generation CAVE and virtual reality OptIPortal , 2009, Future Gener. Comput. Syst..

[2]  Mayur Gondhalekar,et al.  CAVE: An Emerging Immersive Technology -- A Review , 2014, 2014 UKSim-AMSS 16th International Conference on Computer Modelling and Simulation.

[3]  Niklas Elmqvist,et al.  When David Meets Goliath: Combining Smartwatches with a Large Vertical Display for Visual Data Exploration , 2018, CHI.

[4]  Kevin Ponto,et al.  DSCVR: designing a commodity hybrid virtual reality system , 2015, Virtual Reality.

[5]  Arie E. Kaufman,et al.  Scalability limits of large immersive high-resolution displays , 2015, 2015 IEEE Virtual Reality (VR).

[6]  John P. McIntire,et al.  The (possible) utility of stereoscopic 3D displays for information visualization: The good, the bad, and the ugly , 2014, 2014 IEEE VIS International Workshop on 3DVis (3DVis).

[7]  William Gobson,et al.  Multimedia: From Wagner to Virtual Reality , 2001 .

[8]  Harald Reiterer,et al.  Clusters, Trends, and Outliers: How Immersive Technologies Can Facilitate the Collaborative Analysis of Multidimensional Data , 2018, CHI.

[9]  Daniel Zielasko,et al.  buenoSDIAs: Supporting Desktop Immersive Analytics While Actively Preventing Cybersickness , 2017 .

[10]  Vid Petrovic,et al.  The future of the CAVE , 2011 .

[11]  Luc Renambot,et al.  Lambda table: high resolution tiled display table for interacting with large visualizations , 2005 .

[12]  Alexandru Dancu,et al.  The Ultimate Display , 2014 .

[13]  Tim McGraw,et al.  Medical Image Atlas Interaction in Virtual Reality , 2017 .

[14]  Marco Cavallo,et al.  A Visual Interaction Framework for Dimensionality Reduction Based Data Exploration , 2018, CHI.

[15]  Henry Y. K. Lau,et al.  A virtual container terminal simulator for the design of terminal operation , 2007 .

[16]  Jonathan C. Roberts,et al.  Immersive Analytics with WebVR and Google Cardboard , 2016 .

[17]  qcMIZCV QoKNQ,et al.  Increased Display Size and Resolution Improve Task Performance in Information-Rich Virtual Environments , 2006 .

[18]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[19]  Yannick Prié,et al.  Towards HMD-based Immersive Analytics , 2017 .

[20]  Olivier Chapuis,et al.  Shared Interaction on a Wall-Sized Display in a Data Manipulation Task , 2016, CHI.

[21]  Bruce H. Thomas,et al.  Immersive Collaborative Analysis of Network Connectivity: CAVE-style or Head-Mounted Display? , 2017, IEEE Transactions on Visualization and Computer Graphics.

[22]  Arthur Nishimoto,et al.  CAVE2: a hybrid reality environment for immersive simulation and information analysis , 2013, Electronic Imaging.

[23]  Marco Cavallo,et al.  Clustrophile 2: Guided Visual Clustering Analysis , 2018, IEEE Transactions on Visualization and Computer Graphics.

[24]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[25]  Arthur Nishimoto,et al.  Omegalib: A multi-view application framework for hybrid reality display environments , 2014, 2014 IEEE Virtual Reality (VR).

[26]  G. Elisabeta Marai,et al.  Interdisciplinary immersive analytics at the electronic visualization laboratory: Lessons learned and upcoming challenges , 2016, 2016 Workshop on Immersive Analytics (IA).

[27]  Akira Kageyama,et al.  Applications and a three-dimensional desktop environment for an immersive virtual reality system , 2013, ArXiv.

[28]  Pavan K. Turaga,et al.  Ceding Control: Empowering Remote Participants in Meetings involving Smart Conference Rooms , 2016, AAAI Workshop: Symbiotic Cognitive Systems.

[29]  Olivier Chapuis,et al.  Evaluating Multi-User Selection for Exploring Graph Topology on Wall-Displays , 2017, IEEE Transactions on Visualization and Computer Graphics.

[30]  Michael E. Papka,et al.  Effects of Display Size and Resolution on User Behavior and Insight Acquisition in Visual Exploration , 2015, CHI.

[31]  M. Sheelagh T. Carpendale,et al.  Immersive Analytics: Exploring Future Interaction and Visualization Technologies for Data Analytics , 2016, ISS.

[32]  Thomas Marrinan,et al.  SAGE2: A new approach for data intensive collaboration using Scalable Resolution Shared Displays , 2014, 10th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing.

[33]  Matthew R. G. Brown,et al.  Learning stable and predictive network-based patterns of schizophrenia and its clinical symptoms , 2017, npj Schizophrenia.

[34]  Ryan Kelly,et al.  Exploring Data in Virtual Reality: Comparisons with 2D Data Visualizations , 2018, CHI Extended Abstracts.

[35]  Johanna Beyer,et al.  The Hologram in My Hand: How Effective is Interactive Exploration of 3D Visualizations in Immersive Tangible Augmented Reality? , 2018, IEEE Transactions on Visualization and Computer Graphics.

[36]  Rachel K. E. Bellamy,et al.  Symbiotic Cognitive Computing , 2016, AI Mag..

[37]  Klaus Mueller,et al.  The Reality Deck--an Immersive Gigapixel Display , 2015, IEEE Computer Graphics and Applications.

[38]  Luc Renambot,et al.  SAGE: the Scalable Adaptive Graphics Environment , 2004 .

[39]  Jonathan C. Roberts,et al.  Synthetic Visualizations in Web-based Mixed Reality , 2017 .

[40]  Mikkel Rønne Jakobsen,et al.  Up close and personal: Collaborative work on a high-resolution multitouch wall display , 2014, TCHI.

[41]  Stephen Travis Pope,et al.  The AlloSphere: Immersive Multimedia for Scientific Discovery and Artistic Exploration , 2009, IEEE MultiMedia.

[42]  Mark T. Bolas,et al.  Tablet-based interaction panels for immersive environments , 2014, 2014 IEEE Virtual Reality (VR).