IATK: An Immersive Analytics Toolkit

We introduce IATK, the Immersive Analytics Toolkit, a software package for Unity that allows interactive authoring and exploration of data visualisation in immersive environments. The design of IATK was informed by interdisciplinary expert-collaborations as well as visual analytics applications and iterative refinement over several years. IATK allows for easy assembly of visualisations through a grammar of graphics that a user can configure in a GUI-in addition to a dedicated visualisation API that supports the creation of novel immersive visualisation designs and interactions. IATK is designed with scalability in mind, allowing visualisation and fluid responsive interactions in the order of several million points at a usable frame rate. This paper outlines our design requirements, IATK's framework design and technical features, its user interface, as well as application examples.

[1]  Jock D. Mackinlay,et al.  The information visualizer, an information workspace , 1991, CHI.

[2]  M. Sheelagh T. Carpendale,et al.  Immersive Analytics: Exploring Future Interaction and Visualization Technologies for Data Analytics , 2016, ISS.

[3]  Kwan-Liu Ma,et al.  A Study of Layout, Rendering, and Interaction Methods for Immersive Graph Visualization , 2016, IEEE Transactions on Visualization and Computer Graphics.

[4]  Ben Shneiderman,et al.  Interactive Dynamics for Visual Analysis , 2012 .

[5]  Aruna Raja,et al.  Domain Specific Languages , 2010 .

[6]  Jeffrey Heer,et al.  Animated Transitions in Statistical Data Graphics , 2007, IEEE Transactions on Visualization and Computer Graphics.

[7]  W. Hays.  Semiology of Graphics: Diagrams Networks Maps. , 1985 .

[8]  Jeffrey Heer,et al.  prefuse: a toolkit for interactive information visualization , 2005, CHI.

[9]  Johanna Beyer,et al.  The Hologram in My Hand: How Effective is Interactive Exploration of 3D Visualizations in Immersive Tangible Augmented Reality? , 2018, IEEE Transactions on Visualization and Computer Graphics.

[10]  Carolina Cruz-Neira,et al.  VR Juggler: a virtual platform for virtual reality application development , 2001, Proceedings IEEE Virtual Reality 2001.

[11]  Hadley Wickham,et al.  A Layered Grammar of Graphics , 2010 .

[12]  Jeffrey Heer,et al.  Protovis: A Graphical Toolkit for Visualization , 2009, IEEE Transactions on Visualization and Computer Graphics.

[13]  Christophe Hurter,et al.  Immersive solutions for future Air Traffic Control and Management , 2016, ISS Companion.

[14]  Matthias Klapperstück,et al.  Immersive Analytics , 2015, 2015 Big Data Visual Analytics (BDVA).

[15]  Paul S. Strauss.  IRIS Inventor, a 3D graphics toolkit , 1993, OOPSLA '93.

[16]  Hanspeter Pfister,et al.  Drawing into the AR-CANVAS : Designing Embedded Visualizations for Augmented Reality , 2017 .

[17]  Tobias Höllerer,et al.  Stardust: Accessible and Transparent GPU Support for Information Visualization Rendering , 2017, Comput. Graph. Forum.

[18]  Tomasz Bednarz,et al.  Glance: generalized geometric primitives and transformations for information visualization in AR/VR environments , 2016, VRCAI.

[19]  Ross T. Smith,et al.  Using augmented reality to support situated analytics , 2015, 2015 IEEE Virtual Reality (VR).

[20]  David K. Harrison,et al.  Virtual Reality medical training system for anatomy education , 2014, 2014 Science and Information Conference.

[21]  Russell M. Taylor,et al.  VRPN: a device-independent, network-transparent VR peripheral system , 2001, VRST '01.

[22]  John F. Lucas,et al.  Exploring the Benefits of Immersion in Abstract Information Visualization , 2004 .

[23]  Andreas Buja,et al.  Interactive data visualization using focusing and linking , 1991, Proceeding Visualization '91.

[24]  T. Dwyer,et al.  Immersive Analytics : Exploring Future Visualization and Interaction Technologies for Data Analytics , 2017 .

[25]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[26]  M. Sheelagh T. Carpendale,et al.  VisLink: Revealing Relationships Amongst Visualizations , 2007, IEEE Transactions on Visualization and Computer Graphics.

[27]  Bruce H. Thomas,et al.  ImAxes: Immersive Axes as Embodied Affordances for Interactive Multivariate Data Visualisation , 2017, UIST.

[28]  Jean-Daniel Fekete,et al.  The InfoVis Toolkit , 2004, IEEE Symposium on Information Visualization.

[29]  Kwan-Liu Ma,et al.  P4: Portable Parallel Processing Pipelines for Interactive Information Visualization , 2020, IEEE Transactions on Visualization and Computer Graphics.

[30]  Jeffrey S. Norris,et al.  Immersive and collaborative data visualization using virtual reality platforms , 2014, 2014 IEEE International Conference on Big Data (Big Data).

[31]  Robert B. Miller,et al.  Response time in man-computer conversational transactions , 1899, AFIPS Fall Joint Computing Conference.

[32]  Andreas Buja,et al.  Interactive High-Dimensional Data Visualization , 1996 .

[33]  Daniel A. Keim,et al.  Visual exploration of large data sets , 2001, Commun. ACM.

[34]  HeerJeffrey,et al.  D3 Data-Driven Documents , 2011 .

[35]  Aashish Chaudhary,et al.  Enhancements to VTK enabling scientific visualization in immersive environments , 2017, 2017 IEEE Virtual Reality (VR).

[36]  Won-Ki Jeong,et al.  DXR: A Toolkit for Building Immersive Data Visualizations , 2019, IEEE Transactions on Visualization and Computer Graphics.

[37]  Charles Perin,et al.  MyBrush: Brushing and Linking with Personal Agency , 2018, IEEE Transactions on Visualization and Computer Graphics.

[38]  Edward R. Tufte,et al.  Envisioning Information , 1990 .

[39]  Yalong Yang,et al.  Origin-Destination Flow Maps in Immersive Environments , 2019, IEEE Transactions on Visualization and Computer Graphics.

[40]  Blair MacIntyre,et al.  DART: a toolkit for rapid design exploration of augmented reality experiences , 2005, ACM Trans. Graph..

[41]  C. C. Law,et al.  ParaView: An End-User Tool for Large-Data Visualization , 2005, The Visualization Handbook.

[42]  Mark Billinghurst,et al.  A wearable spatial conferencing space , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[43]  Julien Jomier,et al.  Tutorial 2: Developing Virtual Reality applications with the Visualization Toolkit (VTK) , 2017 .

[44]  Tim McGraw,et al.  Medical Image Atlas Interaction in Virtual Reality , 2017 .

[45]  Jeffrey Heer,et al.  SpanningAspectRatioBank Easing FunctionS ArrayIn ColorIn Date Interpolator MatrixInterpola NumObjecPointI Rectang ISchedu Parallel Pause Scheduler Sequen Transition Transitioner Transiti Tween Co DelimGraphMLCon IData JSONCon DataField DataSc Dat DataSource Data DataUtil DirtySprite LineS RectSprite , 2011 .

[46]  Daniel A. Keim,et al.  Pixel-Oriented Visualization Techniques for Exploring Very Large Data Bases , 1996 .

[47]  Pierre Dragicevic,et al.  Embedded Data Representations , 2017, IEEE Transactions on Visualization and Computer Graphics.

[48]  Jock D. Mackinlay,et al.  Automating the design of graphical presentations of relational information , 1986, TOGS.

[49]  Mark Bailey,et al.  The Grammar of Graphics , 2007, Technometrics.

[50]  Arvind Satyanarayan,et al.  Vega-Lite: A Grammar of Interactive Graphics , 2018, IEEE Transactions on Visualization and Computer Graphics.

[51]  Christophe Hurter,et al.  FiberClay: Sculpting Three Dimensional Trajectories to Reveal Structural Insights , 2019, IEEE Transactions on Visualization and Computer Graphics.

[52]  Paul S. Strauss,et al.  An object-oriented 3D graphics toolkit , 1992, SIGGRAPH.

[53]  Yalong Yang,et al.  Maps and Globes in Virtual Reality , 2018, Comput. Graph. Forum.