A Model of Spatial Directness in Interactive Visualization

We discuss the concept of directness in the context of spatial interaction with visualization. In particular, we propose a model that allows practitioners to analyze and describe the spatial directness of interaction techniques, ultimately to be able to better understand interaction issues that may affect usability. To reach these goals, we distinguish between different types of directness. Each type of directness depends on a particular mapping between different spaces, for which we consider the data space, the visualization space, the output space, the user space, the manipulation space, and the interaction space. In addition to the introduction of the model itself, we also show how to apply it to several real-world interaction scenarios in visualization, and thus discuss the resulting types of spatial directness, without recommending either more direct or more indirect interaction techniques. In particular, we will demonstrate descriptive and evaluative usage of the proposed model, and also briefly discuss its generative usage.

[1]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[2]  Jarke J. van Wijk,et al.  The value of visualization , 2005, VIS 05. IEEE Visualization, 2005..

[3]  Erik Nilsen,et al.  Device comparisons for goal-directed drawing tasks , 1994, CHI '94.

[4]  Deborah Silver,et al.  Object-oriented visualization , 1995, IEEE Computer Graphics and Applications.

[5]  Alfred Inselberg,et al.  The plane with parallel coordinates , 1985, The Visual Computer.

[6]  Ben Shneiderman,et al.  The future of interactive systems and the emergence of direct manipulation , 1982 .

[7]  Tim Dwyer,et al.  Design space for spatio-data coordination: Tangible interaction devices for immersive information visualisation , 2017, 2017 IEEE Pacific Visualization Symposium (PacificVis).

[8]  Heidrun Schumann,et al.  Visualization Pipeline , 2009, Encyclopedia of Database Systems.

[9]  Fotis Sotiropoulos,et al.  Slice WIM: a multi-surface, multi-touch interface for overview+detail exploration of volume datasets in virtual reality , 2011, SI3D.

[10]  Markus Hadwiger,et al.  GPU-Based High-Quality Volume Rendering For Virtual Environments , 2006 .

[11]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[12]  Doug A. Bowman,et al.  Formalizing the Design, Evaluation, and Application of Interaction Techniques for Immersive Virtual Environments , 1999, J. Vis. Lang. Comput..

[13]  Ferran Argelaguet,et al.  A survey of 3D object selection techniques for virtual environments , 2013, Comput. Graph..

[14]  Timo Ropinski,et al.  Inviwo - An extensible, multi-purpose visualization framework , 2015, 2015 IEEE Scientific Visualization Conference (SciVis).

[15]  Ben Shneiderman,et al.  High Precision Touchscreens: Design Strategies and Comparisons with a Mouse , 1991, Int. J. Man Mach. Stud..

[16]  Paul Vickers,et al.  Understanding Visualization: A Formal Approach Using Category Theory and Semiotics , 2013, IEEE Transactions on Visualization and Computer Graphics.

[17]  Chi-Wing Fu,et al.  Multi-touch techniques for exploring large-scale 3D astrophysical simulations , 2010, CHI.

[18]  Tobias Isenberg,et al.  Efficient Structure-Aware Selection Techniques for 3D Point Cloud Visualizations with 2DOF Input , 2012, IEEE Transactions on Visualization and Computer Graphics.

[19]  John T. Stasko,et al.  Designing and implementing an interactive scatterplot visualization for a tablet computer , 2014, AVI.

[20]  Frans Vos,et al.  WYSIWYP: What You See Is What You Pick , 2012, IEEE Transactions on Visualization and Computer Graphics.

[21]  Tobias Isenberg,et al.  Hybrid Tactile/Tangible Interaction for 3D Data Exploration , 2017, IEEE Transactions on Visualization and Computer Graphics.

[22]  Hans-Werner Gellersen,et al.  Comparing indirect and direct touch in a stereoscopic interaction task , 2015, 2015 IEEE Symposium on 3D User Interfaces (3DUI).

[23]  Chaoli Wang,et al.  Information Theory in Scientific Visualization , 2011, Entropy.

[24]  Benjamin Weyers,et al.  Visual Quality Adjustment for Volume Rendering in a Head-Tracked Virtual Environment , 2016, IEEE Transactions on Visualization and Computer Graphics.

[25]  Pierre Dragicevic,et al.  Rolling the Dice: Multidimensional Visual Exploration using Scatterplot Matrix Navigation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[26]  John Stasko,et al.  Hands-On , Large Display Visual Data Exploration , 2015 .

[27]  Aaron J. Quigley,et al.  Factors influencing visual attention switch in multi-display user interfaces: a survey , 2012, PerDis.

[28]  Sowmya Somanath,et al.  "Point it, split it, peel it, view it": techniques for interactive reservoir visualization on tabletops , 2011, ITS '11.

[29]  Tobias Höllerer,et al.  Stereoscopic Highlighting: 2D Graph Visualization on Stereo Displays , 2011, IEEE Transactions on Visualization and Computer Graphics.

[30]  Min Chen,et al.  An Information-theoretic Framework for Visualization , 2010, IEEE Transactions on Visualization and Computer Graphics.

[31]  Andreas Butz,et al.  What you see is what you touch: visualizing touch screen interaction in the head-up display , 2014, Conference on Designing Interactive Systems.

[32]  Robert Kosara Indirect multi-touch interaction for brushing in parallel coordinates , 2011, Electronic Imaging.

[33]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[34]  Richard Brath,et al.  3D InfoVis is here to stay: Deal with it , 2014, 2014 IEEE VIS International Workshop on 3DVis (3DVis).

[35]  Tovi Grossman,et al.  Multi-finger gestural interaction with 3d volumetric displays , 2004, UIST '04.

[36]  Tobias Isenberg,et al.  Towards An Understanding of Mobile Touch Navigation in a Stereoscopic Viewing Environment for 3D Data Exploration , 2016, IEEE Transactions on Visualization and Computer Graphics.

[37]  Raimund Dachselt,et al.  Going beyond the surface: studying multi-layer interaction above the tabletop , 2012, CHI.

[38]  Andreas Buja,et al.  Interactive data visualization using focusing and linking , 1991, Proceeding Visualization '91.

[39]  Heidi Lam,et al.  A Framework of Interaction Costs in Information Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[40]  Gabriel Robles-De-La-Torre,et al.  The importance of the sense of touch in virtual and real environments , 2006, IEEE MultiMedia.

[41]  William Ribarsky,et al.  Visual analytics for complex concepts using a human cognition model , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[42]  Richard A. Becker,et al.  Brushing scatterplots , 1987 .

[43]  Lijie Xu,et al.  An Information-Theoretic Framework for Flow Visualization , 2010, IEEE Transactions on Visualization and Computer Graphics.

[44]  John J. Bertin,et al.  The semiology of graphics , 1983 .

[45]  Muhanna Muhanna,et al.  Virtual reality and the CAVE: Taxonomy, interaction challenges and research directions , 2015, J. King Saud Univ. Comput. Inf. Sci..

[46]  Pierre Dragicevic,et al.  An Interaction Model for Visualizations Beyond The Desktop , 2013, IEEE Transactions on Visualization and Computer Graphics.

[47]  Ricardo Langner,et al.  Investigating the Use of Spatial Interaction for 3D Data Visualization on Mobile Devices , 2017, ISS.

[48]  Min Chen,et al.  What May Visualization Processes Optimize? , 2015, IEEE Transactions on Visualization and Computer Graphics.

[49]  Daniel Baum,et al.  Perceptually Linear Parameter Variations , 2012, Comput. Graph. Forum.

[50]  Mark Billinghurst,et al.  Better Realising Direct Manipulation , 2005 .

[51]  Martin Wattenberg,et al.  Direct-Manipulation Visualization of Deep Networks , 2017, ArXiv.

[52]  Matthew O. Ward,et al.  Interaction spaces in data and information visualization , 2004, VISSYM'04.

[53]  David E. Kieras,et al.  Towards demystification of direct manipulation: cognitive modeling charts the gulf of execution , 2001, CHI.

[54]  Tony DeRose,et al.  Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation , 2009, Graphics Interface.

[55]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[56]  Chris R. Johnson Top Scientific Visualization Research Problems , 2004, IEEE Computer Graphics and Applications.

[57]  Timo Ropinski,et al.  Tools and Techniques for Direct Volume Interaction , 2015, Eurographics.

[58]  Graham J. Wills,et al.  Linked Data Views , 2008 .

[59]  Martin Hachet,et al.  Multi-touch RST in 2D and 3D spaces: Studying the impact of directness on user performance , 2011, 2011 IEEE Symposium on 3D User Interfaces (3DUI).

[60]  H. Rex Hartson,et al.  Cognitive, physical, sensory, and functional affordances in interaction design , 2003, Behav. Inf. Technol..

[61]  Tobias Isenberg,et al.  FI3D: Direct-Touch Interaction for the Exploration of 3D Scientific Visualization Spaces , 2010, IEEE Transactions on Visualization and Computer Graphics.

[62]  Ivan Poupyrev,et al.  Tactile interfaces for small touch screens , 2003, UIST '03.

[63]  Martin Hachet,et al.  tBox: a 3d transformation widget designed for touch-screens , 2011, CHI.

[64]  Paolo Sabella,et al.  A rendering algorithm for visualizing 3D scalar fields , 1988, SIGGRAPH.

[65]  Saul Greenberg,et al.  Proxemic interaction: designing for a proximity and orientation-aware environment , 2010, ITS '10.

[66]  John T. Stasko,et al.  Toward a Deeper Understanding of the Role of Interaction in Information Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.

[67]  Michael Gertz,et al.  A Model and Framework for Visualization Exploration , 2007, IEEE Transactions on Visualization and Computer Graphics.

[68]  Peng Song,et al.  WYSIWYF: exploring and annotating volume data with a tangible handheld device , 2011, CHI.

[69]  J. Rolland,et al.  Head-worn displays: a review , 2006, Journal of Display Technology.

[70]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[71]  William Ribarsky,et al.  How locus of control influences compatibility with visualization style , 2011, 2011 IEEE Conference on Visual Analytics Science and Technology (VAST).

[72]  John T. Stasko,et al.  Distributed Cognition as a Theoretical Framework for Information Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[73]  David H. Laidlaw,et al.  The application visualization system: a computational environment for scientific visualization , 1989, IEEE Computer Graphics and Applications.

[74]  Ken Shoemake,et al.  ARCBALL: a user interface for specifying three-dimensional orientation using a mouse , 1992 .

[75]  Tobias Isenberg,et al.  CAST: Effective and Efficient User Interaction for Context-Aware Selection in 3D Particle Clouds , 2016, IEEE Transactions on Visualization and Computer Graphics.

[76]  Jun Rekimoto,et al.  Fairy lights in femtoseconds: aerial and volumetric graphics rendered by focused femtosecond laser combined with computational holographic fields , 2015, SIGGRAPH Emerging Technologies.

[77]  Heidrun Schumann,et al.  Tangible views for information visualization , 2010, ITS '10.

[78]  Mark Billinghurst,et al.  Accounting for user familiarity in user interfaces , 2006, CHINZ '06.

[79]  Bernhard Preim,et al.  Visual Computing for Medicine: Theory, Algorithms, and Applications , 2007 .

[80]  Tamara Munzner,et al.  Visualization Analysis and Design , 2014, A.K. Peters visualization series.

[81]  Jarke J. van Wijk,et al.  Views on Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[82]  Kai Bürger,et al.  Direct Volume Editing , 2008, IEEE Transactions on Visualization and Computer Graphics.

[83]  James D. Hollan,et al.  Direct Manipulation Interfaces , 1985, Hum. Comput. Interact..

[84]  Klaus Mueller,et al.  Eurographics/ Ieee-vgtc Symposium on Visualization 2008 Illustrative Parallel Coordinates , 2022 .

[85]  François Bérard,et al.  Study of the effect of the directness of the interaction on novice users when drawing straight lines , 2015, IHM.

[86]  Stefan Bruckner,et al.  Contextual picking of volumetric structures , 2009, 2009 IEEE Pacific Visualization Symposium.

[87]  Daniel M. Johnson,et al.  Enhancing physicality in touch interaction with programmable friction , 2011, CHI.

[88]  Kenji Ono,et al.  Top computational visualization R&D problems 2015: panel , 2015, SIGGRAPH Asia Visualization in High Performance Computing.

[89]  Min Chen,et al.  Visual Multiplexing , 2014, Comput. Graph. Forum.

[90]  Jeffrey Heer,et al.  Visual Embedding: A Model for Visualization , 2014, IEEE Computer Graphics and Applications.

[91]  Matthew O. Ward,et al.  Theoretical Foundations of Information Visualization , 2008, Information Visualization.

[92]  Bill Hibbard,et al.  Top ten visualization problems , 1999, COMG.

[93]  Patrick Baudisch,et al.  The generalized perceived input point model and how to double touch accuracy by extracting fingerprints , 2010, CHI.

[94]  Fotis Sotiropoulos,et al.  Interactive Slice WIM: Navigating and Interrogating Volume Data Sets Using a Multisurface, Multitouch VR Interface , 2012, IEEE Transactions on Visualization and Computer Graphics.

[95]  Daniel A. Keim,et al.  Visual Analytics: Definition, Process, and Challenges , 2008, Information Visualization.

[96]  Anders Ynnerman,et al.  Interactive visualization of 3d scanned mummies at public venues , 2016, Commun. ACM.

[97]  Carlos Eduardo Scheidegger,et al.  An Algebraic Process for Visualization Design , 2014, IEEE Transactions on Visualization and Computer Graphics.

[98]  Michel Beaudouin-Lafon,et al.  Instrumental interaction: an interaction model for designing post-WIMP user interfaces , 2000, CHI.

[99]  Tobias Isenberg Interactive Exploration of Three-Dimensional Scientific Visualizations on Large Display Surfaces , 2016, Collaboration Meets Interactive Spaces.

[100]  Dominik Schmidt,et al.  A Comparison of Direct and Indirect Multi-touch Input for Large Surfaces , 2009, INTERACT.

[101]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.