A Design Study of Direct‐Touch Interaction for Exploratory 3D Scientific Visualization

We present an interaction design study of several non‐overlapping direct‐touch interaction widgets, postures, and bi‐manual techniques to support the needs of scientists who are exploring a dataset. The final interaction design supports navigation/zoom, cutting plane interaction, a drilling exploration, the placement of seed particles in 3D space, and the exploration of temporal data evolution. To ground our design, we conducted a requirements analysis and used a participatory design approach throughout development. We chose simulations in the field of fluid mechanics as our example domain and, in the paper, discuss our choice of techniques, their adaptation to our target domain, and discuss how they facilitate the necessary combination of visualization control and data exploration. We evaluated our resulting interactive data exploration system with seven fluid mechanics experts and report on their qualitative feedback. While we use flow visualization as our application domain, the developed techniques were designed with generalizability in mind and we discuss several implications of our work on further development of direct‐touch data exploration techniques for scientific visualization in general.

[1]  Tobias Isenberg,et al.  Gestures vs. Postures: 'Gestural' Touch Interaction in 3D Environments , 2012, CHI 2012.

[2]  Tony DeRose,et al.  Eden: a professional multitouch tool for constructing virtual organic environments , 2011, CHI.

[3]  Yvonne Rogers,et al.  Collaborating around vertical and horizontal large interactive displays: which way is best? , 2004, Interact. Comput..

[4]  Chi-Wing Fu,et al.  Multi-touch techniques for exploring large-scale 3D astrophysical simulations , 2010, CHI.

[5]  Chris North,et al.  Information Visualization , 2008, Lecture Notes in Computer Science.

[6]  Abigail Sellen,et al.  The Prevention of Mode Errors Through Sensory Feedback , 1992, Hum. Comput. Interact..

[7]  Sowmya Somanath,et al.  "Point it, split it, peel it, view it": techniques for interactive reservoir visualization on tabletops , 2011, ITS '11.

[8]  Tony DeRose,et al.  Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation , 2009, Graphics Interface.

[9]  M. Sheelagh T. Carpendale,et al.  Shallow-depth 3d interaction: design and evaluation of one-, two- and three-touch techniques , 2007, CHI.

[10]  Philip L. Davidson,et al.  A screen-space formulation for 2D and 3D direct manipulation , 2009, UIST '09.

[11]  Martin Hachet,et al.  Navidget for Easy 3D Camera Positioning from 2D Inputs , 2008, 2008 IEEE Symposium on 3D User Interfaces.

[12]  Ehud Sharlin,et al.  Touching the depths: introducing tabletop interaction to reservoir engineering , 2010, ITS '10.

[13]  Thomas Butkiewicz,et al.  Multi-touch 3D exploratory analysis of ocean flow models , 2011, OCEANS'11 MTS/IEEE KONA.

[14]  Martin Hachet,et al.  tBox: a 3d transformation widget designed for touch-screens , 2011, CHI.

[15]  Tobias Isenberg,et al.  Interactive Exploratory Visualization of 2D Vector Fields , 2008, Comput. Graph. Forum.

[16]  Tobias Isenberg,et al.  FI3D: Direct-Touch Interaction for the Exploration of 3D Scientific Visualization Spaces , 2010, IEEE Transactions on Visualization and Computer Graphics.

[17]  William Buxton,et al.  Usability evaluation considered harmful (some of the time) , 2008, CHI.

[18]  Dimitre Novatchev,et al.  Chunking and Phrasing and the Design of Human-Computer Dialogues - Response , 1986, IFIP Congress.

[19]  Tobias Isenberg,et al.  Position Paper: Touch Interaction in Scientific Visualization , 2011 .

[20]  Anders Ynnerman,et al.  Multi-Touch Table System for Medical Visualization: Application to Orthopedic Surgery Planning , 2011, IEEE Transactions on Visualization and Computer Graphics.

[21]  Raimund Dachselt,et al.  Investigating multi-touch and pen gestures for diagram editing on interactive surfaces , 2009, ITS '09.

[22]  Yvonne Rogers,et al.  Collaboration and interference: awareness with mice or touch input , 2008, CSCW.

[23]  Daniel F. Keefe.  Integrating Visualization and Interaction Research to Improve Scientific Workflows , 2010, IEEE Computer Graphics and Applications.

[24]  David Borland,et al.  Rainbow Color Map (Still) Considered Harmful , 2007, IEEE Computer Graphics and Applications.

[25]  Douglas Schuler,et al.  Participatory Design: Principles and Practices , 1993 .

[26]  G. Haller.  Distinguished material surfaces and coherent structures in three-dimensional fluid flows , 2001 .

[27]  Chris North,et al.  Understanding Multi-touch Manipulation for Surface Computing , 2009, INTERACT.

[28]  Enrico Costanza,et al.  TUIO: A Protocol for Table-Top Tangible User Interfaces , 2005 .

[29]  Fotis Sotiropoulos,et al.  Slice WIM: a multi-surface, multi-touch interface for overview+detail exploration of volume datasets in virtual reality , 2011, SI3D.

[30]  Clifton Forlines,et al.  DTLens: multi-user tabletop spatial data exploration , 2005, UIST.

[31]  M. Sheelagh T. Carpendale,et al.  Evaluating Information Visualizations , 2008, Information Visualization.

[32]  Robles-De-La-TorreGabriel.  The Importance of the Sense of Touch in Virtual and Real Environments , 2006 .

[33]  Petra Isenberg,et al.  Collaborative Brushing and Linking for Co‐located Visual Analytics of Document Collections , 2009, Comput. Graph. Forum.

[34]  M. Sheelagh T. Carpendale,et al.  Lark: Coordinating Co-located Collaboration with Information Visualization , 2009, IEEE Transactions on Visualization and Computer Graphics.

[35]  Gabriel Robles-De-La-Torre,et al.  The importance of the sense of touch in virtual and real environments , 2006, IEEE MultiMedia.

[36]  M. Sheelagh T. Carpendale,et al.  Sticky tools: full 6DOF force-based interaction for multi-touch tables , 2009, ITS '09.