Tangraphe: interactive exploration of network visualizations using single hand, multi-touch gestures

Touch-based displays are becoming a popular medium for interacting with visualizations. Network visualizations are a frequently used class of visualizations across domains to explore entities and relationships between them. However, little work has been done in exploring the design of network visualizations and corresponding interactive tasks such as selection, browsing, and navigation on touch-based displays. Network visualizations on touch-based displays are usually implemented by porting the conventional pointer based interactions as-is to a touch environment and replacing the mouse cursor with a finger. However, this approach does not fully utilize the potential of naturalistic multi-touch gestures afforded by touch displays. We present a set of single hand, multi-touch gestures for interactive exploration of network visualizations and employ these in a prototype system, Tangraphe. We discuss the proposed interactions and how they facilitate a variety of commonly performed network visualization tasks including selection, navigation, adjacency-based exploration, and layout modification. We also discuss advantages of and potential extensions to the proposed set of one-handed interactions including leveraging the non-dominant hand for enhanced interaction, incorporation of additional input modalities, and integration with other devices.

[1]  Niklas Elmqvist,et al.  When David Meets Goliath: Combining Smartwatches with a Large Vertical Display for Visual Data Exploration , 2018, CHI.

[2]  Boris Müller,et al.  mæve - An Interactive Tabletop Installation for Exploring Background Information in Exhibitions , 2009, HCI.

[3]  Mathieu Bastian,et al.  Gephi: An Open Source Software for Exploring and Manipulating Networks , 2009, ICWSM.

[4]  Raimund Dachselt,et al.  GraSp: Combining Spatially‐aware Mobile Devices and a Display Wall for Graph Visualization and Interaction , 2017, Comput. Graph. Forum.

[5]  Jack T Dennerlein,et al.  Wrist and shoulder posture and muscle activity during touch-screen tablet use: effects of usage configuration, tablet type, and interacting hand. , 2013, Work.

[6]  Niklas Elmqvist,et al.  Supporting visual exploration for multiple users in large display environments , 2016, 2016 IEEE Conference on Visual Analytics Science and Technology (VAST).

[7]  Fabrice Matulic,et al.  BodyLenses: Embodied Magic Lenses and Personal Territories for Wall Displays , 2015, ITS.

[8]  Yifan Hu,et al.  Efficient, High-Quality Force-Directed Graph Drawing , 2006 .

[9]  M. Sheelagh T. Carpendale,et al.  Getting practical with interactive tabletop displays: designing for dense data, "fat fingers," diverse interactions, and face-to-face collaboration , 2009, ITS '09.

[10]  O Mason,et al.  Graph theory and networks in Biology. , 2006, IET systems biology.

[11]  Arjan Kuijper,et al.  Visual Analysis of Large Graphs: State‐of‐the‐Art and Future Research Challenges , 2011, Eurographics.

[12]  Danah Boyd,et al.  Vizster: visualizing online social networks , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..

[13]  Niklas Elmqvist,et al.  Fluid interaction for information visualization , 2011, Inf. Vis..

[14]  Emanuel Zgraggen,et al.  PanoramicData: Data Analysis through Pen & Touch , 2014, IEEE Transactions on Visualization and Computer Graphics.

[15]  John T. Stasko,et al.  Natural Language Interfaces for Data Analysis with Visualization: Considering What Has and Could Be Asked , 2017, EuroVis.

[16]  M. Sheelagh T. Carpendale,et al.  Getting practical with interactive tabletop displays: designing for dense data, "fat fingers," diverse interactions, and face-to-face collaboration , 2009, ITS '09.

[17]  John T. Stasko,et al.  Tasks for Multivariate Network Analysis , 2013, Multivariate Network Visualization.

[18]  John T. Stasko,et al.  Designing Multiple Coordinated Visualizations for Tablets , 2016, Comput. Graph. Forum.

[19]  John T. Stasko,et al.  Orko: Facilitating Multimodal Interaction for Visual Exploration and Analysis of Networks , 2018, IEEE Transactions on Visualization and Computer Graphics.

[20]  Monica M. C. Schraefel,et al.  TouchViz: a case study comparing two interfaces for data analytics on tablets , 2013, CHI.

[21]  Jean-Daniel Fekete,et al.  Author Manuscript, Published in "sigchi Conference on Human Factors in Computing Systems Topology-aware Navigation in Large Networks , 2022 .

[22]  M. Sheelagh T. Carpendale,et al.  A set of multi-touch graph interaction techniques , 2010, ITS '10.

[23]  Rahul C. Basole,et al.  ecoxight , 2018, ACM Trans. Manag. Inf. Syst..

[24]  Raimund Dachselt,et al.  Investigating multi-touch and pen gestures for diagram editing on interactive surfaces , 2009, ITS '09.

[25]  Wendy E. Mackay,et al.  BiTouch and BiPad: designing bimanual interaction for hand-held tablets , 2012, CHI.

[26]  John T. Stasko,et al.  Designing and implementing an interactive scatterplot visualization for a tablet computer , 2014, AVI.

[27]  Florian Alt,et al.  Using on-body displays for extending the output of wearable devices , 2016, PerDis.

[28]  John T. Stasko,et al.  The Science of Interaction , 2009, Inf. Vis..

[29]  Jean-Daniel Fekete,et al.  Task taxonomy for graph visualization , 2006, BELIV '06.

[30]  John T. Stasko,et al.  Expanding Selection for Information Visualization Systems on Tablet Devices , 2016, ISS.

[31]  Stephen G. Kobourov,et al.  Group-Level Graph Visualization Taxonomy , 2014, EuroVis.

[32]  Bruce H. Thomas,et al.  Immersive Collaborative Analysis of Network Connectivity: CAVE-style or Head-Mounted Display? , 2017, IEEE Transactions on Visualization and Computer Graphics.

[33]  John T. Stasko,et al.  Toward a Deeper Understanding of the Role of Interaction in Information Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.

[34]  Andreas Holzinger,et al.  Multi-touch Graph-Based Interaction for Knowledge Discovery on Mobile Devices: State-of-the-Art and Future Challenges , 2014, Interactive Knowledge Discovery and Data Mining in Biomedical Informatics.

[35]  Trey Ideker,et al.  Cytoscape 2.8: new features for data integration and network visualization , 2010, Bioinform..

[36]  Ivan Herman,et al.  Graph Visualization and Navigation in Information Visualization: A Survey , 2000, IEEE Trans. Vis. Comput. Graph..

[37]  Jeffrey Heer,et al.  Generalized selection via interactive query relaxation , 2008, CHI.

[38]  M. Sheelagh T. Carpendale,et al.  Beyond Mouse and Keyboard: Expanding Design Considerations for Information Visualization Interactions , 2012, IEEE Transactions on Visualization and Computer Graphics.

[39]  M. Sheelagh T. Carpendale,et al.  SketchInsight: Natural data exploration on interactive whiteboards leveraging pen and touch interaction , 2015, 2015 IEEE Pacific Visualization Symposium (PacificVis).

[40]  Petra Isenberg,et al.  Collaborative Brushing and Linking for Co‐located Visual Analytics of Document Collections , 2009, Comput. Graph. Forum.

[41]  Yehuda Koren,et al.  Improved Circular Layouts , 2006, GD.