Orchard: Exploring Multivariate Heterogeneous Networks on Mobile Phones

People are becoming increasingly sophisticated in their ability to navigate information spaces using search, hyperlinks, and visualization. But, mobile phones preclude the use of multiple coordinated views that have proven effective in the desktop environment (e.g., for business intelligence or visual analytics). In this work, we propose to model information as multivariate heterogeneous networks to enable greater analytic expression for a range of sensemaking tasks while suggesting a new, list‐based paradigm with gestural navigation of structured information spaces on mobile phones. We also present a mobile application, called Orchard, which combines ideas from both faceted search and interactive network exploration in a visual query language to allow users to collect facets of interest during exploratory navigation. Our study showed that users could collect and combine these facets with Orchard, specifying network queries and projections that would only have been possible previously using complex data tools or custom data science.

[1]  Desney S. Tan,et al.  FacetLens: exposing trends and relationships to support sensemaking within faceted datasets , 2009, CHI.

[2]  Martin Wattenberg,et al.  Visual exploration of multivariate graphs , 2006, CHI.

[3]  Gerrit C. van der Veer,et al.  CHI '05 Extended Abstracts on Human Factors in Computing Systems , 2005, CHI 2005.

[4]  W. Bruce Croft,et al.  Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2013 .

[5]  Aniket Kittur,et al.  Kinetica: naturalistic multi-touch data visualization , 2014, CHI.

[6]  Pierre Dragicevic,et al.  GraphDice: A System for Exploring Multivariate Social Networks , 2010, Comput. Graph. Forum.

[7]  Jeffrey Heer,et al.  Online Submission ID : 0 Orion : A System for Modeling , Transformation and Visualization of Multidimensional Heterogeneous Networks , 2012 .

[8]  Tina Eliassi-Rad,et al.  Visual Analysis of Large Heterogeneous Social Networks by Semantic and Structural Abstraction , 2006 .

[9]  Monica M. C. Schraefel,et al.  TouchViz: a case study comparing two interfaces for data analytics on tablets , 2013, CHI.

[10]  Jeffrey Heer,et al.  imMens: Real‐time Visual Querying of Big Data , 2013, Comput. Graph. Forum.

[11]  Aniket Kittur,et al.  Apolo: making sense of large network data by combining rich user interaction and machine learning , 2011, CHI.

[12]  Bongshin Lee,et al.  Data Visualization on Mobile Devices , 2018, CHI Extended Abstracts.

[13]  Mary Czerwinski,et al.  FaThumb: a facet-based interface for mobile search , 2006, CHI.

[14]  Jarke J. van Wijk,et al.  Multivariate Network Exploration and Presentation: From Detail to Overview via Selections and Aggregations , 2014, IEEE Transactions on Visualization and Computer Graphics.

[15]  Ryen W. White,et al.  Exploratory Search: Beyond the Query-Response Paradigm , 2009, Exploratory Search: Beyond the Query-Response Paradigm.

[16]  Susan T. Dumais,et al.  PivotPaths: Strolling through Faceted Information Spaces , 2012, IEEE Transactions on Visualization and Computer Graphics.

[17]  John T. Stasko,et al.  Tasks for Multivariate Network Analysis , 2013, Multivariate Network Visualization.

[18]  John T. Stasko,et al.  Designing Multiple Coordinated Visualizations for Tablets , 2016, Comput. Graph. Forum.

[19]  Gary Marchionini,et al.  Exploratory search , 2006, Commun. ACM.

[20]  Matthieu Latapy,et al.  Basic notions for the analysis of large two-mode networks , 2008, Soc. Networks.

[21]  Yizhou Sun,et al.  Mining Heterogeneous Information Networks: Principles and Methodologies , 2012, Mining Heterogeneous Information Networks: Principles and Methodologies.

[22]  Hanghang Tong,et al.  g-Miner: Interactive Visual Group Mining on Multivariate Graphs , 2015, CHI.

[23]  Theresa-Marie Rhyne,et al.  Reaching Broader Audiences With Data Visualization , 2020, IEEE Computer Graphics and Applications.

[24]  Alex Endert,et al.  Visual Graph Query Construction and Refinement , 2017, SIGMOD Conference.

[25]  Arjan Kuijper,et al.  Visual Analysis of Large Graphs: State‐of‐the‐Art and Future Research Challenges , 2011, Eurographics.

[26]  M. Sheelagh T. Carpendale,et al.  TouchWave: kinetic multi-touch manipulation for hierarchical stacked graphs , 2012, ITS.

[27]  Alexander Lex,et al.  Juniper: A Tree+Table Approach to Multivariate Graph Visualization , 2018, IEEE Transactions on Visualization and Computer Graphics.

[28]  Kevin Li,et al.  Faceted metadata for image search and browsing , 2003, CHI '03.

[29]  M. Sheelagh T. Carpendale,et al.  Beyond Mouse and Keyboard: Expanding Design Considerations for Information Visualization Interactions , 2012, IEEE Transactions on Visualization and Computer Graphics.

[30]  Desney S. Tan,et al.  FacetMap: A Scalable Search and Browse Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[31]  Bongshin Lee,et al.  TouchPivot: Blending WIMP & Post-WIMP Interfaces for Data Exploration on Tablet Devices , 2017, CHI.

[32]  John T. Stasko,et al.  Ploceus: Modeling, visualizing, and analyzing tabular data as networks , 2014, Inf. Vis..

[33]  Jian Zhao,et al.  Interactive Exploration of Implicit and Explicit Relations in Faceted Datasets , 2013, IEEE Transactions on Visualization and Computer Graphics.

[34]  Catherine Plaisant,et al.  NetLens: Iterative Exploration of Content-Actor Network Data , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[35]  Christos Faloutsos,et al.  GRAPHITE: A Visual Query System for Large Graphs , 2008, 2008 IEEE International Conference on Data Mining Workshops.

[36]  Bongshin Lee,et al.  GraphTrail: analyzing large multivariate, heterogeneous networks while supporting exploration history , 2012, CHI.

[37]  Bongshin Lee,et al.  Mobile Data Visualization (Dagstuhl Seminar 19292) , 2019, Dagstuhl Reports.

[38]  Carsten Binnig,et al.  Vizdom: Interactive Analytics through Pen and Touch , 2015, Proc. VLDB Endow..

[39]  Ben Shneiderman,et al.  A Task Taxonomy for Network Evolution Analysis , 2014, IEEE Transactions on Visualization and Computer Graphics.

[40]  Darren Edge,et al.  Bringing AI to BI: Enabling Visual Analytics of Unstructured Data in a Modern Business Intelligence Platform , 2018, CHI Extended Abstracts.

[41]  Emanuel Zgraggen,et al.  PanoramicData: Data Analysis through Pen & Touch , 2014, IEEE Transactions on Visualization and Computer Graphics.

[42]  Shuigeng Zhou,et al.  VOGUE: Towards A Visual Interaction-aware Graph Query Processing Framework , 2013, CIDR.

[43]  John T. Stasko,et al.  Tangraphe: interactive exploration of network visualizations using single hand, multi-touch gestures , 2018, AVI.

[44]  M. Sheelagh T. Carpendale,et al.  SketchInsight: Natural data exploration on interactive whiteboards leveraging pen and touch interaction , 2015, 2015 IEEE Pacific Visualization Symposium (PacificVis).

[45]  Charles A. Sutton,et al.  GEMSEC: Graph Embedding with Self Clustering , 2018, 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[46]  Jean-Daniel Fekete,et al.  Task taxonomy for graph visualization , 2006, BELIV '06.

[47]  Jafar Adibi,et al.  The Enron Email Dataset Database Schema and Brief Statistical Report , 2004 .

[48]  Frank van Ham,et al.  “Search, Show Context, Expand on Demand”: Supporting Large Graph Exploration with Degree-of-Interest , 2009, IEEE Transactions on Visualization and Computer Graphics.

[49]  M. Sheelagh T. Carpendale,et al.  A set of multi-touch graph interaction techniques , 2010, ITS '10.

[50]  Brendan T. O'Connor,et al.  Learning Latent Personas of Film Characters , 2013, ACL.

[51]  Mary Czerwinski,et al.  Understanding research trends in conferences using paperLens , 2005, CHI Extended Abstracts.

[52]  Darren Edge,et al.  Trimming the Hairball: Edge Cutting Strategies for Making Dense Graphs Usable , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[53]  Gary Marchionini,et al.  Synthesis Lectures on Information Concepts, Retrieval, and Services , 2009 .