ChartSeer: Interactive Steering Exploratory Visual Analysis With Machine Intelligence

During exploratory visual analysis (EVA), analysts need to continually determine which subsequent activities to perform, such as which data variables to explore or how to present data variables visually. Due to the vast combinations of data variables and visual encodings that are possible, it is often challenging to make such decisions. Further, while performing local explorations, analysts often fail to attend to the holistic picture that is emerging from their analysis, leading them to improperly steer their EVA. These issues become even more impactful in the real world analysis scenarios where EVA occurs in multiple asynchronous sessions that could be completed by one or more analysts. To address these challenges, this work proposes ChartSeer, a system that uses machine intelligence to enable analysts to visually monitor the current state of an EVA and effectively identify future activities to perform. ChartSeer utilizes deep learning techniques to characterize analyst-created data charts to generate visual summaries and recommend appropriate charts for further exploration based on user interactions. A case study was first conducted to demonstrate the usage of ChartSeer in practice, followed by a controlled study to compare ChartSeer's performance with a baseline during EVA tasks. The results demonstrated that ChartSeer enables analysts to adequately understand current EVA status and advance their analysis by creating charts with increased coverage and visual encoding diversity.

[1]  Martin Wattenberg,et al.  Designing for social data analysis , 2006, IEEE Transactions on Visualization and Computer Graphics.

[2]  Melanie Tory,et al.  Visualizing Dimension Coverage to Support Exploratory Analysis , 2017, IEEE Transactions on Visualization and Computer Graphics.

[3]  Hans Hagen,et al.  Collaborative visualization: Definition, challenges, and research agenda , 2011, Inf. Vis..

[4]  Stefan Pietschmann,et al.  Context-aware Recommendation of Visualization Components , 2012 .

[5]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[6]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[7]  Stefan Bruckner,et al.  Visual Parameter Space Analysis: A Conceptual Framework , 2014, IEEE Transactions on Visualization and Computer Graphics.

[8]  Jian Zhao,et al.  Annotation Graphs: A Graph-Based Visualization for Meta-Analysis of Data Based on User-Authored Annotations , 2017, IEEE Transactions on Visualization and Computer Graphics.

[9]  Jian Zhao,et al.  Flexible Learning with Semantic Visual Exploration and Sequence-Based Recommendation of MOOC Videos , 2018, CHI.

[10]  Jock D. Mackinlay,et al.  Automating the design of graphical presentations of relational information , 1986, TOGS.

[11]  Min Chen,et al.  From Web Data to Visualization via Ontology Mapping , 2008, Comput. Graph. Forum.

[12]  M. Braga,et al.  Exploratory Data Analysis , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[13]  Bongshin Lee,et al.  A Deeper Understanding of Sequence in Narrative Visualization , 2013, IEEE Transactions on Visualization and Computer Graphics.

[14]  M. Sheelagh T. Carpendale,et al.  Lark: Coordinating Co-located Collaboration with Information Visualization , 2009, IEEE Transactions on Visualization and Computer Graphics.

[15]  Tim Kraska,et al.  VizML: A Machine Learning Approach to Visualization Recommendation , 2018, CHI.

[16]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[17]  Jian Zhao,et al.  Supporting Handoff in Asynchronous Collaborative Sensemaking Using Knowledge-Transfer Graphs , 2018, IEEE Transactions on Visualization and Computer Graphics.

[18]  Leilani Battle,et al.  Characterizing Exploratory Visual Analysis: A Literature Review and Evaluation of Analytic Provenance in Tableau , 2019, Comput. Graph. Forum.

[19]  John Hunter,et al.  Matplotlib , 2020, Learning Scientific Programming with Python.

[20]  Melanie Tory,et al.  Supporting Communication and Coordination in Collaborative Sensemaking , 2014, IEEE Transactions on Visualization and Computer Graphics.

[21]  Kanit Wongsuphasawat,et al.  Voyager 2: Augmenting Visual Analysis with Partial View Specifications , 2017, CHI.

[22]  Jeffrey Heer,et al.  Reverse‐Engineering Visualizations: Recovering Visual Encodings from Chart Images , 2017, Comput. Graph. Forum.

[23]  Guoliang Li,et al.  DeepEye: Towards Automatic Data Visualization , 2018, 2018 IEEE 34th International Conference on Data Engineering (ICDE).

[24]  Melanie Tory,et al.  Exploiting analysis history to support collaborative data analysis , 2015, Graphics Interface.

[25]  Peter Pirolli,et al.  Information Foraging , 2009, Encyclopedia of Database Systems.

[26]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[27]  M. Sheelagh T. Carpendale,et al.  Bubble Sets: Revealing Set Relations with Isocontours over Existing Visualizations , 2009, IEEE Transactions on Visualization and Computer Graphics.

[28]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[29]  Frank E. Curtis,et al.  A quasi-Newton algorithm for nonconvex, nonsmooth optimization with global convergence guarantees , 2015, Math. Program. Comput..

[30]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[31]  Gilles Venturini,et al.  VizAssist: an interactive user assistant for visual data mining , 2016, The Visual Computer.

[32]  Chris North,et al.  Semantics of Directly Manipulating Spatializations , 2013, IEEE Transactions on Visualization and Computer Graphics.

[33]  Stephen M. Casner,et al.  Task-analytic approach to the automated design of graphic presentations , 1991, TOGS.

[34]  Michael C. Hout,et al.  Multidimensional Scaling , 2003, Encyclopedic Dictionary of Archaeology.

[35]  Martin Wattenberg,et al.  Voyagers and voyeurs: supporting asynchronous collaborative information visualization , 2007, CHI.

[36]  Younghoon Kim,et al.  GraphScape: A Model for Automated Reasoning about Visualization Similarity and Sequencing , 2017, CHI.

[37]  Jaakko Peltonen,et al.  Information retrieval approach to meta-visualization , 2014, Machine Learning.

[38]  Jeffrey Heer,et al.  CommentSpace: structured support for collaborative visual analysis , 2011, CHI.

[39]  Pat Hanrahan,et al.  Show Me: Automatic Presentation for Visual Analysis , 2007, IEEE Transactions on Visualization and Computer Graphics.

[40]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[41]  Marco Cavallo,et al.  A Visual Interaction Framework for Dimensionality Reduction Based Data Exploration , 2018, CHI.

[42]  Arvind Satyanarayan,et al.  Vega-Lite: A Grammar of Interactive Graphics , 2018, IEEE Transactions on Visualization and Computer Graphics.

[43]  Ian H. Witten,et al.  Data Mining: Practical Machine Learning Tools and Techniques, 3/E , 2014 .

[44]  Jeffrey Heer,et al.  Formalizing Visualization Design Knowledge as Constraints: Actionable and Extensible Models in Draco , 2018, IEEE Transactions on Visualization and Computer Graphics.

[45]  Jeffrey Heer,et al.  Visual Embedding: A Model for Visualization , 2014, IEEE Computer Graphics and Applications.

[46]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[47]  Pierre Dragicevic,et al.  Time Curves: Folding Time to Visualize Patterns of Temporal Evolution in Data , 2016, IEEE Transactions on Visualization and Computer Graphics.

[48]  Kanit Wongsuphasawat,et al.  Voyager: Exploratory Analysis via Faceted Browsing of Visualization Recommendations , 2016, IEEE Transactions on Visualization and Computer Graphics.

[49]  Alex Endert,et al.  AxiSketcher: Interactive Nonlinear Axis Mapping of Visualizations through User Drawings , 2017, IEEE Transactions on Visualization and Computer Graphics.

[50]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[51]  Michael Gertz,et al.  A Model and Framework for Visualization Exploration , 2007, IEEE Transactions on Visualization and Computer Graphics.

[52]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[53]  Kanit Wongsuphasawat,et al.  Towards a general-purpose query language for visualization recommendation , 2016, HILDA '16.

[54]  Kwan-Liu Ma,et al.  Image graphs-a novel approach to visual data exploration , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[55]  Sandra G. Hart,et al.  NASA Task Load Index (TLX) , 2013 .

[56]  Aditya G. Parameswaran,et al.  SEEDB: Automatically Generating Query Visualizations , 2014, Proc. VLDB Endow..

[57]  Lane Harrison,et al.  Patterns and Pace: Quantifying Diverse Exploration Behavior with Visualizations on the Web , 2019, IEEE Transactions on Visualization and Computer Graphics.

[58]  Tamara Munzner,et al.  A Multi-Level Typology of Abstract Visualization Tasks , 2013, IEEE Transactions on Visualization and Computer Graphics.

[59]  Çagatay Demiralp,et al.  Data2Vis: Automatic Generation of Data Visualizations Using Sequence-to-Sequence Recurrent Neural Networks , 2018, IEEE Computer Graphics and Applications.

[60]  Matt J. Kusner,et al.  Grammar Variational Autoencoder , 2017, ICML.

[61]  Kwan-Liu Ma,et al.  An Incremental Dimensionality Reduction Method for Visualizing Streaming Multidimensional Data , 2019, IEEE Transactions on Visualization and Computer Graphics.

[62]  G. Cumming Understanding the New Statistics: Effect Sizes, Confidence Intervals, and Meta-Analysis , 2011 .

[63]  Kwan-Liu Ma,et al.  Chart Constellations: Effective Chart Summarization for Collaborative and Multi‐User Analyses , 2018, Comput. Graph. Forum.

[64]  Mary Czerwinski,et al.  An exploratory study of co-located collaborative visual analytics around a tabletop display , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[65]  Zhen Wen,et al.  Behavior-driven visualization recommendation , 2009, IUI.

[66]  Martin Wattenberg,et al.  ManyEyes: a Site for Visualization at Internet Scale , 2007, IEEE Transactions on Visualization and Computer Graphics.