MultiVision: Designing Analytical Dashboards with Deep Learning Based Recommendation

We contribute a deep-learning-based method that assists in designing analytical dashboards for analyzing a data table. Given a data table, data workers usually need to experience a tedious and time-consuming process to select meaningful combinations of data columns for creating charts. This process is further complicated by the needs of creating dashboards composed of multiple views that unveil different perspectives of data. Existing automated approaches for recommending multiple-view visualizations mainly build on manually crafted design rules, producing sub-optimal or irrelevant suggestions. To address this gap, we present a deep learning approach for selecting data columns and recommending multiple charts. More importantly, we integrate the deep learning models into a mixed-initiative system. Our model could make recommendations given optional user-input selections of data columns. The model, in turn, learns from provenance data of authoring logs in an offline manner. We compare our deep learning model with existing methods for visualization recommendation and conduct a user study to evaluate the usefulness of the system.

[1]  Bongshin Lee,et al.  ChartSense: Interactive Data Extraction from Chart Images , 2017, CHI.

[2]  Ricardo Langner,et al.  Multiple Coordinated Views at Large Displays for Multiple Users: Empirical Findings on User Behavior, Movements, and Distances , 2019, IEEE Transactions on Visualization and Computer Graphics.

[3]  Weiwei Cui,et al.  Learning to Automate Chart Layout Configurations Using Crowdsourced Paired Comparison , 2021, CHI.

[4]  Ah Chung Tsoi,et al.  The Graph Neural Network Model , 2009, IEEE Transactions on Neural Networks.

[5]  Kanit Wongsuphasawat,et al.  Voyager: Exploratory Analysis via Faceted Browsing of Visualization Recommendations , 2016, IEEE Transactions on Visualization and Computer Graphics.

[6]  Tamara Munzner,et al.  VizCommender: Computing Text-Based Similarity in Visualization Repositories for Content-Based Recommendations , 2020, IEEE Transactions on Visualization and Computer Graphics.

[7]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[8]  Huamin Qu,et al.  InfoColorizer: Interactive Recommendation of Color Palettes for Infographics , 2021, IEEE Transactions on Visualization and Computer Graphics.

[9]  Ricardo Langner,et al.  VisTiles: Coordinating and Combining Co-located Mobile Devices for Visual Data Exploration , 2018, IEEE Transactions on Visualization and Computer Graphics.

[10]  Roman Garnett,et al.  Competing Models: Inferring Exploration Patterns and Information Relevance via Bayesian Model Selection , 2021, IEEE Transactions on Visualization and Computer Graphics.

[11]  Xi Chen,et al.  InfoNice: Easy Creation of Information Graphics , 2018, CHI.

[12]  Fan Zhang,et al.  LADV: Deep Learning Assisted Authoring of Dashboard Visualizations From Images and Sketches , 2020, IEEE Transactions on Visualization and Computer Graphics.

[13]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[14]  Susan T. Dumais,et al.  Short-Term Satisfaction and Long-Term Coverage: Understanding How Users Tolerate Algorithmic Exploration , 2018, WSDM.

[15]  Mira Dontcheva,et al.  Data-Driven Guides: Supporting Expressive Design for Information Graphics , 2017, IEEE Transactions on Visualization and Computer Graphics.

[16]  Tie-Yan Liu,et al.  Learning to rank for information retrieval , 2009, SIGIR.

[17]  John T. Stasko,et al.  Designing Multiple Coordinated Visualizations for Tablets , 2016, Comput. Graph. Forum.

[18]  Marc Streit,et al.  Survey on the Analysis of User Interactions and Visualization Provenance , 2020, Comput. Graph. Forum.

[19]  Arvind Satyanarayan,et al.  Vega-Lite: A Grammar of Interactive Graphics , 2018, IEEE Transactions on Visualization and Computer Graphics.

[20]  Alex Endert,et al.  Graphiti: Interactive Specification of Attribute-Based Edges for Network Modeling and Visualization , 2018, IEEE Transactions on Visualization and Computer Graphics.

[21]  Guodao Sun,et al.  A survey on automatic infographics and visualization recommendations , 2020, Vis. Informatics.

[22]  Weiwei Cui,et al.  Visualization Assessment: A Machine Learning Approach , 2019, 2019 IEEE Visualization Conference (VIS).

[23]  Jonathan C. Roberts,et al.  Towards Quantifying Multiple View Layouts in Visualisation as Seen from Research Publications , 2019, 2019 IEEE Visualization Conference (VIS).

[24]  Yang Shi,et al.  Calliope: Automatic Visual Data Story Generation from a Spreadsheet , 2020, IEEE Transactions on Visualization and Computer Graphics.

[25]  Guoliang Li,et al.  DeepEye: Towards Automatic Data Visualization , 2018, 2018 IEEE 34th International Conference on Data Engineering (ICDE).

[26]  Frédo Durand,et al.  Learning Visual Importance for Graphic Designs and Data Visualizations , 2017, UIST.

[27]  Yong Wang,et al.  DeepDrawing: A Deep Learning Approach to Graph Drawing , 2019, IEEE Transactions on Visualization and Computer Graphics.

[28]  Karrie Karahalios,et al.  DataTone: Managing Ambiguity in Natural Language Interfaces for Data Visualization , 2015, UIST.

[29]  Melanie Tory,et al.  What Do We Talk About When We Talk About Dashboards? , 2019, IEEE Transactions on Visualization and Computer Graphics.

[30]  Yong Wang,et al.  Towards Automated Infographic Design: Deep Learning-based Auto-Extraction of Extensible Timeline , 2019, IEEE Transactions on Visualization and Computer Graphics.

[31]  Wei Zeng,et al.  Composition and Configuration Patterns in Multiple-View Visualizations , 2020, IEEE Transactions on Visualization and Computer Graphics.

[32]  Guoliang Li,et al.  Making data visualization more efficient and effective: a survey , 2019, The VLDB Journal.

[33]  Tobias Höllerer,et al.  iVisDesigner: Expressive Interactive Design of Information Visualizations , 2014, IEEE Transactions on Visualization and Computer Graphics.

[34]  Jeffrey Heer,et al.  Formalizing Visualization Design Knowledge as Constraints: Actionable and Extensible Models in Draco , 2018, IEEE Transactions on Visualization and Computer Graphics.

[35]  Zening Qu,et al.  Keeping Multiple Views Consistent: Constraints, Validations, and Exceptions in Visualization Authoring , 2019, IEEE Transactions on Visualization and Computer Graphics.

[36]  Jonathan C. Roberts,et al.  On encouraging multiple views for visualization , 1998, Proceedings. 1998 IEEE Conference on Information Visualization. An International Conference on Computer Visualization and Graphics (Cat. No.98TB100246).

[37]  Yingcai Wu,et al.  What Makes a Data-GIF Understandable? , 2020, IEEE Transactions on Visualization and Computer Graphics.

[38]  Bongshin Lee,et al.  MobileVisFixer: Tailoring Web Visualizations for Mobile Phones Leveraging an Explainable Reinforcement Learning Framework , 2020, IEEE Transactions on Visualization and Computer Graphics.

[39]  Taghi M. Khoshgoftaar,et al.  A Survey of Collaborative Filtering Techniques , 2009, Adv. Artif. Intell..

[40]  Pat Hanrahan,et al.  Show Me: Automatic Presentation for Visual Analysis , 2007, IEEE Transactions on Visualization and Computer Graphics.

[41]  J.C. Roberts,et al.  State of the Art: Coordinated & Multiple Views in Exploratory Visualization , 2007, Fifth International Conference on Coordinated and Multiple Views in Exploratory Visualization (CMV 2007).

[42]  Dongmei Zhang,et al.  Table2Analysis: Modeling and Recommendation of Common Analysis Patterns for Multi-Dimensional Data , 2020, AAAI.

[43]  Gilles Venturini,et al.  VizAssist: an interactive user assistant for visual data mining , 2016, The Visual Computer.

[44]  Chih-Jen Lin,et al.  Large-Scale Linear RankSVM , 2014, Neural Computation.

[45]  John T. Stasko,et al.  Data Illustrator: Augmenting Vector Design Tools with Lazy Data Binding for Expressive Visualization Authoring , 2018, CHI.

[46]  Alex Endert,et al.  Augmenting Visualizations with Interactive Data Facts to Facilitate Interpretation and Communication , 2019, IEEE Transactions on Visualization and Computer Graphics.

[47]  Bongshin Lee,et al.  A Deeper Understanding of Sequence in Narrative Visualization , 2013, IEEE Transactions on Visualization and Computer Graphics.

[48]  Yun Wang,et al.  DataShot: Automatic Generation of Fact Sheets from Tabular Data , 2020, IEEE Transactions on Visualization and Computer Graphics.

[49]  Hanspeter Pfister,et al.  Evaluating ‘Graphical Perception’ with CNNs , 2018, IEEE Transactions on Visualization and Computer Graphics.

[50]  David Auber,et al.  Tulip - A Huge Graph Visualization Framework , 2004, Graph Drawing Software.

[51]  Arvind Satyanarayan,et al.  Lyra: An Interactive Visualization Design Environment , 2014, Comput. Graph. Forum.

[52]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[53]  Younghoon Kim,et al.  GraphScape: A Model for Automated Reasoning about Visualization Similarity and Sequencing , 2017, CHI.

[54]  Wei Zeng,et al.  LassoNet: Deep Lasso-Selection of 3D Point Clouds , 2019, IEEE Transactions on Visualization and Computer Graphics.

[55]  Jeffrey Heer,et al.  Agency plus automation: Designing artificial intelligence into interactive systems , 2019, Proceedings of the National Academy of Sciences.

[56]  Gary D. Bader,et al.  Cytoscape.js: a graph theory library for visualisation and analysis , 2015, Bioinform..

[57]  Tim Kraska,et al.  VizML: A Machine Learning Approach to Visualization Recommendation , 2018, CHI.

[58]  Bongshin Lee,et al.  Charticulator: Interactive Construction of Bespoke Chart Layouts , 2019, IEEE Transactions on Visualization and Computer Graphics.

[59]  Kanit Wongsuphasawat,et al.  Voyager 2: Augmenting Visual Analysis with Partial View Specifications , 2017, CHI.

[60]  E. Litwak A Classification of Biased Questions , 1956, American Journal of Sociology.

[61]  Michael Stonebraker,et al.  Beagle : Automated Extraction and Interpretation of Visualizations from the Web , 2017 .

[62]  Çagatay Demiralp,et al.  Data2Vis: Automatic Generation of Data Visualizations Using Sequence-to-Sequence Recurrent Neural Networks , 2018, IEEE Computer Graphics and Applications.

[63]  Allison Woodruff,et al.  Guidelines for using multiple views in information visualization , 2000, AVI '00.

[64]  Yi-Zeng Liang,et al.  Monte Carlo cross validation , 2001 .

[65]  Jock D. Mackinlay,et al.  Automating the design of graphical presentations of relational information , 1986, TOGS.