Survey on the Analysis of User Interactions and Visualization Provenance

There is fast‐growing literature on provenance‐related research, covering aspects such as its theoretical framework, use cases, and techniques for capturing, visualizing, and analyzing provenance data. As a result, there is an increasing need to identify and taxonomize the existing scholarship. Such an organization of the research landscape will provide a complete picture of the current state of inquiry and identify knowledge gaps or possible avenues for further investigation. In this STAR, we aim to produce a comprehensive survey of work in the data visualization and visual analytics field that focus on the analysis of user interaction and provenance data. We structure our survey around three primary questions: (1) WHY analyze provenance data, (2) WHAT provenance data to encode and how to encode it, and (3) HOW to analyze provenance data. A concluding discussion provides evidence‐based guidelines and highlights concrete opportunities for future development in this emerging area. The survey and papers discussed can be explored online interactively at https://provenance-survey.caleydo.org.

[1]  Silvia Miksch,et al.  A Review of Guidance Approaches in Visual Data Analysis: A Multifocal Perspective , 2019, Comput. Graph. Forum.

[2]  Marco Cavallo,et al.  Track Xplorer: A System for Visual Analysis of Sensor‐based Motor Activity Predictions , 2018, Comput. Graph. Forum.

[3]  Jean-Daniel Fekete,et al.  Provenance and Logging for Sense Making (Dagstuhl Seminar 18462) , 2018, Dagstuhl Reports.

[4]  Raphael Fuchs,et al.  Visual Human+Machine Learning , 2009, IEEE Transactions on Visualization and Computer Graphics.

[5]  Matthew D. Cooper,et al.  Shape grammar extraction for efficient query-by-sketch pattern matching in long time series , 2016, 2016 IEEE Conference on Visual Analytics Science and Technology (VAST).

[6]  Anastasia Bezerianos,et al.  Evolutionary Visual Exploration: Evaluation With Expert Users , 2013, Comput. Graph. Forum.

[7]  Cláudio T. Silva,et al.  VisTrails: visualization meets data management , 2006, SIGMOD Conference.

[8]  Douglas Thain,et al.  Reproducibility in Scientific Computing , 2018, ACM Comput. Surv..

[9]  M. Shahriar Hossain,et al.  Scatter/Gather Clustering: Flexibly Incorporating User Feedback to Steer Clustering Results , 2012, IEEE Transactions on Visualization and Computer Graphics.

[10]  Chris Weaver,et al.  Conjunctive Visual Forms , 2009, IEEE Transactions on Visualization and Computer Graphics.

[11]  B. Shneiderman,et al.  The dynamic HomeFinder: evaluating dynamic queries in a real-estate information exploration system , 1992, SIGIR '92.

[12]  Bob Fields,et al.  SensePath: Understanding the Sensemaking Process Through Analytic Provenance , 2016, IEEE Transactions on Visualization and Computer Graphics.

[13]  Remco Chang,et al.  ModelSpace: Visualizing the Trails of Data Models in Visual Analytics Systems , 2018, 2018 IEEE Workshop on Machine Learning from User Interaction for Visualization and Analytics (MLUI).

[14]  Vidya Setlur,et al.  Eviza: A Natural Language Interface for Visual Analysis , 2016, UIST.

[15]  John Lee,et al.  Effortless Data Exploration with zenvisage: An Expressive and Interactive Visual Analytics System , 2016, Proc. VLDB Endow..

[16]  Chris North,et al.  Analytic provenance: process+interaction+insight , 2011, CHI Extended Abstracts.

[17]  Alex Endert,et al.  Podium: Ranking Data Using Mixed-Initiative Visual Analytics , 2018, IEEE Transactions on Visualization and Computer Graphics.

[18]  Ronald Peikert,et al.  Multiverse Data-Flow Control , 2013, IEEE Transactions on Visualization and Computer Graphics.

[19]  Christopher Andrews,et al.  VizCept: Supporting synchronous collaboration for constructing visualizations in intelligence analysis , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[20]  Jim Smith,et al.  Predicting User’s Confidence During Visual Decision Making , 2018 .

[21]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[22]  Scott Snook,et al.  The Handbook for Teaching Leadership: Knowing, Doing, and Being , 2011 .

[23]  Jarke J. van Wijk,et al.  Exploring Multivariate Event Sequences Using Rules, Aggregations, and Selections , 2018, IEEE Transactions on Visualization and Computer Graphics.

[24]  Bongshin Lee,et al.  Characterizing Visualization Insights from Quantified Selfers' Personal Data Presentations , 2015, IEEE Computer Graphics and Applications.

[25]  Thomas Ertl,et al.  Iterative integration of visual insights during patent search and analysis , 2009, 2009 IEEE Symposium on Visual Analytics Science and Technology.

[26]  T. J. Jankun-Kelly,et al.  Analytic Provenance for Sensemaking: A Research Agenda , 2015, IEEE Computer Graphics and Applications.

[27]  Michael Burch,et al.  The State of the Art in Visualizing Dynamic Graphs , 2014, EuroVis.

[28]  Carla E. Brodley,et al.  Dis-function: Learning distance functions interactively , 2012, 2012 IEEE Conference on Visual Analytics Science and Technology (VAST).

[29]  William Wright,et al.  Visual Classification: Expert Knowledge Guides Machine Learning , 2010, IEEE Computer Graphics and Applications.

[30]  Alex Endert,et al.  Graphiti: Interactive Specification of Attribute-Based Edges for Network Modeling and Visualization , 2018, IEEE Transactions on Visualization and Computer Graphics.

[31]  Olga Kulyk,et al.  A Provenance Task Abstraction Framework , 2019, IEEE Computer Graphics and Applications.

[32]  Silvia Miksch,et al.  Characterizing Guidance in Visual Analytics , 2017, IEEE Transactions on Visualization and Computer Graphics.

[33]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[34]  Peter Buneman,et al.  Data Provenance: What next? , 2019, SGMD.

[35]  Tim Kraska,et al.  VizML: A Machine Learning Approach to Visualization Recommendation , 2018, CHI.

[36]  Olivier Thonnard,et al.  VASABI: Hierarchical User Profiles for Interactive Visual User Behaviour Analytics , 2020, IEEE Transactions on Visualization and Computer Graphics.

[37]  Azza Abouzeid,et al.  Is this Real?: Generating Synthetic Data that Looks Real , 2019, UIST.

[38]  David H. Laidlaw,et al.  Modeling task performance for a crowd of users from interaction histories , 2012, CHI.

[39]  John T. Stasko,et al.  Toward a Deeper Understanding of the Role of Interaction in Information Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.

[40]  Aditya G. Parameswaran,et al.  Avoiding drill-down fallacies with VisPilot: assisted exploration of data subsets , 2019, IUI.

[41]  Christopher Collins,et al.  DimpVis: Exploring Time-varying Information Visualizations by Direct Manipulation , 2014, IEEE Transactions on Visualization and Computer Graphics.

[42]  Oliver Rübel,et al.  BASTet: Shareable and Reproducible Analysis and Visualization of Mass Spectrometry Imaging Data via OpenMSI , 2018, IEEE Transactions on Visualization and Computer Graphics.

[43]  Jarke J. van Wijk,et al.  Supporting the analytical reasoning process in information visualization , 2008, CHI.

[44]  Nan Cao,et al.  Adaptive Contextualization: Combating Bias During High-Dimensional Visualization and Data Selection , 2016, IUI.

[45]  Vidya Setlur,et al.  Inferencing underspecified natural language utterances in visual analysis , 2019, IUI.

[46]  Charles Perin,et al.  Exploration Strategies for Discovery of Interactivity in Visualizations , 2019, IEEE Transactions on Visualization and Computer Graphics.

[47]  Daniel A. Keim,et al.  SOMFlow: Guided Exploratory Cluster Analysis with Self-Organizing Maps and Analytic Provenance , 2018, IEEE Transactions on Visualization and Computer Graphics.

[48]  Jian Zhao,et al.  Supporting Handoff in Asynchronous Collaborative Sensemaking Using Knowledge-Transfer Graphs , 2018, IEEE Transactions on Visualization and Computer Graphics.

[49]  John R. Goodall,et al.  Evaluating How Level of Detail of Visual History Affects Process Memory , 2015, CHI.

[50]  Michael Stonebraker,et al.  Dynamic Prefetching of Data Tiles for Interactive Visualization , 2016, SIGMOD Conference.

[51]  Bongshin Lee,et al.  Charticulator: Interactive Construction of Bespoke Chart Layouts , 2019, IEEE Transactions on Visualization and Computer Graphics.

[52]  Jürgen Ziegler,et al.  A 3D Item Space Visualization for Presenting and Manipulating User Preferences in Collaborative Filtering , 2017, IUI.

[53]  Vidya Setlur,et al.  Applying Pragmatics Principles for Interaction with Visual Analytics , 2018, IEEE Transactions on Visualization and Computer Graphics.

[54]  James Frew,et al.  Lineage retrieval for scientific data processing: a survey , 2005, CSUR.

[55]  Michael Gleicher,et al.  The semantics of sketch: Flexibility in visual query systems for time series data , 2016, 2016 IEEE Conference on Visual Analytics Science and Technology (VAST).

[56]  David H. Laidlaw,et al.  A Case Study Using Visualization Interaction Logs and Insight Metrics to Understand How Analysts Arrive at Insights , 2016, IEEE Transactions on Visualization and Computer Graphics.

[57]  Cláudio T. Silva,et al.  A User Study of Visualization Effectiveness Using EEG and Cognitive Load , 2011, Comput. Graph. Forum.

[58]  Kwan-Liu Ma,et al.  Visual cluster exploration of web clickstream data , 2012, 2012 IEEE Conference on Visual Analytics Science and Technology (VAST).

[59]  Jason Dykes,et al.  An Extensible Framework for Provenance in Human Terrain Visual Analytics , 2013, IEEE Transactions on Visualization and Computer Graphics.

[60]  Olivier Thonnard,et al.  Understanding User Behaviour through Action Sequences: From the Usual to the Unusual , 2019, IEEE Transactions on Visualization and Computer Graphics.

[61]  Christoph Trattner,et al.  VizRec , 2016 .

[62]  Mira Dontcheva,et al.  CoreFlow: Extracting and Visualizing Branching Patterns from Event Sequences , 2017, Comput. Graph. Forum.

[63]  William Ribarsky,et al.  Recovering Reasoning Processes from User Interactions , 2009, IEEE Computer Graphics and Applications.

[64]  Arvind Satyanarayan,et al.  Reactive Vega: A Streaming Dataflow Architecture for Declarative Interactive Visualization , 2016, IEEE Transactions on Visualization and Computer Graphics.

[65]  Eduard Gröller,et al.  Visual Analysis and Steering of Flooding Simulations , 2013, IEEE Transactions on Visualization and Computer Graphics.

[66]  M. Sheelagh T. Carpendale,et al.  ChangeCatcher: Increasing Inter‐author Awareness for Visualization Development , 2018, Comput. Graph. Forum.

[67]  P. Pirolli,et al.  The Sensemaking Process and Leverage Points for Analyst Technology as Identified Through Cognitive Task Analysis , 2007 .

[68]  Cristina Conati,et al.  Inferring Visualization Task Properties, User Performance, and User Cognitive Abilities from Eye Gaze Data , 2014, ACM Trans. Interact. Intell. Syst..

[69]  GulwaniSumit Automating string processing in spreadsheets using input-output examples , 2011 .

[70]  Michael Schwärzler,et al.  LightGuider: Guiding Interactive Lighting Design using Suggestions, Provenance, and Quality Visualization , 2019, IEEE Transactions on Visualization and Computer Graphics.

[71]  PohlMargit,et al.  The User Puzzle—Explaining the Interaction with Visual Analytics Systems , 2012 .

[72]  Tamara Munzner,et al.  Segmentifier: Interactive Refinement of Clickstream Data , 2019, Comput. Graph. Forum.

[73]  Jean-Daniel Fekete,et al.  Provenance Analysis for Sensemaking , 2019, IEEE Computer Graphics and Applications.

[74]  Silvia Miksch,et al.  To Score or Not to Score? Tripling Insights for Participatory Design , 2009, IEEE Computer Graphics and Applications.

[75]  Xiaolin Du,et al.  Short Text Classification: A Survey , 2014, J. Multim..

[76]  Arvind Satyanarayan,et al.  Lyra: An Interactive Visualization Design Environment , 2014, Comput. Graph. Forum.

[77]  Elmar Eisemann,et al.  Approximated and User Steerable tSNE for Progressive Visual Analytics , 2015, IEEE Transactions on Visualization and Computer Graphics.

[78]  Thomas Zichner,et al.  KnowledgePearls: Provenance-Based Visualization Retrieval , 2019, IEEE Transactions on Visualization and Computer Graphics.

[79]  Hongyuan Zha,et al.  Visualizing Uncertainty and Alternatives in Event Sequence Predictions , 2019, CHI.

[80]  Lane Harrison,et al.  Patterns and Pace: Quantifying Diverse Exploration Behavior with Visualizations on the Web , 2019, IEEE Transactions on Visualization and Computer Graphics.

[81]  Cristina Conati,et al.  User-adaptive information visualization: using eye gaze data to infer visualization tasks and user cognitive abilities , 2013, IUI '13.

[82]  Alex Endert,et al.  InterAxis: Steering Scatterplot Axes via Observation-Level Interaction , 2016, IEEE Transactions on Visualization and Computer Graphics.

[83]  Carlos Eduardo Scheidegger,et al.  Collaborative visual analysis with RCloud , 2015, 2015 IEEE Conference on Visual Analytics Science and Technology (VAST).

[84]  Jarke J. van Wijk,et al.  Rationale Visualization for Safety and Security , 2015, Comput. Graph. Forum.

[85]  Nawaz Khan,et al.  Interactive visualization for low literacy users: from lessons learnt to design , 2012, CHI.

[86]  Jarke J. van Wijk,et al.  Reducing Snapshots to Points: A Visual Analytics Approach to Dynamic Network Exploration , 2016, IEEE Transactions on Visualization and Computer Graphics.

[87]  David Gotz,et al.  Connecting the dots in visual analysis , 2009, 2009 IEEE Symposium on Visual Analytics Science and Technology.

[88]  Jeffrey Heer,et al.  Wrangler: interactive visual specification of data transformation scripts , 2011, CHI.

[89]  Roman Garnett,et al.  Follow The Clicks: Learning and Anticipating Mouse Interactions During Exploratory Data Analysis , 2019, Comput. Graph. Forum.

[90]  Rastislav Bodík,et al.  Programming by manipulation for layout , 2014, UIST.

[91]  Leilani Battle,et al.  Characterizing Exploratory Visual Analysis: A Literature Review and Evaluation of Analytic Provenance in Tableau , 2019, Comput. Graph. Forum.

[92]  John T. Stasko,et al.  Mental Models, Visual Reasoning and Interaction in Information Visualization: A Top-down Perspective , 2010, IEEE Transactions on Visualization and Computer Graphics.

[93]  Miguel A. Nacenta,et al.  Dynamic Network Plaid: A Tool for the Analysis of Dynamic Networks , 2019, CHI.

[94]  Chris North,et al.  Semantic interaction for visual text analytics , 2012, CHI.

[95]  Jeffrey Heer,et al.  Scented Widgets: Improving Navigation Cues with Embedded Visualizations , 2007, IEEE Transactions on Visualization and Computer Graphics.

[96]  Neesha Kodagoda,et al.  Using Interactive Visual Reasoning to Support Sense-Making: Implications for Design , 2013, IEEE Transactions on Visualization and Computer Graphics.

[97]  Melanie Tory,et al.  Supporting Communication and Coordination in Collaborative Sensemaking , 2014, IEEE Transactions on Visualization and Computer Graphics.

[98]  Jacqueline Grennon , 2nd Ed. , 2002, The Journal of nervous and mental disease.

[99]  Robert J. K. Jacob,et al.  Using fNIRS brain sensing to evaluate information visualization interfaces , 2013, CHI.

[100]  Silvia Miksch,et al.  Analysing Interactivity in Information Visualisation , 2012, KI - Künstliche Intelligenz.

[101]  Alex Endert,et al.  AxiSketcher: Interactive Nonlinear Axis Mapping of Visualizations through User Drawings , 2017, IEEE Transactions on Visualization and Computer Graphics.

[102]  Stefan Bruckner,et al.  Visual Parameter Space Analysis: A Conceptual Framework , 2014, IEEE Transactions on Visualization and Computer Graphics.

[103]  Melanie Herschel,et al.  A survey on provenance: What for? What form? What from? , 2017, The VLDB Journal.

[104]  Cláudio T. Silva,et al.  Visual Exploration of Big Spatio-Temporal Urban Data: A Study of New York City Taxi Trips , 2013, IEEE Transactions on Visualization and Computer Graphics.

[105]  Chris North,et al.  Multi-model semantic interaction for text analytics , 2014, 2014 IEEE Conference on Visual Analytics Science and Technology (VAST).

[106]  Pat Hanrahan,et al.  Enhancing Visual Analysis of Network Traffic Using a Knowledge Representation , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[107]  Christopher D. Janneck,et al.  DIMACS Technical Report 2009-12 November 2009 Supporting Cognitive Models of Sensemaking in Analytics Systems , 2009 .

[108]  Charu C. Aggarwal,et al.  A Survey of Text Classification Algorithms , 2012, Mining Text Data.

[109]  Rosane Minghim,et al.  Interactive Document Clustering Revisited: A Visual Analytics Approach , 2018, IUI.

[110]  Bowen Yu,et al.  FlowSense: A Natural Language Interface for Visual Data Exploration within a Dataflow System , 2019, IEEE Transactions on Visualization and Computer Graphics.

[111]  Cláudio T. Silva,et al.  Provenance for Visualizations: Reproducibility and Beyond , 2007, Computing in Science & Engineering.

[112]  Michael Stonebraker,et al.  The Role of Latency and Task Complexity in Predicting Visual Search Behavior , 2020, IEEE Transactions on Visualization and Computer Graphics.

[113]  Alexander Lex,et al.  From Visual Exploration to Storytelling and Back Again , 2016, bioRxiv.

[114]  Yang Wang,et al.  Patterns and Sequences: Interactive Exploration of Clickstreams to Understand Common Visitor Paths , 2017, IEEE Transactions on Visualization and Computer Graphics.

[115]  Alex Endert,et al.  Warning, Bias May Occur: A Proposed Approach to Detecting Cognitive Bias in Interactive Visual Analytics , 2017, 2017 IEEE Conference on Visual Analytics Science and Technology (VAST).

[116]  Nancy Argüelles,et al.  Author ' s , 2008 .

[117]  Sumit Gulwani,et al.  Spreadsheet data manipulation using examples , 2012, CACM.

[118]  Alex Endert,et al.  Characterizing Provenance in Visualization and Data Analysis: An Organizational Framework of Provenance Types and Purposes , 2016, IEEE Transactions on Visualization and Computer Graphics.

[119]  Evan M. Peck,et al.  The Curious Case of Combining Text and Visualization , 2019, EuroVis.

[120]  Martin Wattenberg,et al.  Sketching a graph to query a time-series database , 2001, CHI Extended Abstracts.

[121]  Chris North,et al.  Observation-level interaction with statistical models for visual analytics , 2011, 2011 IEEE Conference on Visual Analytics Science and Technology (VAST).

[122]  Emanuel Zgraggen,et al.  (s|qu)eries: Visual Regular Expressions for Querying and Exploring Event Sequences , 2015, CHI.

[123]  Sumit Gulwani,et al.  Automating string processing in spreadsheets using input-output examples , 2011, POPL '11.

[124]  Kate Herd,et al.  SenseMap: Supporting browser-based online sensemaking through analytic provenance , 2016, 2016 IEEE Conference on Visual Analytics Science and Technology (VAST).

[125]  Daniel F. Keefe,et al.  Visualization-by-Sketching: An Artist's Interface for Creating Multivariate Time-Varying Data Visualizations , 2016, IEEE Transactions on Visualization and Computer Graphics.

[126]  Russ Burtner,et al.  Mixed-initiative visual analytics using task-driven recommendations , 2015, 2015 IEEE Conference on Visual Analytics Science and Technology (VAST).

[127]  Cristina Conati,et al.  Pupillometry and Head Distance to the Screen to Predict Skill Acquisition During Information Visualization Tasks , 2017, IUI.

[128]  Kwan-Liu Ma,et al.  Chart Constellations: Effective Chart Summarization for Collaborative and Multi‐User Analyses , 2018, Comput. Graph. Forum.

[129]  Scott Barlowe,et al.  Click2Annotate: Automated Insight Externalization with rich semantics , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[130]  Chris Weaver,et al.  Visual Analysis of Higher-Order Conjunctive Relationships in Multidimensional Data Using a Hypergraph Query System , 2013, IEEE Transactions on Visualization and Computer Graphics.

[131]  Yogesh L. Simmhan,et al.  A survey of data provenance in e-science , 2005, SGMD.

[132]  Thomas Ertl,et al.  VA2: A Visual Analytics Approach for Evaluating Visual Analytics Applications , 2016, IEEE Transactions on Visualization and Computer Graphics.

[133]  Thomas Ertl,et al.  Visual analysis and coding of data-rich user behavior , 2016, 2016 IEEE Conference on Visual Analytics Science and Technology (VAST).

[134]  Jesus J. Caban,et al.  A Grammar-based Approach for Modeling User Interactions and Generating Suggestions During the Data Exploration Process , 2017, IEEE Transactions on Visualization and Computer Graphics.

[135]  Isaac Cho,et al.  The Anchoring Effect in Decision-Making with Visual Analytics , 2017, 2017 IEEE Conference on Visual Analytics Science and Technology (VAST).

[136]  Jason Dykes,et al.  Design Exposition with Literate Visualization , 2019, IEEE Transactions on Visualization and Computer Graphics.

[137]  Silvia Miksch,et al.  Capturing and Visualizing Provenance From Data Wrangling , 2019, IEEE Computer Graphics and Applications.

[138]  James Cheney,et al.  Provenance in Databases: Why, How, and Where , 2009, Found. Trends Databases.

[139]  I. V. Ramakrishnan,et al.  Model-driven Visual Analytics , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[140]  Margit Pohl,et al.  The User Puzzle—Explaining the Interaction with Visual Analytics Systems , 2012, IEEE Transactions on Visualization and Computer Graphics.

[141]  Jeffrey Heer,et al.  Graphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[142]  Samuel Kaski,et al.  Interactive Elicitation of Knowledge on Feature Relevance Improves Predictions in Small Data Sets , 2016, IUI.

[143]  Zhen Wen,et al.  Behavior-driven visualization recommendation , 2009, IUI.

[144]  Cláudio T. Silva,et al.  Provenance for Computational Tasks: A Survey , 2008, Computing in Science & Engineering.

[145]  Christoph Heinzl,et al.  GEMSe: Visualization‐Guided Exploration of Multi‐channel Segmentation Algorithms , 2016, Comput. Graph. Forum.

[146]  Cristina Conati,et al.  Towards facilitating user skill acquisition: identifying untrained visualization users through eye tracking , 2014, IUI.

[147]  Tim Kraska,et al.  VizNet: Towards A Large-Scale Visualization Learning and Benchmarking Repository , 2019, CHI.

[148]  Alex Endert,et al.  Finding Waldo: Learning about Users from their Interactions , 2014, IEEE Transactions on Visualization and Computer Graphics.

[149]  Wencheng Wang,et al.  Interactive Storytelling for Movie Recommendation through Latent Semantic Analysis , 2018, IUI.

[150]  Huahai Yang,et al.  Personality as a Predictor of User Strategy: How Locus of Control Affects Search Strategies on Tree Visualizations , 2015, CHI.

[151]  Karthic Madanagopal,et al.  Analytic Provenance in Practice: The Role of Provenance in Real-World Visualization and Data Analysis Environments , 2019, IEEE Computer Graphics and Applications.

[152]  Björn Hartmann,et al.  Identifying Redundancy and Exposing Provenance in Crowdsourced Data Analysis , 2013, IEEE Transactions on Visualization and Computer Graphics.

[153]  Holger Stitz,et al.  AVOCADO: Visualization of Workflow–Derived Data Provenance for Reproducible Biomedical Research , 2016, bioRxiv.

[154]  Marc Cavazza,et al.  Applying planning to interactive storytelling: Narrative control using state constraints , 2010, TIST.

[155]  Cheryl Z. Qian,et al.  Capturing and supporting the analysis process , 2009, 2009 IEEE Symposium on Visual Analytics Science and Technology.

[156]  Gennady L. Andrienko,et al.  Identifying Place Histories from Activity Traces with an Eye to Parameter Impact , 2012, IEEE Transactions on Visualization and Computer Graphics.

[157]  Alex Endert,et al.  Visualization by Demonstration: An Interaction Paradigm for Visual Data Exploration , 2017, IEEE Transactions on Visualization and Computer Graphics.

[158]  Arnab Nandi,et al.  Flux capacitors for JavaScript deloreans: approximate caching for physics-based data interaction , 2019, IUI.

[159]  Nan Cao,et al.  Adaptive Contextualization Methods for Combating Selection Bias during High-Dimensional Visualization , 2017, ACM Trans. Interact. Intell. Syst..

[160]  Jarke J. van Wijk,et al.  Supporting Exploration Awareness in Information Visualization , 2009, IEEE Computer Graphics and Applications.

[161]  Wellington Moreira de Oliveira,et al.  Provenance Analytics for Workflow-Based Computational Experiments , 2018, ACM Comput. Surv..

[162]  Clemens Nylandsted Klokmose,et al.  InsideInsights: Integrating Data‐Driven Reporting in Collaborative Visual Analytics , 2019, Comput. Graph. Forum.

[163]  Bongshin Lee,et al.  GraphTrail: analyzing large multivariate, heterogeneous networks while supporting exploration history , 2012, CHI.

[164]  Chris North,et al.  Semantic Interaction for Sensemaking: Inferring Analytical Reasoning for Model Steering , 2012, IEEE Transactions on Visualization and Computer Graphics.

[165]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[166]  Chris North,et al.  Semantics of Directly Manipulating Spatializations , 2013, IEEE Transactions on Visualization and Computer Graphics.

[167]  Michelle X. Zhou,et al.  Characterizing Users' Visual Analytic Activity for Insight Provenance , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[168]  Cheryl Z. Qian,et al.  Employing a Parametric Model for Analytic Provenance , 2014, TIIS.

[169]  Tamara Munzner,et al.  A Multi-Level Typology of Abstract Visualization Tasks , 2013, IEEE Transactions on Visualization and Computer Graphics.

[170]  Juliana Freire,et al.  Provenance and Reproducibility , 2018, Encyclopedia of Database Systems.

[171]  Karrie Karahalios,et al.  DataTone: Managing Ambiguity in Natural Language Interfaces for Data Visualization , 2015, UIST.

[172]  Jeffrey Heer,et al.  Perfopticon: Visual Query Analysis for Distributed Databases , 2015, Comput. Graph. Forum.

[173]  Alex Endert,et al.  Semantic Interaction for Visual Analytics: Toward Coupling Cognition and Computation , 2014, IEEE Computer Graphics and Applications.

[174]  Chris North,et al.  Semantic Interaction: Coupling Cognition and Computation through Usable Interactive Analytics , 2015, IEEE Computer Graphics and Applications.

[175]  Frédo Durand,et al.  Learning Visual Importance for Graphic Designs and Data Visualizations , 2017, UIST.

[176]  Nilanjan Dey,et al.  A survey of image classification methods and techniques , 2014, 2014 International Conference on Control, Instrumentation, Communication and Computational Technologies (ICCICCT).

[177]  Christopher G. Healey,et al.  Interest Driven Navigation in Visualization , 2012, IEEE Transactions on Visualization and Computer Graphics.

[178]  Anastasia Bezerianos,et al.  An Exploratory Study on Visual Exploration of Model Simulations by Multiple Types of Experts , 2019, CHI.

[179]  Helwig Hauser,et al.  Fast and Accurate CNN‐based Brushing in Scatterplots , 2018, Comput. Graph. Forum.

[180]  Kanit Wongsuphasawat,et al.  Voyager: Exploratory Analysis via Faceted Browsing of Visualization Recommendations , 2016, IEEE Transactions on Visualization and Computer Graphics.

[181]  Hujun Bao,et al.  A visual reasoning approach for data-driven transport assessment on urban roads , 2014, 2014 IEEE Conference on Visual Analytics Science and Technology (VAST).

[182]  Arvind Satyanarayan,et al.  Vega-Lite: A Grammar of Interactive Graphics , 2018, IEEE Transactions on Visualization and Computer Graphics.