Enhancing Web-based Analytics Applications through Provenance

Visual analytics systems continue to integrate new technologies and leverage modern environments for exploration and collaboration, making tools and techniques available to a wide audience through web browsers. Many of these systems have been developed with rich interactions, offering users the opportunity to examine details and explore hypotheses that have not been directly encoded by a designer. Understanding is enhanced when users can replay and revisit the steps in the sensemaking process, and in collaborative settings, it is especially important to be able to review not only the current state but also what decisions were made along the way. Unfortunately, many web-based systems lack the ability to capture such reasoning, and the path to a result is transient, forgotten when a user moves to a new view. This paper explores the requirements to augment existing client-side web applications with support for capturing, reviewing, sharing, and reusing steps in the reasoning process. Furthermore, it considers situations where decisions are made with streaming data, and the insights gained from revisiting those choices when more data is available. It presents a proof of concept, the Shareable Interactive Manipulation Provenance framework (SIMProv.js), that addresses these requirements in a modern, client-side JavaScript library, and describes how it can be integrated with existing frameworks.

[1]  David Gotz,et al.  Progressive Visual Analytics: User-Driven Visual Exploration of In-Progress Analytics , 2014, IEEE Transactions on Visualization and Computer Graphics.

[2]  Pierre Dragicevic,et al.  GraphDice: A System for Exploring Multivariate Social Networks , 2010, Comput. Graph. Forum.

[3]  Jaime Teevan,et al.  Visual snippets: summarizing web pages for search and revisitation , 2009, CHI.

[4]  H. Theisel,et al.  ExPlates: Spatializing Interactive Analysis to Scaffold Visual Exploration , 2013, Comput. Graph. Forum.

[5]  Kwan-Liu Ma,et al.  Image graphs-a novel approach to visual data exploration , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[6]  Kanit Wongsuphasawat,et al.  Voyager: Exploratory Analysis via Faceted Browsing of Visualization Recommendations , 2016, IEEE Transactions on Visualization and Computer Graphics.

[7]  Alex Endert,et al.  Characterizing Provenance in Visualization and Data Analysis: An Organizational Framework of Provenance Types and Purposes , 2016, IEEE Transactions on Visualization and Computer Graphics.

[8]  Clarence A. Ellis,et al.  Concurrency control in groupware systems , 1989, SIGMOD '89.

[9]  Hans Hagen,et al.  Collaborative visualization: Definition, challenges, and research agenda , 2011, Inf. Vis..

[10]  Lyndsey Franklin,et al.  Rethinking Visual Analytics for Streaming Data Applications , 2017, IEEE Internet Computing.

[11]  Schahram Dustdar,et al.  End-to-End Versioning Support for Web Services , 2008, 2008 IEEE International Conference on Services Computing.

[12]  Melanie Herschel,et al.  A survey on provenance: What for? What form? What from? , 2017, The VLDB Journal.

[13]  John Shalf,et al.  Deploying Web-Based Visual Exploration Tools on the Grid , 2002, IEEE Computer Graphics and Applications.

[14]  Jeffrey Heer,et al.  Scented Widgets: Improving Navigation Cues with Embedded Visualizations , 2007, IEEE Transactions on Visualization and Computer Graphics.

[15]  Melanie Tory,et al.  Supporting Communication and Coordination in Collaborative Sensemaking , 2014, IEEE Transactions on Visualization and Computer Graphics.

[16]  Jeffrey Heer,et al.  Graphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[17]  Melanie Tory,et al.  Exploiting analysis history to support collaborative data analysis , 2015, Graphics Interface.

[18]  Paul T. Groth ProvenanceJS: Revealing the Provenance of Web Pages , 2010, IPAW.

[19]  Saul Greenberg,et al.  How People Recognise Previously Seen Web Pages from Titles, URLs and Thumbnails , 2001 .

[20]  David Koop Versioning Version Trees: The Provenance of Actions that Affect Multiple Versions , 2016, IPAW.

[21]  Niklas Elmqvist,et al.  ExPlates: Spatializing Interactive Analysis to Scaffold Visual Exploration , 2013, Comput. Graph. Forum.

[22]  Michelle X. Zhou,et al.  Characterizing users’ visual analytic activity for insight provenance , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[23]  Michael D. Ernst,et al.  Interactive record/replay for web application debugging , 2013, UIST.

[24]  Niklas Elmqvist,et al.  Branch-explore-merge: facilitating real-time revision control in collaborative visual exploration , 2012, ITS.

[25]  Cláudio T. Silva,et al.  Provenance for Computational Tasks: A Survey , 2008, Computing in Science & Engineering.

[26]  Jarke J. van Wijk,et al.  Supporting the analytical reasoning process in information visualization , 2008, CHI.

[27]  Arvind Satyanarayan,et al.  Visual Debugging Techniques for Reactive Data Visualization , 2016, Comput. Graph. Forum.

[28]  Jeffrey Heer,et al.  Design Considerations for Collaborative Visual Analytics , 2008, Inf. Vis..

[29]  Tova Milo,et al.  REACT: Context-Sensitive Recommendations for Data Analysis , 2016, SIGMOD Conference.

[30]  Jesus J. Caban,et al.  A Grammar-based Approach for Modeling User Interactions and Generating Suggestions During the Data Exploration Process , 2017, IEEE Transactions on Visualization and Computer Graphics.

[31]  Paul T. Groth,et al.  Requirements for Provenance on the Web , 2012, Int. J. Digit. Curation.

[32]  Bob Fields,et al.  SensePath: Understanding the Sensemaking Process Through Analytic Provenance , 2016, IEEE Transactions on Visualization and Computer Graphics.

[33]  Melanie Tory,et al.  Supporting Awareness through Collaborative Brushing and Linking of Tabular Data , 2013, IEEE Transactions on Visualization and Computer Graphics.

[34]  Chris North,et al.  Analytic provenance: process+interaction+insight , 2011, CHI Extended Abstracts.

[35]  Ali Mesbah,et al.  Understanding Asynchronous Interactions in Full-Stack JavaScript , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE).

[36]  Simon Breslav,et al.  Mimic: visual analytics of online micro-interactions , 2014, AVI.

[37]  Niklas Elmqvist,et al.  PolyChrome: A Cross-Device Framework for Collaborative Web Visualization , 2014, ITS '14.

[38]  Haoqi Zhang,et al.  Unravel: Rapid Web Application Reverse Engineering via Interaction Recording, Source Tracing, and Library Detection , 2015, UIST.

[39]  Jian Zhao,et al.  Supporting Handoff in Asynchronous Collaborative Sensemaking Using Knowledge-Transfer Graphs , 2018, IEEE Transactions on Visualization and Computer Graphics.

[40]  Michael Dixon,et al.  High-latency, low-bandwidth windowing in the Jupiter collaboration system , 1995, UIST '95.

[41]  Cláudio T. Silva,et al.  Managing Rapidly-Evolving Scientific Workflows , 2006, IPAW.

[42]  Yogesh L. Simmhan,et al.  A survey of data provenance in e-science , 2005, SGMD.

[43]  Ye Zhao,et al.  Supporting effective common ground construction in Asynchronous Collaborative Visual Analytics , 2011, 2011 IEEE Conference on Visual Analytics Science and Technology (VAST).

[44]  Cheng Deng,et al.  HindSight: Encouraging Exploration through Direct Encoding of Personal Interaction History , 2017, IEEE Transactions on Visualization and Computer Graphics.

[45]  Melanie Herschel,et al.  Provenance-based Recommendations for Visual Data Exploration , 2017, TaPP.

[46]  Ken Brodlie,et al.  GRASPARC-A problem solving environment integrating computation and visualization , 1993, Proceedings Visualization '93.

[47]  Steven K. Feiner,et al.  Editable graphical histories , 1988, [Proceedings] 1988 IEEE Workshop on Visual Languages.

[48]  Steven F. Roth,et al.  Enhancing data exploration with a branching history of user operations , 2001, Knowl. Based Syst..

[49]  Christopher Andrews,et al.  VizCept: Supporting synchronous collaboration for constructing visualizations in intelligence analysis , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[50]  T. J. Jankun-Kelly,et al.  Analytic Provenance for Sensemaking: A Research Agenda , 2015, IEEE Computer Graphics and Applications.