InsideInsights: Integrating Data‐Driven Reporting in Collaborative Visual Analytics

Analyzing complex data is a non‐linear process that alternates between identifying discrete facts and developing overall assessments and conclusions. In addition, data analysis rarely occurs in solitude; multiple collaborators can be engaged in the same analysis, or intermediate results can be reported to stakeholders. However, current data‐driven communication tools are detached from the analysis process and promote linear stories that forego the hierarchical and branching nature of data analysis, which leads to either too much or too little detail in the final report. We propose a conceptual design for integrated data‐driven reporting that allows for iterative structuring of insights into hierarchies linked to analytic provenance and chosen analysis views. The hierarchies become dynamic and interactive reports where collaborators can review and modify the analysis at a desired level of detail. Our web‐based InsideInsights system provides interaction techniques to annotate states of analytic components, structure annotations, and link them to appropriate presentation views. We demonstrate the generality and usefulness of our system with two use cases and a qualitative expert review.

[1]  Chris North,et al.  Toward measuring visualization insight , 2006, IEEE Computer Graphics and Applications.

[2]  Wendy E. Mackay,et al.  Webstrates: Shareable Dynamic Media , 2015, UIST.

[3]  Martin Wattenberg,et al.  Communication-minded visualization : A call to action , 2006 .

[4]  Niklas Elmqvist,et al.  DataSite: Proactive visual data exploration with computation of insight-based recommendations , 2018, Inf. Vis..

[5]  K. Jarrod Millman,et al.  Developing Open-Source Scientific Practice * , 2018, Implementing Reproducible Research.

[6]  Juliana Freire,et al.  Provenance and scientific workflows: challenges and opportunities , 2008, SIGMOD Conference.

[7]  David Kirsh,et al.  Thinking with external representations , 2010, AI & SOCIETY.

[8]  Arvind Satyanarayan,et al.  Authoring Narrative Visualizations with Ellipsis , 2014, Comput. Graph. Forum.

[9]  Melanie Tory,et al.  Evaluating Visualizations: Do Expert Reviews Work? , 2005, IEEE Computer Graphics and Applications.

[10]  Kanit Wongsuphasawat,et al.  Voyager: Exploratory Analysis via Faceted Browsing of Visualization Recommendations , 2016, IEEE Transactions on Visualization and Computer Graphics.

[11]  Kenney Ng,et al.  Interacting with Predictions: Visual Inspection of Black-box Machine Learning Models , 2016, CHI.

[12]  Arvind Satyanarayan,et al.  Vega-Lite: A Grammar of Interactive Graphics , 2018, IEEE Transactions on Visualization and Computer Graphics.

[13]  Niklas Elmqvist,et al.  The Interactive Visualization Gap in Initial Exploratory Data Analysis , 2018, IEEE Transactions on Visualization and Computer Graphics.

[14]  Nahum Gershon,et al.  What storytelling can do for information visualization , 2001, Commun. ACM.

[15]  Alexander Lex,et al.  From Visual Exploration to Storytelling and Back Again , 2016, bioRxiv.

[16]  Hausi A. Müller,et al.  Live documents with contextual, data-driven information components , 2002, SIGDOC '02.

[17]  Margo I. Seltzer,et al.  BURRITO: Wrapping Your Lab Notebook in Computational Infrastructure , 2012, TaPP.

[18]  Niklas Elmqvist,et al.  Keshif: Rapid and Expressive Tabular Data Exploration for Novices , 2018, IEEE Transactions on Visualization and Computer Graphics.

[19]  Jian Zhao,et al.  Supporting Handoff in Asynchronous Collaborative Sensemaking Using Knowledge-Transfer Graphs , 2018, IEEE Transactions on Visualization and Computer Graphics.

[20]  Jason Dykes,et al.  Design Exposition with Literate Visualization , 2019, IEEE Transactions on Visualization and Computer Graphics.

[21]  Wendy E. Mackay,et al.  From individual to collaborative: the evolution of prism, a hybrid laboratory notebook , 2008, CSCW.

[22]  Jeffrey Heer,et al.  Design Considerations for Collaborative Visual Analytics , 2008, Inf. Vis..

[23]  Cláudio T. Silva,et al.  VisTrails: enabling interactive multiple-view visualizations , 2005, VIS 05. IEEE Visualization, 2005..

[24]  Nancy Argüelles,et al.  Author ' s , 2008 .

[25]  James D. Hollan,et al.  Exploration and Explanation in Computational Notebooks , 2018, CHI.

[26]  R. E. Horn Structured Writing as a Paradigm , 2005 .

[27]  Bongshin Lee,et al.  A Deeper Understanding of Sequence in Narrative Visualization , 2013, IEEE Transactions on Visualization and Computer Graphics.

[28]  Melanie Tory,et al.  Exploiting analysis history to support collaborative data analysis , 2015, Graphics Interface.

[29]  Miguel A. Nacenta,et al.  iVoLVER: Interactive Visual Language for Visualization Extraction and Reconstruction , 2016, CHI.

[30]  James D. Hollan,et al.  Aiding Collaborative Reuse of Computational Notebooks with Annotated Cell Folding , 2018, Proc. ACM Hum. Comput. Interact..

[31]  Jeffrey Heer,et al.  Enterprise Data Analysis and Visualization: An Interview Study , 2012, IEEE Transactions on Visualization and Computer Graphics.

[32]  Brad A. Myers,et al.  Variolite: Supporting Exploratory Programming by Data Scientists , 2017, CHI.

[33]  Jeffrey Heer,et al.  Narrative Visualization: Telling Stories with Data , 2010, IEEE Transactions on Visualization and Computer Graphics.

[34]  Martin Wattenberg,et al.  Voyagers and voyeurs: Supporting asynchronous collaborative visualization , 2009, CACM.

[35]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[36]  André Tricot,et al.  Interaction between prior knowledge and concept-map structure on hypertext comprehension, coherence of reading orders and disorientation , 2010, Interact. Comput..

[37]  Jeffrey Heer,et al.  CommentSpace: structured support for collaborative visual analysis , 2011, CHI.

[38]  Roman Rädle,et al.  Vistrates: A Component Model for Ubiquitous Analytics , 2019, IEEE Transactions on Visualization and Computer Graphics.

[39]  Martin Wattenberg,et al.  Technical forum: Communication-minded visualization: A call to action , 2006, IBM Syst. J..

[40]  Alex Endert,et al.  Characterizing Provenance in Visualization and Data Analysis: An Organizational Framework of Provenance Types and Purposes , 2016, IEEE Transactions on Visualization and Computer Graphics.

[41]  Jeffrey Heer,et al.  Idyll: A Markup Language for Authoring and Publishing Interactive Articles on the Web , 2018, UIST.

[42]  Jarke J. van Wijk,et al.  Supporting the analytical reasoning process in information visualization , 2008, CHI.

[43]  Bongshin Lee,et al.  ActiveInk: (Th)Inking with Data , 2019, CHI.

[44]  Ken Brodlie,et al.  GRASPARC-A problem solving environment integrating computation and visualization , 1993, Proceedings Visualization '93.

[45]  M. Sheelagh T. Carpendale,et al.  More Than Telling a Story: Transforming Data into Visually Shared Stories , 2015, IEEE Computer Graphics and Applications.

[46]  Nicholas Diakopoulos,et al.  Visualization Rhetoric: Framing Effects in Narrative Visualization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[47]  M. Sheelagh T. Carpendale,et al.  Evaluating Information Visualizations , 2008, Information Visualization.

[48]  Midas Nouwens,et al.  The Application and Its Consequences for Non-Standard Knowledge Work , 2018, CHI.

[49]  Michelle X. Zhou,et al.  Characterizing Users' Visual Analytic Activity for Insight Provenance , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[50]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[51]  Roman Rädle,et al.  Codestrate Packages: An Alternative to "One-Size-Fits-All" Software , 2018, CHI Extended Abstracts.

[52]  Brad A. Myers,et al.  The Story in the Notebook: Exploratory Data Science using a Literate Programming Tool , 2018, CHI.

[53]  Roman Rädle,et al.  Codestrates: Literate Computing with Webstrates , 2017, UIST.

[54]  Catherine Plaisant,et al.  The challenge of information visualization evaluation , 2004, AVI.

[55]  Donald E. Knuth,et al.  Literate Programming , 1984, Comput. J..

[56]  Melanie Tory,et al.  Supporting Communication and Coordination in Collaborative Sensemaking , 2014, IEEE Transactions on Visualization and Computer Graphics.

[57]  Kaj Grønbæk,et al.  Clear Visual Separation of Temporal Event Sequences , 2017, 2017 IEEE Visualization in Data Science (VDS).

[58]  Arvind Satyanarayan,et al.  Declarative interaction design for data visualization , 2014, UIST.

[59]  J.C. Roberts,et al.  State of the Art: Coordinated & Multiple Views in Exploratory Visualization , 2007, Fifth International Conference on Coordinated and Multiple Views in Exploratory Visualization (CMV 2007).

[60]  Helen Shen,et al.  Interactive notebooks: Sharing the code , 2014, Nature.

[61]  P. Pirolli,et al.  The Sensemaking Process and Leverage Points for Analyst Technology as Identified Through Cognitive Task Analysis , 2007 .

[62]  Barbara Minto The Pyramid Principle: Logic in Writing and Thinking , 1981 .

[63]  Martin Wattenberg,et al.  ManyEyes: a Site for Visualization at Internet Scale , 2007, IEEE Transactions on Visualization and Computer Graphics.

[64]  Nikhil Sharma,et al.  Sensemaking handoff: When and how? , 2008, ASIST.

[65]  Edward Lank,et al.  Knowledge Graphs versus Hierarchies: An Analysis of User Behaviours and Perspectives in Information Seeking , 2016, CHIIR.

[66]  Mark Gerstein,et al.  Structuring supplemental materials in support of reproducibility , 2017, Genome Biology.