Inking Your Insights: Investigating Digital Externalization Behaviors During Data Analysis

Externalizing one's thoughts can be helpful during data analysis, such as which one marks interesting data, notes hypotheses, and draws diagrams. In this paper, we present two exploratory studies conducted to investigate types and use of externalizations during the analysis process. We first studied how people take notes during different stages of data analysis using VoyagerNote, a visualization recommendation system augmented to support text annotations, and coupled with participants' favorite external note-taking tools (e.g., word processor, pen & paper). Externalizations manifested mostly as notes written on paper or in a word processor, with annotations atop views used almost exclusively in the initial phase of analysis. In the second study, we investigated two specific opportunities: (1) integrating digital pen input to facilitate the use of free-form externalizations and (2) providing a more explicit linking between visualizations and externalizations. We conducted the study with VoyagerInk, a visualization system that enabled free-form externalization with a digital pen as well as touch interactions to link externalizations to data. Participants created more graphical externalizations with VoyagerInk and revisited over half of their externalizations via the linking mechanism. Reflecting on the findings from these two studies, we discuss implications for the design of data analysis tools.

[1]  Fabrice Matulic,et al.  Supporting active reading on pen and touch-operated tabletops , 2012, AVI.

[2]  Kenton O'Hara,et al.  A diary study of work-related reading: design implications for digital reading devices , 1998, CHI.

[3]  Melanie Tory,et al.  A closer look at note taking in the co-located collaborative visual analytics process , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[4]  Paul Johns,et al.  Understanding Pen and Touch Interaction for Data Exploration on Interactive Whiteboards , 2012, IEEE Transactions on Visualization and Computer Graphics.

[5]  Robert Harper,et al.  Stories in GeoTime , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[6]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[7]  Tobias Höllerer,et al.  ChartAccent: Annotation for data-driven storytelling , 2017, 2017 IEEE Pacific Visualization Symposium (PacificVis).

[8]  Shigeru Makino,et al.  QueryLines: approximate query for visual browsing , 2005, CHI 2005.

[9]  Ivan Denisovich,et al.  Software support for annotation of visualized data using hand-drawn marks , 2005, Ninth International Conference on Information Visualisation (IV'05).

[10]  Alexander W. Skaburskis,et al.  The Sandbox for analysis: concepts and methods , 2006, CHI.

[11]  James D. Hollan,et al.  Deixis and the future of visualization excellence , 1991, Proceeding Visualization '91.

[12]  Jarke J. van Wijk,et al.  Supporting the analytical reasoning process in information visualization , 2008, CHI.

[13]  Michelle X. Zhou,et al.  Interactive Visual Synthesis of Analytic Knowledge , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[14]  Martin Wattenberg,et al.  Sketching a graph to query a time-series database , 2001, CHI Extended Abstracts.

[15]  Scott Barlowe,et al.  Click2Annotate: Automated Insight Externalization with rich semantics , 2010, 2010 IEEE Symposium on Visual Analytics Science and Technology.

[16]  Dennis P. Groth,et al.  A collaborative annotation system for data visualization , 2004, AVI.

[17]  Monika Richter,et al.  Cognition In The Wild , 2016 .

[18]  M. Sheelagh T. Carpendale,et al.  Beyond Mouse and Keyboard: Expanding Design Considerations for Information Visualization Interactions , 2012, IEEE Transactions on Visualization and Computer Graphics.

[19]  Martin Wattenberg,et al.  Voyagers and voyeurs: supporting asynchronous collaborative information visualization , 2007, CHI.

[20]  M. Sheelagh T. Carpendale,et al.  Data analysis on interactive whiteboards through sketch-based interaction , 2011, ITS '11.

[21]  Adrienne E. Williams,et al.  The impact of laptop-free zones on student performance and attitudes in large lectures , 2012, Comput. Educ..

[22]  Bongshin Lee,et al.  TouchPivot: Blending WIMP & Post-WIMP Interfaces for Data Exploration on Tablet Devices , 2017, CHI.

[23]  Daniel M. Oppenheimer,et al.  The Pen Is Mightier Than the Keyboard , 2014, Psychological science.

[24]  David Kirsh,et al.  Thinking with external representations , 2010, AI & SOCIETY.

[25]  Bill N. Schilit,et al.  Beyond paper: supporting active reading with free form digital ink annotations , 1998, CHI.

[26]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[27]  Kibum Kim,et al.  Requirements for electronic note taking systems: A field study of note taking in university classrooms , 2009, Education and Information Technologies.

[28]  John T. Stasko,et al.  Characterizing the intelligence analysis process through a longitudinal field study: Implications for visual analytics , 2014, Inf. Vis..

[29]  Melanie Tory,et al.  Supporting Communication and Coordination in Collaborative Sensemaking , 2014, IEEE Transactions on Visualization and Computer Graphics.

[30]  M. Sheelagh T. Carpendale,et al.  An Exploratory Study of Data Sketching for Visual Representation , 2015, Comput. Graph. Forum.

[31]  Carsten Binnig,et al.  Vizdom: Interactive Analytics through Pen and Touch , 2015, Proc. VLDB Endow..

[32]  Kenneth A. Kiewra A review of note-taking: The encoding-storage paradigm and beyond , 1989 .

[33]  George Chin,et al.  Exploring the analytical processes of intelligence analysts , 2009, CHI.

[34]  Yann Riche,et al.  As We May Ink?: Learning from Everyday Analog Pen Use to Improve Digital Ink Experiences , 2017, CHI.

[35]  Bongshin Lee,et al.  ActiveInk: (Th)Inking with Data , 2019, CHI.

[36]  John T. Stasko,et al.  Evaluating visual analytics systems for investigative analysis: Deriving design principles from a case study , 2009, 2009 IEEE Symposium on Visual Analytics Science and Technology.

[37]  Charles Perin,et al.  Active Reading of Visualizations , 2018, IEEE Transactions on Visualization and Computer Graphics.

[38]  Jian Zhao,et al.  Annotation Graphs: A Graph-Based Visualization for Meta-Analysis of Data Based on User-Authored Annotations , 2017, IEEE Transactions on Visualization and Computer Graphics.

[39]  N. Cowan Attention and Memory: An Integrated Framework , 1995 .

[40]  Emanuel Zgraggen,et al.  PanoramicData: Data Analysis through Pen & Touch , 2014, IEEE Transactions on Visualization and Computer Graphics.

[41]  Desney S. Tan,et al.  InkSeine: In Situ search for active note taking , 2007, CHI.

[42]  Bongshin Lee,et al.  SketchStory: Telling More Engaging Stories with Data through Freeform Sketching , 2013, IEEE Transactions on Visualization and Computer Graphics.

[43]  Kanit Wongsuphasawat,et al.  Voyager: Exploratory Analysis via Faceted Browsing of Visualization Recommendations , 2016, IEEE Transactions on Visualization and Computer Graphics.

[44]  M. Sheelagh T. Carpendale,et al.  SketchInsight: Natural data exploration on interactive whiteboards leveraging pen and touch interaction , 2015, 2015 IEEE Pacific Visualization Symposium (PacificVis).

[45]  Guang Li,et al.  SketchComm: a tool to support rich and flexible asynchronous communication of early design ideas , 2012, CSCW.

[46]  Melanie Tory,et al.  Note-taking in co-located collaborative visual analytics: Analysis of an observational study , 2012, Inf. Vis..