A Descriptive Attribute-Based Framework for Annotations in Data Visualization

Annotations are observations made during the exploration of a specific data visualization, which can be recorded as text or visual data selection. This article introduces a classification framework that allows a systematic description of annotations. To create the framework, a real dataset of 302 annotations authored by 16 analysts was collected. Then, three coders independently described the annotations by eliciting categories that emerged from the data. This process was repeated for several iterative phases, until a high inter-coder agreement was reached. The final descriptive attribute-based framework comprises the following dimensions: insight on data, multiple observations, data units, level of interpretation, co-references and detected patterns. This framework has the potential to provide a common ground to assess the expressiveness of different types of visualization over the same data. This potential is further illustrated in a concrete use case.

[1]  Howard Wainer,et al.  Understanding Graphs and Tables , 1992 .

[2]  Curtis C. McKnight,et al.  Task Analyses of Critical Evaluations of Quantitative Arguments: First Steps in Critical Interpretation of Graphically Presented Data. , 1990 .

[3]  Arvind Satyanarayan,et al.  Lyra: An Interactive Visualization Design Environment , 2014, Comput. Graph. Forum.

[4]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[5]  J. Fleiss Measuring nominal scale agreement among many raters. , 1971 .

[6]  Arvind Satyanarayan,et al.  Reactive Vega: A Streaming Dataflow Architecture for Declarative Interactive Visualization , 2016, IEEE Transactions on Visualization and Computer Graphics.

[7]  Tobias Höllerer,et al.  ChartAccent: Annotation for data-driven storytelling , 2017, 2017 IEEE Pacific Visualization Symposium (PacificVis).

[8]  Tamara Munzner,et al.  Visualization Analysis and Design , 2014, A.K. Peters visualization series.

[9]  Kanit Wongsuphasawat,et al.  Voyager: Exploratory Analysis via Faceted Browsing of Visualization Recommendations , 2016, IEEE Transactions on Visualization and Computer Graphics.

[10]  Arvind Satyanarayan,et al.  Vega-Lite: A Grammar of Interactive Graphics , 2018, IEEE Transactions on Visualization and Computer Graphics.

[11]  Susan N. Friel,et al.  Making sense of graphs: Critical factors influencing comprehension and instructional implications. , 2001 .

[12]  Jeffrey Heer,et al.  SpanningAspectRatioBank Easing FunctionS ArrayIn ColorIn Date Interpolator MatrixInterpola NumObjecPointI Rectang ISchedu Parallel Pause Scheduler Sequen Transition Transitioner Transiti Tween Co DelimGraphMLCon IData JSONCon DataField DataSc Dat DataSource Data DataUtil DirtySprite LineS RectSprite , 2011 .

[13]  Frances R. Curcio,et al.  Comprehension of Mathematical Relationships Expressed in Graphs. , 1987 .

[14]  Jian Zhao,et al.  Annotation Graphs: A Graph-Based Visualization for Meta-Analysis of Data Based on User-Authored Annotations , 2017, IEEE Transactions on Visualization and Computer Graphics.

[15]  Denis Lalanne,et al.  Designing a Classification for User-authored Annotations in Data Visualization , 2018, VISIGRAPP.

[16]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[17]  C M Carswell,et al.  Choosing Specifiers: An Evaluation of the Basic Tasks Model of Graphical Perception , 1992, Human factors.

[18]  Jean-Daniel Fekete,et al.  A Principled Way of Assessing Visualization Literacy , 2014, IEEE Transactions on Visualization and Computer Graphics.

[19]  Martin Wattenberg,et al.  Voyagers and voyeurs: Supporting asynchronous collaborative visualization , 2009, CACM.

[20]  Paul Johns,et al.  Pathfinder: an online collaboration environment for citizen scientists , 2009, CHI.

[21]  Jeffrey Heer,et al.  CommentSpace: structured support for collaborative visual analysis , 2011, CHI.

[22]  Martin Wattenberg,et al.  ManyEyes: a Site for Visualization at Internet Scale , 2007, IEEE Transactions on Visualization and Computer Graphics.