Leveraging Text-Chart Links to Support Authoring of Data-Driven Articles with VizFlow

Data-driven articles—i.e., articles featuring text and supporting charts—play a key role in communicating information to the public. New storytelling formats like scrollytelling apply compelling dynamics to these articles to help walk readers through complex insights, but are challenging to craft. In this work, we investigate ways to support authors of data-driven articles using such storytelling forms via a text-chart linking strategy. From formative interviews with 6 authors and an assessment of 43 scrollytelling stories, we built VizFlow, a prototype system that uses text-chart links to support a range of dynamic layouts. We validate our text-chart linking approach via an authoring study with 12 participants using VizFlow, and a reading study with 24 participants comparing versions of the same article with different VizFlow intervention levels. Assessments showed our approach enabled a rapid and expressive authoring experience, and informed key design recommendations for future efforts in the space.

[1]  Fabian Beck,et al.  Exploring Interactive Linking Between Text and Visualization , 2018, EuroVis.

[2]  Jeffrey Heer,et al.  Reverse‐Engineering Visualizations: Recovering Visual Encodings from Chart Images , 2017, Comput. Graph. Forum.

[3]  Cristina Conati,et al.  User-adaptive Support for Processing Magazine Style Narrative Visualizations: Identifying User Characteristics that Matter , 2018, IUI.

[4]  Ajay Joshi,et al.  LEAF-QA: Locate, Encode & Attend for Figure Question Answering , 2019, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[5]  Bongshin Lee,et al.  Emerging and Recurring Data-Driven Storytelling Techniques: Analysis of a Curated Collection of Recent Stories , 2016 .

[6]  C. Conati,et al.  Gaze-Driven Links for Magazine Style Narrative Visualizations , 2020, 2020 IEEE Visualization Conference (VIS).

[7]  Waralak V. Siricharoen.  Infographics: The New Communication Tools in Digital Age , 2013 .

[8]  Arvind Satyanarayan,et al.  Critical Reflections on Visualization Authoring Systems , 2019, IEEE Transactions on Visualization and Computer Graphics.

[9]  Walter J. Scheirer,et al.  Coupling Story to Visualization: Using Textual Analysis as a Bridge Between Data and Interpretation , 2017, IUI.

[10]  Jeffrey Heer,et al.  ReVision: automated classification, analysis and redesign of chart images , 2011, UIST.

[11]  Fabian Beck,et al.  Authoring Combined Textual and Visual Descriptions of Graph Data , 2019, EuroVis.

[12]  Ben Shneiderman,et al.  Creativity support tools: accelerating discovery and innovation , 2007, CACM.

[13]  Cristina Conati,et al.  Eye-Tracking to Predict User Cognitive Abilities and Performance for User-Adaptive Narrative Visualizations , 2020, ICMI.

[14]  Jeffrey Heer,et al.  Narrative Visualization: Telling Stories with Data , 2010, IEEE Transactions on Visualization and Computer Graphics.

[15]  Wilmot Li,et al.  Techniques for Flexible Responsive Visualization Design , 2020, CHI.

[16]  Michael Stonebraker,et al.  Beagle : Automated Extraction and Interpretation of Visualizations from the Web , 2017 .

[17]  Maneesh Agrawala,et al.  Facilitating Document Reading by Linking Text and Tables , 2018, UIST.

[18]  Karrie Karahalios,et al.  Internal and External Visual Cue Preferences for Visualizations in Presentations , 2017, Comput. Graph. Forum.

[19]  Jie Li,et al.  Supporting Story Synthesis: Bridging the Gap between Visual Analytics and Storytelling , 2020, IEEE Transactions on Visualization and Computer Graphics.

[20]  Bongshin Lee,et al.  Visual Narrative Flow: Exploring Factors Shaping Data Visualization Story Reading Experiences , 2017, Comput. Graph. Forum.

[21]  B. Thomas,et al.  Usability Evaluation In Industry , 1996 .

[22]  Kevin Mu,et al.  War of Words , 2015 .

[23]  Wei Chen,et al.  The design space of construction tools for information visualization: A survey , 2017, J. Vis. Lang. Comput..

[24]  M. Sheelagh T. Carpendale,et al.  More Than Telling a Story: Transforming Data into Visually Shared Stories , 2015, IEEE Computer Graphics and Applications.

[25]  Pierre Dragicevic,et al.  Increasing the Transparency of Research Papers with Explorable Multiverse Analyses , 2019, CHI.

[26]  R. Harper,et al.  Stories in GeoTime , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[27]  Robert S. Laramee,et al.  Storytelling and Visualization: An Extended Survey , 2018, Inf..

[28]  Arvind Satyanarayan,et al.  Authoring Narrative Visualizations with Ellipsis , 2014, Comput. Graph. Forum.

[29]  Sean Milmo.  Making it big , 2006 .

[30]  Shawn Graham.  A Visual Introduction to Machine Learning , 2015 .

[31]  John T. Stasko,et al.  Data Illustrator: Augmenting Vector Design Tools with Lazy Data Binding for Expressive Visualization Authoring , 2018, CHI.

[32]  Jeffrey Heer,et al.  Idyll: A Markup Language for Authoring and Publishing Interactive Articles on the Web , 2018, UIST.

[33]  Michael Zeiller,et al.  Scrollytelling – An Analysis of Visual Storytelling in Online Journalism , 2018, 2018 22nd International Conference Information Visualisation (IV).

[34]  B. Gardiner,et al.  The dark side of Guardian comments , 2016 .

[35]  Daniel J. Wigdor,et al.  DataInk: Direct and Creative Data-Oriented Drawing , 2018, CHI.

[36]  Yuri Engelhardt,et al.  Narrative Design Patterns for Data-Driven Storytelling , 2018 .

[37]  Ronald Metoyer,et al.  Linking and Layout: Exploring the Integration of Text and Visualization in Storytelling , 2019, Comput. Graph. Forum.

[38]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[39]  Arvind Satyanarayan,et al.  Vega-Lite: A Grammar of Interactive Graphics , 2018, IEEE Transactions on Visualization and Computer Graphics.

[40]  Cristina Conati,et al.  Gaze-Driven Adaptive Interventions for Magazine-Style Narrative Visualizations , 2019, IEEE transactions on visualization and computer graphics.

[41]  Sharon Brownie.  I'll have what they're having. , 2015, The lancet. Diabetes & endocrinology.

[42]  Jeffrey Heer,et al.  Communicating with Interactive Articles , 2020 .

[43]  Maneesh Agrawala,et al.  Extracting references between text and charts via crowdsourcing , 2014, CHI.

[44]  Dieter Schmalstieg,et al.  Context-Preserving Visual Links , 2011, IEEE Transactions on Visualization and Computer Graphics.

[45]  Bongshin Lee,et al.  Authoring Data-Driven Videos with DataClips , 2017, IEEE Transactions on Visualization and Computer Graphics.

[46]  Niklas Elmqvist,et al.  Elastic Documents: Coupling Text and Tables through Contextual Visualizations for Enhanced Document Reading , 2019, IEEE Transactions on Visualization and Computer Graphics.