Exploring Visualization Implementation Challenges Faced by D3 Users Online

Visualization languages help to standardize the process of designing effective visualizations, one of the most prominent being D3.js. However, few researchers have analyzed at scale how users incorporate these languages into existing visualization implementation processes, i.e., implementation workflows. In this paper, we present a new method for evaluating visualization languages. Our method emphasizes the experiences of users as observed through the online communities that have sprouted to facilitate public discussion and support around visualization languages. We demonstrate our method by analyzing D3 implementation workflows and challenges discussed on Stack Overflow. Our results show how the visualization community may be limiting its understanding of users’ visualization implementation challenges by ignoring the larger context in which languages such as D3 are used. Based on our findings, we suggest new research directions to enhance the user experience with visualization languages. All our data and code are available at: https://osf.io/fup48/?view_only=2cdecfd00f1048a98064b381bde27c18.

[1]  Jeffrey Heer,et al.  Reverse‐Engineering Visualizations: Recovering Visual Encodings from Chart Images , 2017, Comput. Graph. Forum.

[2]  The Public Life of Data: Investigating Reactions to Visualizations on Reddit , 2021, CHI.

[3]  Elena L. Glassman,et al.  Interactive Extraction of Examples from Existing Code , 2018, CHI.

[4]  Yong Wang,et al.  Towards Automated Infographic Design: Deep Learning-based Auto-Extraction of Extensible Timeline , 2019, IEEE Transactions on Visualization and Computer Graphics.

[5]  Hadley Wickham,et al.  ggplot2 - Elegant Graphics for Data Analysis (2nd Edition) , 2017 .

[6]  William E. Lorensen,et al.  The design and implementation of an object-oriented toolkit for 3D graphics and visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[7]  Arvind Satyanarayan,et al.  Vega-Lite: A Grammar of Interactive Graphics , 2018, IEEE Transactions on Visualization and Computer Graphics.

[8]  Miryung Kim,et al.  Are Code Examples on an Online Q&A Forum Reliable?: A Study of API Misuse on Stack Overflow , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE).

[9]  Aditya G. Parameswaran,et al.  SeeDB: Efficient Data-Driven Visualization Recommendations to Support Visual Analytics , 2015, Proc. VLDB Endow..

[10]  Pedro M. Valero-Mora,et al.  ggplot2: Elegant Graphics for Data Analysis , 2010 .

[11]  Maneesh Agrawala,et al.  Deconstructing and restyling D3 visualizations , 2014, UIST.

[12]  Sheryl Staub-French,et al.  Qualitative analysis of visualization: a building design field study , 2008, BELIV.

[13]  Guoliang Li,et al.  DeepEye: Towards Automatic Data Visualization , 2018, 2018 IEEE 34th International Conference on Data Engineering (ICDE).

[14]  Yaxing Wei,et al.  Bridging Theory with Practice: An Exploratory Study of Visualization Use and Design for Climate Model Comparison , 2015, IEEE Transactions on Visualization and Computer Graphics.

[15]  Arvind Satyanarayan,et al.  Reactive Vega: A Streaming Dataflow Architecture for Declarative Interactive Visualization , 2016, IEEE Transactions on Visualization and Computer Graphics.

[16]  John T. Stasko,et al.  Data Illustrator: Augmenting Vector Design Tools with Lazy Data Binding for Expressive Visualization Authoring , 2018, CHI.

[17]  Guoliang Li,et al.  DeepEye: Creating Good Data Visualizations by Keyword Search , 2018, SIGMOD Conference.

[18]  Wei Li,et al.  Cultural influences on knowledge sharing through online communities of practice , 2006, J. Knowl. Manag..

[19]  Bongshin Lee,et al.  ChartSense: Interactive Data Extraction from Chart Images , 2017, CHI.

[20]  David R. Karger,et al.  End-users publishing structured information on the web: an observational study of what, why, and how , 2014, CHI.

[21]  Tim Kraska,et al.  VizML: A Machine Learning Approach to Visualization Recommendation , 2018, CHI.

[22]  M. Sheelagh T. Carpendale,et al.  Empirical Studies in Information Visualization: Seven Scenarios , 2012, IEEE Transactions on Visualization and Computer Graphics.

[23]  Arvind Satyanarayan,et al.  Critical Reflections on Visualization Authoring Systems , 2019, IEEE Transactions on Visualization and Computer Graphics.

[24]  Jeffrey C. Carver,et al.  Building reputation in StackOverflow: An empirical investigation , 2013, 2013 10th Working Conference on Mining Software Repositories (MSR).

[25]  Kanit Wongsuphasawat,et al.  Voyager 2: Augmenting Visual Analysis with Partial View Specifications , 2017, CHI.

[26]  Philip J. Guo,et al.  Paradise unplugged: identifying barriers for female participation on stack overflow , 2016, SIGSOFT FSE.

[27]  Ranjitha Kumar,et al.  Webzeitgeist: design mining the web , 2013, CHI.

[28]  Melanie Tory,et al.  How Information Visualization Novices Construct Visualizations , 2010, IEEE Trans. Vis. Comput. Graph..

[29]  Alberto Bacchelli,et al.  One-Day Flies on StackOverflow - Why the Vast Majority of StackOverflow Users Only Posts Once , 2015, 2015 IEEE/ACM 12th Working Conference on Mining Software Repositories.

[30]  M. Sheelagh T. Carpendale,et al.  An exploratory study of visual information analysis , 2008, CHI.

[31]  Ravi Kumar,et al.  Great Question! Question Quality in Community Q&A , 2014, ICWSM.

[32]  Alex Endert,et al.  Evaluating Interactive Graphical Encodings for Data Visualization , 2018, IEEE Transactions on Visualization and Computer Graphics.

[33]  Pat Hanrahan,et al.  Show Me: Automatic Presentation for Visual Analysis , 2007, IEEE Transactions on Visualization and Computer Graphics.

[34]  Babak Saleh,et al.  Learning style similarity for searching infographics , 2015, Graphics Interface.

[35]  Jure Leskovec,et al.  Discovering value from community activity on focused question answering sites: a case study of stack overflow , 2012, KDD.

[36]  Christoph Treude,et al.  How do programmers ask and answer questions on the web?: NIER track , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[37]  R. Mendes.  Popular Blocks - bl.ocks.org , 2016 .

[38]  Leilani Battle,et al.  Debugging Database Queries: A Survey of Tools, Techniques, and Users , 2020, CHI.

[39]  Wei Chen,et al.  The design space of construction tools for information visualization: A survey , 2017, J. Vis. Lang. Comput..

[40]  Maneesh Agrawala,et al.  Searching the Visual Style and Structure of D3 Visualizations , 2019, IEEE Transactions on Visualization and Computer Graphics.

[41]  Ponnurangam Kumaraguru,et al.  Signals Matter: Understanding Popularity and Impact of Users on Stack Overflow , 2019, WWW.

[42]  Maneesh Agrawala,et al.  Converting Basic D3 Charts into Reusable Style Templates , 2016, IEEE Transactions on Visualization and Computer Graphics.

[43]  M. Sheelagh T. Carpendale,et al.  SketchInsight: Natural data exploration on interactive whiteboards leveraging pen and touch interaction , 2015, 2015 IEEE Pacific Visualization Symposium (PacificVis).

[44]  Jeffrey Heer,et al.  Formalizing Visualization Design Knowledge as Constraints: Actionable and Extensible Models in Draco , 2018, IEEE Transactions on Visualization and Computer Graphics.

[45]  Niklas Elmqvist,et al.  The Interactive Visualization Gap in Initial Exploratory Data Analysis , 2018, IEEE Transactions on Visualization and Computer Graphics.

[46]  Katharina Reinecke,et al.  r/science: Challenges and Opportunities in Online Science Communication , 2019, CHI.

[47]  Leilani Battle,et al.  Making Sense of Temporal Queries with Interactive Visualization , 2016, CHI.

[48]  HeerJeffrey,et al.  D3 Data-Driven Documents , 2011 .

[49]  Scott R. Klemmer,et al.  d.tour: style-based exploration of design example galleries , 2011, UIST.

[50]  John T. Stasko,et al.  Toward a Deeper Understanding of the Role of Interaction in Information Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.

[51]  Arvind Satyanarayan,et al.  Lyra 2: Designing Interactive Visualizations by Demonstration , 2020, IEEE transactions on visualization and computer graphics.

[52]  Kevin Chen-Chuan Chang,et al.  Characterizing Scalability Issues in Spreadsheet Software using Online Forums , 2018, CHI Extended Abstracts.

[53]  Ben Shneiderman,et al.  Strategies for evaluating information visualization tools: multi-dimensional in-depth long-term case studies , 2006, BELIV '06.

[54]  Martin Wattenberg,et al.  ManyEyes: a Site for Visualization at Internet Scale , 2007, IEEE Transactions on Visualization and Computer Graphics.

[55]  Tamara Munzner,et al.  A Multi-Level Typology of Abstract Visualization Tasks , 2013, IEEE Transactions on Visualization and Computer Graphics.

[56]  Michael Stonebraker,et al.  Beagle : Automated Extraction and Interpretation of Visualizations from the Web , 2017 .

[57]  Çagatay Demiralp,et al.  Data2Vis: Automatic Generation of Data Visualizations Using Sequence-to-Sequence Recurrent Neural Networks , 2018, IEEE Computer Graphics and Applications.

[58]  Peter J. Haas,et al.  Foresight: Recommending Visual Insights , 2017, Proc. VLDB Endow..

[59]  Jeffrey Heer,et al.  ReVision: automated classification, analysis and redesign of chart images , 2011, UIST.

[60]  Chew Lim Tan,et al.  A system for understanding imaged infographics and its applications , 2007, DocEng '07.