Searching the Visual Style and Structure of D3 Visualizations

We present a search engine for D3 visualizations that allows queries based on their visual style and underlying structure. To build the engine we crawl a collection of 7860 D3 visualizations from the Web and deconstruct each one to recover its data, its data-encoding marks and the encodings describing how the data is mapped to visual attributes of the marks. We also extract axes and other non-data-encoding attributes of marks (e.g., typeface, background color). Our search engine indexes this style and structure information as well as metadata about the webpage containing the chart. We show how visualization developers can search the collection to find visualizations that exhibit specific design characteristics and thereby explore the space of possible designs. We also demonstrate how researchers can use the search engine to identify commonly used visual design patterns and we perform such a demographic design analysis across our collection of D3 charts. A user study reveals that visualization developers found our style and structure based search engine to be significantly more useful and satisfying for finding different designs of D3 charts, than a baseline search engine that only allows keyword search over the webpage containing a chart.

[1]  Arvind Satyanarayan,et al.  Vega-Lite: A Grammar of Interactive Graphics , 2018, IEEE Transactions on Visualization and Computer Graphics.

[2]  Lane Harrison,et al.  SightLine: Building on the Web's Visualization Ecosystem , 2017, CHI Extended Abstracts.

[3]  Jeffrey Heer,et al.  Extracting and Retargeting Color Mappings from Bitmap Images of Visualizations , 2018, IEEE Transactions on Visualization and Computer Graphics.

[4]  Ali Farhadi,et al.  FigureSeer: Parsing Result-Figures in Research Papers , 2016, ECCV.

[5]  David S. Rosenberg,et al.  Scatteract: Automated Extraction of Data from Scatter Plots , 2017, ECML/PKDD.

[6]  Zhe Chen,et al.  DiagramFlyer: A Search Engine for Data-Driven Diagrams , 2015, WWW.

[7]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[8]  Jock D. Mackinlay,et al.  Automating the design of graphical presentations of relational information , 1986, TOGS.

[9]  Michelle A. Borkin,et al.  What Makes a Visualization Memorable? , 2013, IEEE Transactions on Visualization and Computer Graphics.

[10]  Leland Wilkinson The Grammar of Graphics , 1999 .

[11]  Jeffrey Heer,et al.  Graphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[12]  Maneesh Agrawala,et al.  Deconstructing and restyling D3 visualizations , 2014, UIST.

[13]  Scott R. Klemmer,et al.  d.tour: style-based exploration of design example galleries , 2011, UIST.

[14]  Bill Howe,et al.  VizioMetrix: A Platform for Analyzing the Visual Information in Big Scholarly Data , 2016, WWW.

[15]  Jeffrey Heer,et al.  Reverse‐Engineering Visualizations: Recovering Visual Encodings from Chart Images , 2017, Comput. Graph. Forum.

[16]  Thomas Zichner,et al.  KnowledgePearls: Provenance-Based Visualization Retrieval , 2019, IEEE Transactions on Visualization and Computer Graphics.

[17]  Hanspeter Pfister,et al.  What Makes a Visualization Memorable? , 2013, IEEE Transactions on Visualization and Computer Graphics.

[18]  Alex Endert,et al.  Visualization by Demonstration: An Interaction Paradigm for Visual Data Exploration , 2017, IEEE Transactions on Visualization and Computer Graphics.

[19]  Ranjitha Kumar,et al.  Webzeitgeist: design mining the web , 2013, CHI.

[20]  Kanit Wongsuphasawat,et al.  Voyager 2: Augmenting Visual Analysis with Partial View Specifications , 2017, CHI.

[21]  Jeffrey Heer,et al.  ReVision: automated classification, analysis and redesign of chart images , 2011, UIST.

[22]  Bongshin Lee,et al.  ChartSense: Interactive Data Extraction from Chart Images , 2017, CHI.

[23]  Tamara Munzner,et al.  Visualization Analysis and Design , 2014, A.K. Peters visualization series.

[24]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[25]  Maneesh Agrawala,et al.  Converting Basic D3 Charts into Reusable Style Templates , 2016, IEEE Transactions on Visualization and Computer Graphics.

[26]  Michael Stonebraker,et al.  Beagle : Automated Extraction and Interpretation of Visualizations from the Web , 2017 .

[27]  Miryung Kim,et al.  Visualizing API Usage Examples at Scale , 2018, CHI.

[28]  S. Palmer Vision Science : Photons to Phenomenology , 1999 .