SketchStory: Telling More Engaging Stories with Data through Freeform Sketching

Presenting and communicating insights to an audience-telling a story-is one of the main goals of data exploration. Even though visualization as a storytelling medium has recently begun to gain attention, storytelling is still underexplored in information visualization and little research has been done to help people tell their stories with data. To create a new, more engaging form of storytelling with data, we leverage and extend the narrative storytelling attributes of whiteboard animation with pen and touch interactions. We present SketchStory, a data-enabled digital whiteboard that facilitates the creation of personalized and expressive data charts quickly and easily. SketchStory recognizes a small set of sketch gestures for chart invocation, and automatically completes charts by synthesizing the visuals from the presenter-provided example icon and binding them to the underlying data. Furthermore, SketchStory allows the presenter to move and resize the completed data charts with touch, and filter the underlying data to facilitate interactive exploration. We conducted a controlled experiment for both audiences and presenters to compare SketchStory with a traditional presentation system, Microsoft PowerPoint. Results show that the audience is more engaged by presentations done with SketchStory than PowerPoint. Eighteen out of 24 audience participants preferred SketchStory to PowerPoint. Four out of five presenter participants also favored SketchStory despite the extra effort required for presentation.

[1]  William Buxton,et al.  Pen + touch = new tools , 2010, UIST.

[2]  Martin Wattenberg,et al.  Voyagers and voyeurs: supporting asynchronous collaborative information visualization , 2007, CHI.

[3]  Guang Li,et al.  SketchComm: a tool to support rich and flexible asynchronous communication of early design ideas , 2012, CSCW.

[4]  Tobias Isenberg,et al.  Sketchy Rendering for Information Visualization , 2012, IEEE Transactions on Visualization and Computer Graphics.

[5]  Matthew Fifolt,et al.  The back of the napkin: Solving problems and selling ideas with pictures , 2011 .

[6]  Joseph J. LaViola,et al.  MathPad2: a system for the creation and exploration of mathematical sketches , 2004, ACM Trans. Graph..

[7]  Carl Gutwin,et al.  Useful junk?: the effects of visual embellishment on comprehension and memorability of charts , 2010, CHI.

[8]  Stefan Schlechtweg,et al.  Non-photorealistic computer graphics: modeling, rendering, and animation , 2002 .

[9]  Dan Roam,et al.  The Back of the Napkin: Solving Problems and Selling Ideas with Pictures , 2008 .

[10]  Jeremy Hsu The Secrets of Storytelling , 2008 .

[11]  Jeffrey Heer,et al.  Graphical Histories for Visualization: Supporting Analysis, Communication, and Evaluation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[12]  Daniel A. Keim,et al.  Information Visualization and Visual Data Mining , 2002, IEEE Trans. Vis. Comput. Graph..

[13]  Paul Johns,et al.  Understanding Pen and Touch Interaction for Data Exploration on Interactive Whiteboards , 2012, IEEE Transactions on Visualization and Computer Graphics.

[14]  Nahum Gershon,et al.  What storytelling can do for information visualization , 2001, Commun. ACM.

[15]  Brian C. Dean BEYOND SCREEN CAPTURE: CREATING EFFECTIVE MULTIMEDIA WHITEBOARD LECTURES ON A TABLET PC , 2006 .

[16]  Saul Greenberg,et al.  1.2 – Why Should I Sketch?: a synopsis of Buxton's Sketching User Experiences: Getting the Design Right and the Right Design , 2012 .

[17]  Duncan Smith Your Brain on Fiction , 2009 .

[18]  Abigail Sellen,et al.  Getting the right design and the design right , 2006, CHI.

[19]  B. Shneiderman,et al.  The dynamic HomeFinder: evaluating dynamic queries in a real-estate information exploration system , 1992, SIGIR '92.

[20]  Shigeru Makino,et al.  QueryLines: approximate query for visual browsing , 2005, CHI 2005.

[21]  Ellen Yi-Luen Do,et al.  Ambiguous intentions: a paper-like interface for creative design , 1996, UIST '96.

[22]  Martin Wattenberg,et al.  ManyEyes: a Site for Visualization at Internet Scale , 2007, IEEE Transactions on Visualization and Computer Graphics.

[23]  Ravin Balakrishnan,et al.  ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models , 2008, UIST '08.

[24]  Ivan E. Sutherland,et al.  Sketchpad a Man-Machine Graphical Communication System , 1899, Outstanding Dissertations in the Computer Sciences.

[25]  Takeo Igarashi,et al.  Vignette: interactive texture design and manipulation with freeform gestures for pen-and-ink illustration , 2012, CHI.

[26]  Thomas Strothotte,et al.  Assessing the effect of non-photorealistic rendered images in CAD , 1996, CHI '96.

[27]  Joseph J. LaViola,et al.  MathPad2: a system for the creation and exploration of mathematical sketches , 2004, SIGGRAPH 2004.

[28]  Jeffrey Heer,et al.  Narrative Visualization: Telling Stories with Data , 2010, IEEE Transactions on Visualization and Computer Graphics.

[29]  M. Sheelagh T. Carpendale,et al.  Data analysis on interactive whiteboards through sketch-based interaction , 2011, ITS '11.

[30]  Robert Harper,et al.  Stories in GeoTime , 2007, 2007 IEEE Symposium on Visual Analytics Science and Technology.

[31]  Sumit Gulwani,et al.  QuickDraw: improving drawing experience for geometric diagrams , 2012, CHI.

[32]  Sheelagh Carpendale,et al.  Sketching user experiences , 2012 .

[33]  Kok-Lim Low,et al.  SandCanvas: a multi-touch art medium inspired by sand animation , 2011, CHI.

[34]  Joseph J. LaViola,et al.  A Pen-Based Tool for Visualizing Vector Mathematics , 2010, SBIM.

[35]  Allison Woodruff,et al.  Guidelines for using multiple views in information visualization , 2000, AVI '00.

[36]  James A. Landay,et al.  Interactive sketching for the early stages of user interface design , 1995, CHI '95.

[37]  Martin Wattenberg,et al.  Sketching a graph to query a time-series database , 2001, CHI Extended Abstracts.

[38]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[39]  Thomas Strothotte,et al.  Psychology and Non-Photorealistic Rendering: The Beginning of a Beautiful Relationship , 2003, MuC.

[40]  James A. Landay,et al.  K-sketch: a 'kinetic' sketch pad for novice animators , 2008, CHI.

[41]  Mark W. Newman,et al.  DENIM: an informal tool for early stage web site design , 2001, CHI Extended Abstracts.