Sketchnote Components, Design Space Dimensions, and Strategies for Effective Visual Note Taking

Sketchnoting is a form of visual note taking where people listen to, synthesize, and visualize ideas from a talk or other event using a combination of pictures, diagrams, and text. Little is known about the design space of this kind of visual note taking. With an eye towards informing the implementation of digital equivalents of sketchnoting, inking, and note taking, we introduce a classification of sketchnote styles and techniques, with a qualitative analysis of 103 sketchnotes, and situated in context with six semi-structured follow up interviews. Our findings distill core sketchnote components (content, layout, structuring elements, and visual styling) and dimensions of the sketchnote design space, classifying levels of conciseness, illustration, structure, personification, cohesion, and craftsmanship. We unpack strategies to address particular note taking challenges, for example dealing with constraints of live drawings, and discuss relevance for future digital inking tools, such as recomposition, styling, and design suggestions.

[1]  William Buxton,et al.  Pen + touch = new tools , 2010, UIST.

[2]  Letizia Bollini.  DRAWING AS LEARNING ENABLING META-LANGUAGE. USING SKETCH-NOTING IN THE FIELD OF EDUCATION , 2017 .

[3]  Peter Brandl,et al.  NiCEBook: supporting natural note taking , 2010, CHI.

[4]  Paul Marshall,et al.  Flexible and Mindful Self-Tracking: Design Implications from Paper Bullet Journals , 2018, CHI.

[5]  Bill Buxton,et al.  Sketching User Experiences: Getting the Design Right and the Right Design , 2007 .

[6]  Michael S. Bernstein,et al.  Information ! Scraps : ! ! How ! and ! Why ! Information ! Eludes ! our ! Personal ! Information ! Management , 2022 .

[7]  Miriam Sturdee,et al.  Sketching in HCI: Hands-on Course of Sketching Techniques , 2019, CHI Extended Abstracts.

[8]  Miriam Sturdee,et al.  SketchingDIS: Hand-drawn Sketching in HCI , 2017, Conference on Designing Interactive Systems.

[9]  Jo Vermeulen,et al.  DRAFT VERSION : Sketching and Ideation Activities for Situated Visualization Design , 2019 .

[10]  A. D. Manning,et al.  Understanding Comics: The Invisible Art , 1993 .

[11]  Jennifer Pearson,et al.  The reading desk: applying physical interactions to digital documents , 2011, CHI.

[12]  Thomas P. Moran,et al.  Pen-based interaction techniques for organizing material on an electronic whiteboard , 1997, UIST '97.

[13]  Melanie Tory,et al.  Note-taking in co-located collaborative visual analytics: Analysis of an observational study , 2012, Inf. Vis..

[14]  Bill N. Schilit,et al.  From reading to retrieval: freeform ink annotations as queries , 1999, SIGIR '99.

[15]  Wayne G. Lutters,et al.  Understanding the micronote lifecycle: improving mobile support for informal note taking , 2004, CHI.

[16]  David Kirsh,et al.  Thinking with external representations , 2010, AI & SOCIETY.

[17]  Daniel J. Wigdor,et al.  DataInk: Direct and Creative Data-Oriented Drawing , 2018, CHI.

[18]  William Buxton,et al.  Inking Outside the Box: How Context Sensing Affords More Natural Pen (and Touch) Computing , 2016, Revolutionizing Education with Digital Ink.

[19]  Nicolai Marquardt,et al.  RealPen: Providing Realism in Handwriting Tasks on Touch Surfaces using Auditory-Tactile Feedback , 2016, UIST.

[20]  Yann Riche,et al.  As We May Ink?: Learning from Everyday Analog Pen Use to Improve Digital Ink Experiences , 2017, CHI.

[21]  Lora Oehlberg,et al.  WatchPen: Using Cross-Device Interaction Concepts to Augment Pen-Based Interaction , 2019, MobileHCI.

[22]  Xiang Cao,et al.  Enhancing naturalness of pen-and-tablet drawing through context sensing , 2011, ITS '11.

[23]  Mike Rohde.  The Sketchnote Handbook: the illustrated guide to visual note taking , 2012 .

[24]  Hanspeter Pfister,et al.  What Makes a Visualization Memorable? , 2013, IEEE Transactions on Visualization and Computer Graphics.

[25]  Christine Reid,et al.  The Myth of the Paperless Office , 2003, J. Documentation.

[26]  Nicolai Marquardt,et al.  Live Sketchnoting Across Platforms: Exploring the Potential and Limitations of Analogue and Digital Tools , 2020, CHI.

[27]  Yang Li,et al.  Experimental analysis of mode switching techniques in pen-based user interfaces , 2005, CHI.

[28]  Anoop Gupta,et al.  The pen is mightier: understanding stylus behaviour while inking on tablets , 2014, Graphics Interface.

[29]  A. Lewis.  Making Comics: Storytelling Secrets of Comics, Manga and Graphic Novels , 2007 .

[30]  M. Sheelagh T. Carpendale,et al.  Visual Thinking In Action: Visualizations As Used On Whiteboards , 2011, IEEE Transactions on Visualization and Computer Graphics.

[31]  David Murray-Rust,et al.  Design Patterns for Data Comics , 2018, CHI.

[32]  M. Sheelagh T. Carpendale,et al.  Sketch & The Lizard King: Supporting Image Inclusion in HCI Publishing , 2018, CHI Extended Abstracts.

[33]  Benjamin Bach,et al.  Picturing Science: Design Patterns in Graphical Abstracts , 2018, Diagrams.

[34]  David Kirsh,et al.  The Intelligent Use of Space , 1995, Artif. Intell..

[35]  Mark Perry,et al.  Follow the Money: Managing Personal Finance Digitally , 2019, CHI.

[36]  Raimund Dachselt,et al.  Enhancing UML sketch tools with digital pens and paper , 2008, SoftVis '08.

[37]  Alma R. Hoffmann.  Sketching as Design Thinking , 2019 .

[38]  Robert Dimeo.  Sketchnoting: an analog skill in the digital age , 2016, CSOC.