SpaceInk: Making Space for In-Context Annotations

When editing or reviewing a document, people directly overlay ink marks on content. For instance, they underline words, or circle elements in a fgure. These overlay marks often accompany in-context annotations in the form of handwritten footnotes and marginalia. People tend to put annotations close to the content that elicited them, but have to compose with the often-limited whitespace. We introduce SpaceInk, a design space of pen+touch techniques that make room for in-context annotations by dynamically refowing documents. We identify representative techniques in this design space, spanning both new ones and existing ones. We evaluate them in a user study, with results that inform the design of a prototype system. Our system lets users concentrate on capturing feeting thoughts, streamlining the overall annotation process by enabling the fuid inverleaving of space-making gestures with freeform ink.

[1]  Nicholas Chen,et al.  RichReview: blending ink, speech, and gesture to support collaborative document review , 2014, UIST.

[2]  Eric Saund,et al.  Stylus input and editing without prior selection of mode , 2003, UIST '03.

[3]  Beryl Plimmer,et al.  iAnnotate: Exploring Multi-User Ink Annotation in Web Browsers , 2010, AUIC.

[4]  William Buxton,et al.  A marking based interface for collaborative writing , 1993, UIST '93.

[5]  Bill N. Schilit,et al.  Beyond paper: supporting active reading with free form digital ink annotations , 1998, CHI.

[6]  Yann Riche,et al.  As We May Ink?: Learning from Everyday Analog Pen Use to Improve Digital Ink Experiences , 2017, CHI.

[7]  David Bargeron,et al.  Robust annotation positioning in digital documents , 2001, CHI.

[8]  Anoop Gupta,et al.  Using Web annotations for asynchronous collaboration around documents , 2000, CSCW '00.

[9]  Timothy S. Miller,et al.  Fluid inking: augmenting the medium of free-form inking with gestures , 2006, Graphics Interface.

[10]  Volker Roth,et al.  Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices , 2009, CHI.

[11]  Catherine C. Marshall,et al.  Annotation: from paper books to the digital library , 1997, DL '97.

[12]  I. Scott MacKenzie,et al.  Phrase sets for evaluating text entry techniques , 2003, CHI Extended Abstracts.

[13]  W. Keith Edwards,et al.  LiquidText: a flexible, multitouch environment to support active reading , 2011, CHI.

[14]  Ralf Klamma,et al.  u-Annotate: An Application for User-Driven Freeform Digital Ink Annotation of E-Learning Content , 2006, Sixth IEEE International Conference on Advanced Learning Technologies (ICALT'06).

[15]  Takeo Igarashi,et al.  A negotiation architecture for fluid documents , 1998, UIST '98.

[16]  Nicholas Chen,et al.  TextTearing: opening white space for digital ink annotation , 2013, UIST.

[17]  Maneesh Agrawala,et al.  DIZI: A Digital Ink Zooming Interface for Document Annotation , 2005, INTERACT.

[18]  Fabrice Matulic,et al.  Supporting active reading on pen and touch-operated tabletops , 2012, AVI.

[19]  Carl Gutwin,et al.  Faster document navigation with space-filling thumbnails , 2006, CHI.

[20]  Catherine C. Marshall,et al.  Reading and Writing the Electronic Book , 2009, Reading and Writing the Electronic Book.

[21]  Patrick Baudisch,et al.  Design and analysis of delimiters for selection-action pen gesture phrases in scriboli , 2005, CHI.

[22]  Bill N. Schilit,et al.  From reading to retrieval: freeform ink annotations as queries , 1999, SIGIR '99.

[23]  Bongshin Lee,et al.  ActiveInk: (Th)Inking with Data , 2019, CHI.

[24]  Marian Petre,et al.  Usability Analysis of Visual Programming Environments: A 'Cognitive Dimensions' Framework , 1996, J. Vis. Lang. Comput..

[25]  Hirohito Shibata,et al.  Comparison of paper and computer displays in reading including frequent movement between pages , 2014, OZCHI.

[26]  Olivier Chapuis,et al.  Designing Coherent Gesture Sets for Multi-scale Navigation on Tabletops , 2018, CHI.

[27]  Jean-Daniel Fekete,et al.  Melange: space folding for multi-focus interaction , 2008, CHI.

[28]  Ramanujan S. Kashi,et al.  An architecture for ink annotations on Web documents , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[29]  Meredith Ringel Morris,et al.  Reading Revisited: Evaluating the Usability of Digital Display Surfaces for Active Reading Tasks , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[30]  Shumin Zhai,et al.  Using strokes as command shortcuts: cognitive benefits and toolkit support , 2009, CHI.

[31]  Patrick Baudisch,et al.  The springboard: multiple modes in one spring-loaded control , 2006, CHI.

[32]  David Bargeron,et al.  Reflowing digital ink annotations , 2003, CHI '03.

[33]  Laurent Denoue,et al.  Moving markup: repositioning freeform annotations , 2002, UIST '02.

[34]  Fabrice Matulic,et al.  Unimanual Pen+Touch Input Using Variations of Precision Grip Postures , 2018, UIST.

[35]  Kenton O'Hara,et al.  A comparison of reading paper and on-line documents , 1997, CHI.

[36]  Catherine C. Marshall,et al.  Toward an ecology of hypertext annotation , 1998, HYPERTEXT '98.

[37]  Desney S. Tan,et al.  InkSeine: In Situ search for active note taking , 2007, CHI.