Knotty gestures: subtle traces to support interactive use of paper

We introduce the knotty gesture, a simple yet powerful technique for interacting with paper. Knots are tiny circles that can be added to any gesture. Users can leave subtle marks that permit both immediate interaction in the flow of writing and create rich opportunities for future interaction. We identify diverse applications of knotty gestures and explore alternative techniques for interacting with their traces. We conducted two experiments to evaluate the design and recognition heuristics and demonstrated that people can successfully execute knotty gestures, even without feedback. Knotty gestures provide users with a subtle, in-the-flow-of-writing technique for tagging information and subsequently interacting with the paper.

[1]  Pierre Dragicevic,et al.  Earpod: eyes-free menu selection using touch input and reactive audio feedback , 2007, CHI.

[2]  Wendy E. Mackay,et al.  From individual to collaborative: the evolution of prism, a hybrid laboratory notebook , 2008, CSCW.

[3]  Nadir Weibel,et al.  Paperproof: a paper-digital proof-editing system , 2008, CHI Extended Abstracts.

[4]  Chunyuan Liao,et al.  Pen-top feedback for paper-based interfaces , 2006, UIST.

[5]  Hod Lipson,et al.  ModelCraft: capturing freehand annotations and edits on physical 3D models , 2006, UIST.

[6]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[7]  Shumin Zhai,et al.  Modeling human performance of pen stroke gestures , 2007, CHI.

[8]  Scott R. Klemmer,et al.  ButterflyNet: a mobile capture and access system for field biology research , 2006, CHI.

[9]  Monica M. C. Schraefel,et al.  The radial scroll tool: scrolling support for stylus- or touch-based document navigation , 2004, UIST '04.

[10]  Gregory D. Abowd,et al.  Interaction techniques for ambiguity resolution in recognition-based interfaces , 2007, SIGGRAPH '07.

[11]  Wendy E. Mackay,et al.  The missing link: augmenting biology laboratory notebooks , 2002, UIST '02.

[12]  Chunyuan Liao,et al.  PapierCraft: a command system for interactive paper , 2005, UIST.

[13]  Thomas P. Moran,et al.  Guided gesture support in the paper PDA , 2001, UIST '01.

[14]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[15]  Patrick Baudisch,et al.  Design and analysis of delimiters for selection-action pen gesture phrases in scriboli , 2005, CHI.

[16]  Desney S. Tan,et al.  InkSeine: In Situ search for active note taking , 2007, CHI.

[17]  Roy Huber,et al.  Handwriting Identification: Facts and Fundamentals , 1999 .

[18]  Tovi Grossman,et al.  PenLight: combining a mobile projector and a digital pen for dynamic visual overlay , 2009, CHI.

[19]  Wendy E. Mackay,et al.  Musink: composing music through augmented drawing , 2009, CHI.

[20]  D. Myers,et al.  Aging Baby Boomers and the Generational Housing Bubble: Foresight and Mitigation of an Epic Transition , 2008 .

[21]  William Buxton,et al.  The limits of expert performance using hierarchic marking menus , 1993, INTERCHI.

[22]  John F. Hughes,et al.  Navigating documents with the virtual scroll ring , 2004, UIST '04.

[23]  Olivier Bau,et al.  OctoPocus: a dynamic guide for learning gesture-based command sets , 2008, UIST '08.