An exploration of pen tail gestures for interactions

In this paper, we performed an exploration on the design and evaluation of pen tail gesture, an interaction method that allows the use of pen tail movement to initiate interactions. Based on our interviews with some designers and researchers who regularly used pen-based tools, we conducted three experiments to establish baseline criteria to distinguish intentional pen tail gestures from incidental pen tail movements, and to understand the basic movement behaviors in pen tail gestures. We developed designs and recognition methods of pen gestures, and implemented three application prototypes based on them. Our research can inspire some new designs of pen-based tools and enrich the design repertoire of pen-based user interfaces.

[1]  Pierre Dragicevic,et al.  Combining crossing-based and paper-based interaction paradigms for dragging and dropping between overlapping windows , 2004, UIST '04.

[2]  Shumin Zhai,et al.  Modeling human performance of pen stroke gestures , 2007, CHI.

[3]  Hongan Wang,et al.  The tilt cursor: enhancing stimulus-response compatibility by providing 3d orientation cue of pen , 2007, CHI.

[4]  Hongan Wang,et al.  Tilt menu: using the 3D orientation information of pen devices to extend the selection capability of pen-based user interfaces , 2008, CHI.

[5]  Yang Li,et al.  Protractor: a fast and accurate gesture recognizer , 2010, CHI.

[6]  Xiaojun Bi,et al.  Acquiring and pointing: an empirical study of pen-tilt-based interaction , 2011, CHI.

[7]  James A. Landay,et al.  PDA and Gesture Use in Practice: Insights for Designers of Pen-based User Interfaces , 1997 .

[8]  James A. Landay,et al.  Visual similarity of pen gestures , 2000, CHI.

[9]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[10]  Ravin Balakrishnan,et al.  Pressure marks , 2007, CHI.

[11]  Shumin Zhai,et al.  SHARK2: a large vocabulary shorthand writing system for pen-based computers , 2004, UIST '04.

[12]  Yang Li,et al.  Experimental analysis of mode switching techniques in pen-based user interfaces , 2005, CHI.

[13]  Patrick Baudisch,et al.  Design and analysis of delimiters for selection-action pen gesture phrases in scriboli , 2005, CHI.

[14]  Joseph J. LaViola,et al.  CavePainting: a fully immersive 3D artistic medium and interactive experience , 2001, I3D '01.

[15]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[16]  James A. Landay,et al.  Interactive sketching for the early stages of user interface design , 1995, CHI '95.

[17]  Thomas P. Moran,et al.  Tivoli: an electronic whiteboard for informal workgroup meetings , 1993, INTERCHI.

[18]  Maneesh Agrawala,et al.  Zone and polygon menus: using relative position to increase the breadth of multi-stroke marking menus , 2006, CHI.

[19]  Andrew Roberts,et al.  3-Draw: a tool for designing 3D shapes , 1991, IEEE Computer Graphics and Applications.

[20]  Jiro Tanaka,et al.  Stylus Enhancement to Enrich Interaction with Computers , 2007, HCI.

[21]  Terry Winograd,et al.  Benefits of merging command selection and direct manipulation , 2005, TCHI.

[22]  Poika Isokoski,et al.  Model for unistroke writing time , 2001, CHI.

[23]  Patrick Baudisch,et al.  Hover widgets: using the tracking state to extend the capabilities of pen-operated devices , 2006, CHI.

[24]  J. Hollerbach An oscillation theory of handwriting , 2004, Biological Cybernetics.

[25]  Shumin Zhai,et al.  Beyond Fitts' law: models for trajectory-based HCI tasks , 1997, CHI Extended Abstracts.

[26]  Xiaojun Bi,et al.  An exploration of pen rolling for pen-based interaction , 2008, UIST '08.

[27]  Eric Saund,et al.  Stylus input and editing without prior selection of mode , 2003, UIST '03.