Modeling human performance of pen stroke gestures

This paper presents a quantitative human performance model of making single-stroke pen gestures within certain error constraints in terms of production time. Computed from the properties of Curves, Line segments, and Corners (CLC) in a gesture stroke, the model may serve as a foundation for the design and evaluation of existing and future gesture-based user interfaces at the basic motor control efficiency level, similar to the role of previous "laws of action" played to pointing, crossing or steering-based user interfaces. We report and discuss our experimental results on establishing and validating the CLC model, together with other basic empirical findings in stroke gesture production.

[1]  P. Viviani,et al.  Trajectory determines movement dynamics , 1982, Neuroscience.

[2]  Eric Saund,et al.  Sloppy selection: Providing an accurate interpretation of imprecise selection gestures , 2005, Comput. Graph..

[3]  Shumin Zhai,et al.  Beyond Fitts' law: models for trajectory-based HCI tasks , 1997, CHI Extended Abstracts.

[4]  Patrick Baudisch,et al.  Stitching: pen gestures that span multiple displays , 2004, AVI.

[5]  Robert Pastel,et al.  Measuring the difficulty of steering through corners , 2006, CHI.

[6]  Shumin Zhai,et al.  More than dotting the i's --- foundations for crossing-based interfaces , 2002, CHI.

[7]  James A. Landay,et al.  Visual similarity of pen gestures , 2000, CHI.

[8]  Shumin Zhai,et al.  Relaxing stylus typing precision by geometric pattern matching , 2005, IUI.

[9]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[10]  Shumin Zhai,et al.  Human Action Laws in Electronic Virtual Worlds: An Empirical Study of Path Steering Performance in VR , 2004, Presence: Teleoperators & Virtual Environments.

[11]  Shumin Zhai,et al.  Scale effects in steering law tasks , 2001, CHI.

[12]  T. Flash,et al.  Minimum-jerk, two-thirds power law, and isochrony: converging approaches to movement planning. , 1995, Journal of experimental psychology. Human perception and performance.

[13]  Shumin Zhai,et al.  Speed-accuracy tradeoff in Fitts' law tasks-on the equivalency of actual and nominal pointing precision , 2004, Int. J. Hum. Comput. Stud..

[14]  David Goldberg,et al.  Touch-typing with a stylus , 1993, INTERCHI.

[15]  Thomas P. Moran,et al.  Pen-based interaction techniques for organizing material on an electronic whiteboard , 1997, UIST '97.

[16]  David Goldberg,et al.  Touch-typing with a stylus (abstract) , 1993, CHI '93.

[17]  Shumin Zhai,et al.  SHARK2: a large vocabulary shorthand writing system for pen-based computers , 2004, UIST '04.

[18]  M. S. Mayzner,et al.  Tables of single-letter and digram frequency counts for various word-length and letter-position combinations. , 1965 .

[19]  Rui Zhao,et al.  Incremental recognition in gesture-based and syntax-directed diagram editors , 1993, INTERCHI.

[20]  Shumin Zhai,et al.  Performance Optimization of Virtual Keyboards , 2002, Hum. Comput. Interact..

[21]  Shumin Zhai,et al.  Performance evaluation of input devices in trajectory-based tasks: an application of the steering law , 1999, CHI '99.

[22]  Poika Isokoski,et al.  Model for unistroke writing time , 2001, CHI.

[23]  Xing Xie,et al.  Collapse-to-zoom: viewing web pages on small screen devices by interactively removing irrelevant content , 2004, UIST '04.