SHARK2: a large vocabulary shorthand writing system for pen-based computers

Zhai and Kristensson (2003) presented a method of speed-writing for pen-based computing which utilizes gesturing on a stylus keyboard for familiar words and tapping for others. In SHARK<sup>2</sup>:, we eliminated the necessity to alternate between the two modes of writing, allowing any word in a large vocabulary (e.g. 10,000-20,000 words) to be entered as a shorthand gesture. This new paradigm supports a gradual and seamless transition from visually guided tracing to recall-based gesturing. Based on the use characteristics and human performance observations, we designed and implemented the architecture, algorithms and interfaces of a high-capacity multi-channel pen-gesture recognition system. The system's key components and performance are also reported.

[1]  James A. Landay,et al.  Implications for a gesture design tool , 1999, CHI '99.

[2]  James H. Martin,et al.  Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition, 2nd Edition , 2000, Prentice Hall series in artificial intelligence.

[3]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[4]  Timothy D. Lee,et al.  Motor Control and Learning: A Behavioral Emphasis , 1982 .

[5]  Abigail Sellen,et al.  An Empirical Evaluation of Some Articulatory and Cognitive Aspects of Marking Menus , 1993, Hum. Comput. Interact..

[6]  Ching Y. Suen,et al.  The State of the Art in Online Handwriting Recognition , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Brad A. Myers,et al.  EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion , 2003, UIST '03.

[8]  Sargur N. Srihari,et al.  On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Amit Roy,et al.  Creating word-level language models for handwriting recognition , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[10]  Clive Frankish,et al.  Recognition accuracy and user acceptance of pen interfaces , 1995, CHI '95.

[11]  Djamel Bouchaffra,et al.  A Methodology for Mapping Scores to Probabilities , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Mark W. Newman,et al.  DENIM: An Informal Web Site Design Tool Inspired by Observations of Practice , 2003, Hum. Comput. Interact..

[13]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[14]  I. Scott MacKenzie,et al.  Text Entry for Mobile Computing: Models and Methods,Theory and Practice , 2002, Hum. Comput. Interact..

[15]  Shumin Zhai,et al.  Movement model, hits distribution and learning in virtual keyboarding , 2002, CHI.

[16]  I. Scott MacKenzie,et al.  The design and evaluation of a high-performance soft keyboard , 1999, CHI '99.

[17]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[18]  Gregory D. Abowd,et al.  Cirrin: a word-level unistroke keyboard for pen input , 1998, UIST '98.

[19]  James H. Martin,et al.  Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition , 2000 .

[20]  Shumin Zhai,et al.  Performance Optimization of Virtual Keyboards , 2002, Hum. Comput. Interact..

[21]  Graham Leedham,et al.  Automatic recognition and transcription of Pitman's handwritten shorthand - An approach to shortforms , 1987, Pattern Recognit..

[22]  Shumin Zhai,et al.  Shorthand writing on stylus keyboard , 2003, CHI '03.

[23]  David G. Stork,et al.  Pattern Classification , 1973 .

[24]  Shumin Zhai,et al.  Beyond Fitts' law: models for trajectory-based HCI tasks , 1997, CHI Extended Abstracts.

[25]  Charles C. Tappert,et al.  Cursive Script Recognition by Elastic Matching , 1982, IBM J. Res. Dev..

[26]  David Nahamoo,et al.  A Fast Statistical Mixture Algorithm for On-Line Handwriting Recognition , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Shumin Zhai,et al.  More than dotting the i's --- foundations for crossing-based interfaces , 2002, CHI.

[28]  Ken Perlin,et al.  Quikwriting: continuous stylus-based text entry , 1998, UIST '98.

[29]  David Goldberg,et al.  Touch-typing with a stylus , 1993, INTERCHI.

[30]  Ching,et al.  The State of the Art in On-Line Handwriting Recognition , 2000 .

[31]  Shumin Zhai,et al.  In search of effective text input interfaces for off the desktop computing , 2005, Interact. Comput..