RATA: codeless generation of gesture recognizers

Touch and stylus sensitive computer displays are widely available. Yet, the development of gesture sets to support these interaction methods continues to be difficult. We present RATA, a tool for interaction designers and software developers to create gesture recognizers for novel and custom gesture sets. Guided by the RATA wizard, the developer: defines their gesture set; collects example gestures; labels them with the support of an auto labeller; and generates the recognizer model file -- no coding or expert knowledge of recognizers is required. Incorporating the recognizer into a program requires just two lines of code. Our evaluations show high user satisfaction and that novice software developers can design a customized gesture set and generate a recognizer in about 20 minutes.

[1]  Eamonn J. Keogh,et al.  Scaling and time warping in time series querying , 2005, The VLDB Journal.

[2]  Beryl Plimmer,et al.  Rata.SSR: Data Mining for Pertinent Stroke Recognizers , 2010, SBIM.

[3]  Thomas F. Stahovich,et al.  The effect of task on classification accuracy: using gesture recognition techniques in free-sketch recognition , 2009, SBIM '09.

[4]  Beryl Plimmer,et al.  A toolkit approach to sketched diagram recognition , 2007 .

[5]  James A. Landay,et al.  Implications for a gesture design tool , 1999, CHI '99.

[6]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[7]  Yong Wang,et al.  Using data mining for digital ink recognition: Dividing text and shapes in sketched diagrams , 2011, Comput. Graph..

[8]  Joaquim A. Jorge,et al.  CALI: An Online Scribble Recognizer for Calligraphic Interfaces , 2002 .

[9]  Beryl Plimmer,et al.  SketchSet: Creating Euler diagrams using pen or mouse , 2011, 2011 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[10]  Randall Davis,et al.  LADDER, a sketching language for user interface developers , 2005, Comput. Graph..

[11]  Thad Starner,et al.  MAGIC: a motion gesture design tool , 2010, CHI.

[12]  Kim Marriott,et al.  Developing Domain-Specific Gesture Recognizers for Smart Diagram Environments , 2007, GREC.

[13]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[14]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[15]  Tracy Anne Hammond,et al.  PaleoSketch: accurate primitive sketch recognition and beautification , 2008, IUI '08.

[16]  Beryl Plimmer,et al.  Automatic evaluation of sketch recognizers , 2009, SBIM '09.

[17]  Beat Signer,et al.  iGesture: A General Gesture Recognition Framework , 2007 .

[18]  Yong Wang,et al.  A data collection tool for sketched diagrams , 2008, SBM'08.

[19]  Thomas F. Stahovich,et al.  The effect of task on classification accuracy: Using gesture recognition techniques in free-sketch recognition , 2010, Comput. Graph..