RATA.Gesture: A gesture recognizer developed using data mining

Abstract Although many approaches to digital ink recognition have been proposed, most lack the flexibility and adaptability to provide acceptable recognition rates across a variety of problem spaces. This project uses a systematic approach of data mining analysis to build a gesture recognizer for sketched diagrams. A wide range of algorithms was tested, and those with the best performance were chosen for further tuning and analysis. Our resulting recognizer, RATA.Gesture, is an ensemble of four algorithms. We evaluated it against four popular gesture recognizers with three data sets; one of our own and two from other projects. Except for recognizer–data set pairs (e.g., PaleoSketch recognizer and PaleoSketch data set) the results show that it outperforms the other recognizers. This demonstrates the potential of this approach to produce flexible and accurate recognizers.

[1]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[2]  Stefan Kramer,et al.  Ensembles of Balanced Nested Dichotomies for Multi-class Problems , 2005, PKDD.

[3]  Mark D. Gross,et al.  Recognizing and interpreting diagrams in design , 1994, AVI '94.

[4]  Rachel Blagojevic,et al.  Using Data Mining for Digital Ink Recognition , 2011 .

[5]  Stefan Kramer,et al.  Ensembles of nested dichotomies for multi-class problems , 2004, ICML.

[6]  Ingo Mierswa,et al.  YALE: rapid prototyping for complex data mining tasks , 2006, KDD '06.

[7]  Roberto Basili,et al.  Classification of musical genre: a machine learning approach , 2004, ISMIR.

[8]  Kimberle Koile,et al.  Improving digital ink interpretation through expected type prediction and dynamic dispatch , 2008, 2008 19th International Conference on Pattern Recognition.

[9]  Thomas F. Stahovich,et al.  The effect of task on classification accuracy: using gesture recognition techniques in free-sketch recognition , 2009, SBIM '09.

[10]  Levent Burak Kara,et al.  From engineering diagrams to engineering models: Visual recognition and applications , 2011, Comput. Aided Des..

[11]  Levent Burak Kara,et al.  Hierarchical parsing and recognition of hand-sketched diagrams , 2004, UIST '04.

[12]  Anil K. Jain,et al.  Recognition of unconstrained online Devanagari characters , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[13]  Joaquim A. Jorge,et al.  CALI: An Online Scribble Recognizer for Calligraphic Interfaces , 2002 .

[14]  Yong Wang,et al.  A data collection tool for sketched diagrams , 2008, SBM'08.

[15]  Brian Eoff,et al.  Free-sketch recognition: putting the chi in sketching , 2008, CHI Extended Abstracts.

[16]  Thomas F. Stahovich,et al.  Sketch based interfaces: early processing for sketch understanding , 2001, PUI '01.

[17]  Tracy Anne Hammond,et al.  PaleoSketch: accurate primitive sketch recognition and beautification , 2008, IUI '08.

[18]  Joseph J. LaViola,et al.  MathPad2: a system for the creation and exploration of mathematical sketches , 2004, ACM Trans. Graph..

[19]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[20]  Joseph J. LaViola,et al.  MathPad2: a system for the creation and exploration of mathematical sketches , 2004, SIGGRAPH 2004.

[21]  S. Sathiya Keerthi,et al.  Improvements to Platt's SMO Algorithm for SVM Classifier Design , 2001, Neural Computation.

[22]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[23]  Randall Davis,et al.  Sketch Interpretation Using Multiscale Models of Temporal Patterns , 2007, IEEE Computer Graphics and Applications.

[24]  Geoff Holmes,et al.  Multiclass Alternating Decision Trees , 2002, ECML.

[25]  Beryl Plimmer,et al.  Ink features for diagram recognition , 2007, SBIM '07.

[26]  Robert Tibshirani,et al.  Classification by Pairwise Coupling , 1997, NIPS.

[27]  Randall Davis,et al.  A Visual Approach to Sketched Symbol Recognition , 2009, IJCAI.

[28]  Beryl Plimmer,et al.  Automatic evaluation of sketch recognizers , 2009, SBIM '09.

[29]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[30]  L. Kara,et al.  Recognizing Multi-Stroke Symbols , 2002 .

[31]  Beryl Plimmer,et al.  Rata.SSR: Data Mining for Pertinent Stroke Recognizers , 2010, SBIM.

[32]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[33]  Judea Pearl,et al.  Bayesian Networks , 1998, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[34]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[35]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[36]  Takayuki Dan Kimura,et al.  Recognizing multistroke geometric shapes: an experimental evaluation , 1993, UIST '93.

[37]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[38]  Louis Vuurpijl,et al.  Iconic and multi-stroke gesture recognition , 2009, Pattern Recognit..

[39]  Beryl Plimmer,et al.  The Power of Automatic Feature Selection: Rubine on Steroids , 2010, SBIM.

[40]  Eibe Frank,et al.  Speeding Up Logistic Model Tree Induction , 2005, PKDD.

[41]  J. Friedman.  Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[42]  Christine Alvarado,et al.  Resolving ambiguities to create a natural computer-based sketching environment , 2007, SIGGRAPH '07.

[43]  Ethem Alpaydin,et al.  Combining multiple representations and classifiers for pen-based handwritten digit recognition , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[44]  Beryl Plimmer,et al.  Connector Semantics for Sketched Diagram Recognition , 2007, AUIC.

[45]  Ethem Alpaydin,et al.  Combining Multiple Representations for Pen-based Handwritten Digit Recognition , 2001 .

[46]  Bo Yu,et al.  A domain-independent system for sketch recognition , 2003, GRAPHITE '03.

[47]  Beryl Plimmer,et al.  A toolkit approach to sketched diagram recognition , 2007, BCS HCI.

[48]  Eibe Frank,et al.  Logistic Model Trees , 2003, Machine Learning.

[49]  Elisabeth André,et al.  Comparing Feature Sets for Acted and Spontaneous Speech in View of Automatic Emotion Recognition , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[50]  Jason Hong,et al.  Computational Support for Sketching in Design: A Review , 2009, Found. Trends Hum. Comput. Interact..