HBF49 feature set: A first unified baseline for online symbol recognition

As the rise of pen-enabled interfaces is accompanied with an increased number of techniques for recognition of pen-based input, recent trends in symbol recognition show an escalation in systems complexity (number of features, classifiers combination) or the over-specialization of systems to specific datasets or applications. Despite the importance of representation space in feature-based methods, few works focus on the design of feature sets adapted to a large variety of symbols, and no universal representation space was proposed as a benchmarking reference. We introduce in this work HBF49, a unique set of features for the representation of hand-drawn symbols to be used as a reference for evaluation of symbol recognition systems. An empirical constructive approach is adopted for designing this set of 49 simple features, able to handle a large diversity of symbols in various experimental contexts. An original effort is made for guaranteeing transparency of features design and reproducibility of experiments. We demonstrate that using off-the-shelf statistical classifiers, the HBF49 representation performs comparably or better than state-of-the-art results reported on eight databases of hand-drawn objects. We also obtain a good recognition performance for user-defined gestures that further attests the ability of HBF49 to deal with a great variety of symbols.

[1]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[2]  Levent Burak Kara,et al.  Combining geometry and domain knowledge to interpret hand-drawn diagrams , 2005, Comput. Graph..

[3]  Éric Anquetil,et al.  Perceptual model of handwriting drawing. Application to the handwriting segmentation problem , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[4]  Alexander Hall,et al.  A combinatorial approach to multi-domain sketch recognition , 2007, SBIM '07.

[5]  Ricardo Gutierrez-Osuna,et al.  What ! ? ! No Rubine Features ? : Using Geometric-based Features to Produce Normalized Confidence Values for Sketch Recognition , 2008 .

[6]  LiuCheng-Lin,et al.  Online Recognition of Chinese Characters , 2004 .

[7]  Levent Burak Kara,et al.  An efficient graph-based recognizer for hand-drawn symbols , 2007, Comput. Graph..

[8]  Randall Davis,et al.  Learning from Neighboring Strokes: Combining Appearance and Context for Multi-Domain Sketch Recognition , 2009, NIPS.

[9]  Masaki Nakagawa,et al.  'Online recognition of Chinese characters: the state-of-the-art , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Takayuki Dan Kimura,et al.  Recognizing multistroke geometric shapes: an experimental evaluation , 1993, UIST '93.

[11]  Zhen-Long Bai,et al.  A study on the use of 8-directional features for online handwritten Chinese character recognition , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[12]  Stephen M. Watt,et al.  Online Recognition of Multi-Stroke Symbols with Orthogonal Series , 2009, 2009 10th International Conference on Document Analysis and Recognition.

[13]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[14]  Ronald L. Graham,et al.  An Efficient Algorithm for Determining the Convex Hull of a Finite Planar Set , 1972, Inf. Process. Lett..

[15]  Mohamed Cheriet,et al.  Personalizable Pen-Based Interface Using Lifelong Learning , 2010, 2010 12th International Conference on Frontiers in Handwriting Recognition.

[16]  Abdul Rahim Ahmad,et al.  Online handwriting recognition using support vector machine , 2004, 2004 IEEE Region 10 Conference TENCON 2004..

[17]  Sebastiano Impedovo,et al.  Zoning Methods for Hand-Written Character Recognition: An Overview , 2010, 2010 12th International Conference on Frontiers in Handwriting Recognition.

[18]  Randall Davis,et al.  A Visual Approach to Sketched Symbol Recognition , 2009, IJCAI.

[19]  Basabi Chakraborty,et al.  A new feature extraction technique for on-line recognition of handwritten alphanumeric characters , 2002, Inf. Sci..

[20]  Louis Vuurpijl,et al.  Design Issues for Pen-Centric Interactive Maps , 2010, Interactive Collaborative Information Systems.

[21]  Éric Anquetil,et al.  Eager interpretation of on-line hand-drawn structured documents: The DALI methodology , 2009, Pattern Recognit..

[22]  Joaquim A. Jorge,et al.  Using fuzzy logic to recognize geometric shapes interactively , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[23]  Éric Anquetil,et al.  Fuzzy Relative Positioning Templates for Symbol Recognition , 2011, 2011 International Conference on Document Analysis and Recognition.

[24]  Fei Yin,et al.  CASIA Online and Offline Chinese Handwriting Databases , 2011, 2011 International Conference on Document Analysis and Recognition.

[25]  L. Kara,et al.  Recognizing Multi-Stroke Symbols , 2002 .

[26]  Aurélie Lemaitre,et al.  Optimization Analysis Based on a Breadth-First Exploration for a Structural Approach of Sketches Interpretation , 2012, 2012 10th IAPR International Workshop on Document Analysis Systems.

[27]  Ching Y. Suen,et al.  The State of the Art in Online Handwriting Recognition , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Levent Burak Kara,et al.  An image-based, trainable symbol recognizer for hand-drawn sketches , 2005, Comput. Graph..

[29]  M. Dinesh,et al.  A Feature based on Encoding the Relative Position of a Point in the Character for Online Handwritten Character Recognition , 2007 .

[30]  Cheng-Lin Liu,et al.  Handwritten digit recognition: benchmarking of state-of-the-art techniques , 2003, Pattern Recognit..

[31]  Anil K. Jain,et al.  Representation and Recognition of Handwritten Digits Using Deformable Templates , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Stefan Knerr,et al.  The IRESTE On/Off (IRONOFF) dual handwriting database , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[33]  Louis Vuurpijl,et al.  The NicIcon database of handwritten icons , 2008, ICFHR 2008.

[34]  Yang Li,et al.  Experimental analysis of touch-screen gesture designs in mobile environments , 2011, CHI.

[35]  Marjorie Skubic,et al.  Hidden Markov Model Symbol Recognition for Sketch-Based Interfaces , 2004, AAAI Technical Report.

[36]  Masaki Nakagawa,et al.  The state of the art in Japanese online handwriting recognition compared to techniques in western handwriting recognition , 2003, Document Analysis and Recognition.

[37]  Joseph J. LaViola,et al.  A Practical Approach for Writer-Dependent Symbol Recognition Using a Writer-Independent Symbol Recognizer , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Randall Davis,et al.  HMM-based efficient sketch recognition , 2005, IUI.

[39]  Cheng-Lin Liu,et al.  Online Japanese Character Recognition Using Trajectory-Based Normalization and Direction Feature Extraction , 2006 .

[40]  T. Metin Sezgin,et al.  Feature Extraction and Classifier Combination for Image-based Sketch Recognition , 2010, SBIM.

[41]  Le CunY.,et al.  Handwritten digit recognition , 1989 .

[42]  Mohamed Cheriet,et al.  Evolving Fuzzy Classifiers: Application to Incremental Learning of Handwritten Gesture Recognition Systems , 2010, 2010 20th International Conference on Pattern Recognition.

[43]  Randall Davis,et al.  LADDER, a sketching language for user interface developers , 2005, Comput. Graph..

[44]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[45]  L. Prasanth,et al.  HMM-Based Online Handwriting Recognition System for Telugu Symbols , 2007 .

[46]  Éric Anquetil,et al.  The ILGDB database of realistic pen-based gestural commands , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[47]  Aurélie Lemaitre,et al.  Competitive Hybrid Exploration for Off-Line Sketches Structure Recognition , 2012, 2012 International Conference on Frontiers in Handwriting Recognition.

[48]  T. Metin Sezgin,et al.  Sketch recognition by fusion of temporal and image-based features , 2011, Pattern Recognit..

[49]  Ethem Alpaydin,et al.  Combining multiple representations and classifiers for pen-based handwritten digit recognition , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[50]  Ching Y. Suen,et al.  Character Recognition Systems: A Guide for Students and Practitioners , 2007 .

[51]  A. Newton,et al.  Sketched symbol recognition using Zernike moments , 2004, ICPR 2004.

[52]  Nicolas Ragot,et al.  A generic hybrid classifier based on hierarchical fuzzy modeling: experiments on on-line handwritten character recognition , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[53]  Louis Vuurpijl,et al.  Iconic and multi-stroke gesture recognition , 2009, Pattern Recognit..

[54]  Anil K. Jain,et al.  Template-based online character recognition , 2001, Pattern Recognit..

[55]  Fotini Simistira,et al.  A Template Matching Distance for Recognition of On-Line Mathematical Symbols , 2008 .

[56]  Michael Oltmans Envisioning sketch recognition: a local feature based approach to recognizing informal sketches , 2007 .

[57]  Richard Zanibbi,et al.  Recognizing Mathematical Expressions Using Tree Transformation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[58]  Marc Parizeau,et al.  Genetic engineering of handwriting representations , 2002, Proceedings Eighth International Workshop on Frontiers in Handwriting Recognition.

[59]  Wenyin Liu On-line Graphics Recognition: State-of-the-Art , 2003, GREC.

[60]  Amar Mitiche,et al.  On-line handwritten digit recognition based on trajectory and velocity modeling , 2008, Pattern Recognit. Lett..

[61]  Ernest Valveny,et al.  A Non-rigid Feature Extraction Method for Shape Recognition , 2011, 2011 International Conference on Document Analysis and Recognition.

[62]  Joan Mas Romeu A syntactic pattern recognition approach based on a distortion tolerant adjacency grammar and a spatial indexed parser. Application to sketched document recognition , 2010 .

[63]  Claus Bahlmann,et al.  Directional features in online handwriting recognition , 2006, Pattern Recognit..

[64]  Birendra Keshari Mathematical Symbol Recognition using SVMs with Features from Functional Approximation , 2008 .

[65]  Yang Li,et al.  Protractor: a fast and accurate gesture recognizer , 2010, CHI.

[66]  Bart Lamiroy,et al.  Automatic Adjacency Grammar Generation from User Drawn Sketches , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[67]  Tracy Anne Hammond,et al.  Recognizing sketched multistroke primitives , 2011, ACM Trans. Interact. Intell. Syst..

[68]  Lisa Anthony,et al.  A lightweight multistroke recognizer for user interface prototypes , 2010, Graphics Interface.

[69]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[70]  H WittenIan,et al.  The WEKA data mining software , 2009 .

[71]  Marcus Liwicki,et al.  IAM-OnDB - an on-line English sentence database acquired from handwritten text on a whiteboard , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[72]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[73]  Randall Davis,et al.  LADDER, a sketching language for user interface developers , 2005, Comput. Graph..