Integration of Shape Context and Neural Networks for Symbol Recognition

Using shape matching within a k-nearest neighbor approach, shape context descrip- tor has been applied in several classification problems with outstanding results. However, the application of this framework on large datasets or online scenarios is challenging due to its computational cost. To overcome this limitations, we evaluate the use of shape context as in- put features for neural networks. We test the proposed method in a problem of recognition of handwritten mathematical symbols. For a total of 75 classes of symbols, we obtained a recog- nition rate of 89.8%, comparable with a k-nearest neighbor approach, but with reduced time complexity.

[1]  Hiroshi Murase,et al.  Visual learning and recognition of 3-d objects from appearance , 2005, International Journal of Computer Vision.

[2]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[3]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[4]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[5]  H. Kuhn The Hungarian method for the assignment problem , 1955 .

[6]  Ahmad-Montaser Awal Reconnaissance de structures bidimensionnelles : Application aux expressions mathématiques manuscrites en-ligne. (Recognition of two-dimensional structures: application on online handwritten mathematical expressions) , 2010 .

[7]  Jin Hyung Kim,et al.  ICFHR 2012 Competition on Recognition of On-Line Mathematical Expressions (CROHME 2012) , 2012, 2012 International Conference on Frontiers in Handwriting Recognition.

[8]  Zheru Chi,et al.  Leaf Image Classification with Shape Context and SIFT Descriptors , 2011, 2011 International Conference on Digital Image Computing: Techniques and Applications.

[9]  Jitendra Malik,et al.  Efficient shape matching using shape contexts , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Dinesh Mavaluru,et al.  Elastic Matching of Online Handwritten Tamil and Telugu Scripts Using Local Features , 2007, Ninth International Conference on Document Analysis and Recognition (ICDAR 2007).

[11]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.