A Comprehensive Survey on On-line Handwriting Recognition Technology and its Real Application to the Nepalese Natural Handwriting

Handwriting Recognition Technology has been improving much under the purview of pattern recognition and image processing since a few decades. This paper focuses on the comprehensive survey on on-line handwriting recognition system along with the real application by taking Nepali natural handwriting (a real example of one of the cursive handwritings). The survey mainly includes pre-processing, feature vector and similarity measures in between the non-linear 2D sequences of coordinates, and their effective applications. A very highlighting topic ``Dynamic Time Warping Algorithm'' (DTW) is introduced, which has been popular in determining the distance between two non-linear sequences ranging from handwriting to speech recognition. Besides these contemporary research issues/areas, stroke number and order free Nepalese natural handwritten recognition system is presented in the second step. Writing one's own style brings unevenness in writing units, which is the most difficult part to classify. Writing units reveal number, shape, size, order of stroke, and speed in writing. Variation in the number of strokes, their order, shapes and sizes, tilting angles and similarities among characters from one another are the important factors, which are to be considered in classification for Nepali. This paper utilizes structural properties of those alphanumeric characters, which have variable writing units. It uses a string of pen tip's positions and tangent angles of every consecutive point as a feature vector sequence of a stroke. We constructed a prototype recognizer that uses the DTW algorithm to align handwritten strokes with stored strokes' templates and determine their similarity. Separate system is trained for original and preprocessed writing samples and achieved recognition rates of 85.87% and 88.59% respectively. This introduces novel real time handwriting recognition on Nepalese alphanumeric characters, which are independent of number of strokes, as well as their order.

[1]  Nicolas Ragot,et al.  Handwritten gesture recognition driven by the spatial context of strokes , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[2]  R.P. Lippmann,et al.  Pattern classification using neural networks , 1989, IEEE Communications Magazine.

[3]  Veena Bansal,et al.  Segmentation of touching and fused Devanagari characters , 2002, Pattern Recognit..

[4]  Christian Viard-Gaudin,et al.  From Off-line to On-line Handwriting Recognition , 2004 .

[5]  Anil K. Jain,et al.  Recognition of unconstrained online Devanagari characters , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[6]  Bidyut Baran Chaudhuri,et al.  Skew Angle Detection of Digitized Indian Script Documents , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  B. Verma,et al.  A feature extraction technique for online handwriting recognition , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[8]  Hiroshi Maruyama,et al.  Real-time on-line unconstrained handwriting recognition using statistical methods , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[9]  John Bennett,et al.  The effect of large training set sizes on online Japanese Kanji and English cursive recognizers , 2002, Proceedings Eighth International Workshop on Frontiers in Handwriting Recognition.

[10]  S. Jassar.  The digital pen as a human computer interface , 2004, IEEE International Symposium on Consumer Electronics, 2004.

[11]  Kemal Oflazer,et al.  An online handwriting recognition system for Turkish , 2004, Proceedings of the IEEE 12th Signal Processing and Communications Applications Conference, 2004..

[12]  N. Alvertos,et al.  Optical machine recognition of Greek characters of any size , 1989, Proceedings. IEEE Energy and Information Technologies in the Southeast'.

[13]  Claus Bahlmann,et al.  The writer independent online handwriting recognition system frog on hand and cluster generative statistical dynamic time warping , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  C. Nattee,et al.  Structural Approach on Writer Independent Nepalese Natural Handwriting Recognition , 2006, 2006 IEEE Conference on Cybernetics and Intelligent Systems.

[15]  Sung-Hyuk Cha,et al.  Approximate stroke sequence string matching algorithm for character recognition and analysis , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[16]  S.A. Khan,et al.  Urdu online handwriting recognition , 2005, Proceedings of the IEEE Symposium on Emerging Technologies, 2005..

[17]  Thierry Artières,et al.  Handling spatial information in on-line handwriting recognition , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[18]  Patrick Gallinari,et al.  A flexible recognition engine for complex on-line handwritten character recognition , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[19]  Facog,et al.  The state of ART , 2010 .

[20]  Anil K. Jain,et al.  Online handwritten script recognition , 2004 .

[21]  Cholwich Nattee,et al.  Template-based Nepali Natural Handwritten Alphanumeric Character Recognition , 2007 .

[22]  Réjean Plamondon,et al.  Normalizing and restoring on-line handwriting , 1993, Pattern Recognit..

[23]  Ching Y. Suen,et al.  The State of the Art in Online Handwriting Recognition , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Anil K. Jain,et al.  Template-based online character recognition , 2001, Pattern Recognit..

[25]  Patrick Gallinari,et al.  A generic approach for on-line handwriting recognition , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[26]  Brijesh Verma,et al.  A novel feature extraction technique for the recognition of segmented handwritten characters , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[27]  Krishna S. Nathan,et al.  Size normalization in on-line unconstrained handwriting recognition , 1994, Proceedings of 1st International Conference on Image Processing.

[28]  Stephen M. Watt,et al.  Recognition for large sets of handwritten mathematical symbols , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[29]  Seiichi Uchida,et al.  An HMM implementation for on-line handwriting recognition based on pen-coordinate feature and pen-direction feature , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[30]  Cholwich Nattee,et al.  Stroke Number and Order Free Handwriting Recognition for Nepali , 2006, PRICAI.

[31]  Panu Somervuo,et al.  Self-Organizing Maps and Learning Vector Quantization for Feature Sequences , 1999, Neural Processing Letters.

[32]  Tomoichi Takahashi,et al.  A study of symbol segmentation method for handwritten mathematical formula recognition using mathematical structure information , 2004, ICPR 2004.

[33]  Eamonn J. Keogh,et al.  Scaling up Dynamic Time Warping to Massive Dataset , 1999, PKDD.

[34]  Xiaoqing Ding,et al.  Image Pattern Recognition Based on Examples - A Combined Statistical and Structural-Syntactic Approach , 2000, SSPR/SPR.