Stroke-order-free on-line Chinese character recognition by stroke adjustment of two-layer bipartite weighted matching

Abstract Dynamic programming (DP) is good at recognizing on-line standard-stroke-order Chinese characters. We propose a two-stage bipartite weighted matching to rearrange the stroke order of a test on-line Chinese handwriting before recognition. At the first layer, for each stroke pair which matches one stroke in the test handwriting with one stroke in the reference character, we generate a stroke-based vector graph (SVG) and the bipartite weighted matching determines the best stroke permutation of the handwriting, stroke-based matched vector graph (SMVG), from the SVG. At the second layer, we superimpose all SMVGs to form a character-based vector graph (CVG), and the bipartite weighted matching calculates the final stroke mapping between the test handwriting and the reference character. Experimental results reveal that the modified split-and-merge DP matching using the stroke adjustment method recognizes on-line stroke-order-varied handwritings with accuracy 89%, much higher than accuracy 5.2% for the original split-and-merge DP matching.

[1]  Andrew K. C. Wong,et al.  An algorithm for graph optimal monomorphism , 1990, IEEE Trans. Syst. Man Cybern..

[2]  S. Impedovo,et al.  Optical Character Recognition - a Survey , 1991, Int. J. Pattern Recognit. Artif. Intell..

[3]  Masaki Nakagawa,et al.  Robust and highly customizable recognition of online handwritten Japanese characters , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[4]  T. Wakahara Online cursive script recognition using local affine transformation , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[5]  Ching Y. Suen,et al.  Historical review of OCR research and development , 1992, Proc. IEEE.

[6]  Ching Y. Suen,et al.  Structural classification and relaxation matching of totally unconstrained handwritten zip-code numbers , 1988, Pattern Recognit..

[7]  Daniel P. Lopresti,et al.  CROSS­DOMAIN SEARCHING USING HANDWRITTEN QUERIES , 2004 .

[8]  Thomas Zimmerman,et al.  Pen computing: challenges and applications , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[9]  Fang-Hsuan Cheng,et al.  Fuzzy approach to solve the recognition problem of handwritten chinese characters , 1989, Pattern Recognit..

[10]  Masaki Nakagawa,et al.  HANDWRITING-BASED USER INTERFACES EMPLOYING ON-LINE HANDWRITING RECOGNITION , 1999 .

[11]  Jianzhuang Liu,et al.  Stroke order and stroke number free on-line Chinese character recognition using attributed relational graph matching , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[12]  Shigeki Matsuda,et al.  Context-dependent substroke model for HMM-based on-line handwriting recognition , 2002, Proceedings Eighth International Workshop on Frontiers in Handwriting Recognition.

[13]  Réjean Plamondon,et al.  On-line recognition of handprinted characters: Survey and beta tests , 1990, Pattern Recognit..

[14]  Xiaoqing Ding,et al.  Spatio-temporal unified model for on-line handwritten Chinese character recognition , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[15]  Y. S. Cheung,et al.  A knowledge-based stroke-matching method for Chinese character recognition , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[16]  Ching Y. Suen,et al.  The State of the Art in Online Handwriting Recognition , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Shigeki Sagayama,et al.  Substroke approach to HMM-based on-line Kanji handwriting recognition , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[18]  Fang-Hsuan Cheng,et al.  Research on Chinese OCR in Taiwan , 1991, Int. J. Pattern Recognit. Artif. Intell..

[19]  Hang Joon Kim,et al.  On-line recognition of handwritten chinese characters based on hidden markov models , 1997, Pattern Recognit..

[20]  Ai-Jia Hsieh,et al.  Bipartite weighted matching for on-line handwritten Chinese character recognition , 1995, Pattern Recognit..

[21]  M. P. Perrone,et al.  Handwritten document retrieval , 2002, Proceedings Eighth International Workshop on Frontiers in Handwriting Recognition.

[22]  Masaki Nakagawa,et al.  'Online recognition of Chinese characters: the state-of-the-art , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Steven W. Zucker,et al.  On the Foundations of Relaxation Labeling Processes , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Anne E. James,et al.  An efficient image retrieval scheme for colour enhancement of embedded and distributed surveillance images , 2016, Neurocomputing.

[25]  V. K. Govindan,et al.  Character recognition - A review , 1990, Pattern Recognit..

[26]  Wen-Hsiang Tsai,et al.  Recognizing Handwritten Chinese Characters by Stroke-Segment Matching using an Iteration Scheme , 1991, Int. J. Pattern Recognit. Artif. Intell..

[27]  K. Takahashi,et al.  A fast HMM algorithm for on-line handwritten character recognition , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[28]  Wentai Liu,et al.  Optical recognition of handwritten Chinese characters: Advances since 1980 , 1993, Pattern Recognit..

[29]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[30]  Wen-Hsiang Tsai,et al.  Attributed String Matching by Split-and-Merge for On-Line Chinese Character Recognition , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Victor I. Chang,et al.  A fuzzy computational model of emotion for cloud based sentiment analysis , 2017, Inf. Sci..

[32]  Minsoo Suk,et al.  On machine recognition of hand-printed Chinese characters by feature relaxation , 1988, Pattern Recognit..

[33]  R M Haralick,et al.  The consistent labeling problem: part I. , 1979, IEEE transactions on pattern analysis and machine intelligence.

[34]  Jianzhuang Liu,et al.  Online Chinese character recognition using attributed relational graph matching , 1996 .

[35]  Shigeki Sagayama,et al.  Pen pressure features for writer-independent on-line handwriting recognition based on substroke HMM , 2002, Object recognition supported by user interaction for service robots.

[36]  Jungpil Shin,et al.  On-line cursive hangul recognition that uses DP matching to detect key segmentation points , 2004, Pattern Recognit..

[37]  Yoshimitsu Komiya,et al.  RAV (reparameterized angle variations) algorithm for online handwriting recognition , 2001, International Journal on Document Analysis and Recognition.

[38]  Rahat Iqbal,et al.  Cloud enabled data analytics and visualization framework for health-shocks prediction , 2016, Future Gener. Comput. Syst..

[39]  Hsi-Jian Lee,et al.  Increasing character recognition accuracy by detection and correction of erroneously identified characters , 1994, Pattern Recognit..

[40]  King-Sun Fu,et al.  Subgraph error-correcting isomorphisms for syntactic pattern recognition , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[41]  Jianzhuang Liu,et al.  Two-layer assignment method for online Chinese character recognition , 2000 .