SURVEY PAPER Special Section on Document Image Understanding and Digital Documents A Survey of Elastic Matching Techniques for Handwritten Character Recognition

SUMMARY This paper presents a survey of elastic matching (EM) techniques employed in handwritten character recognition. EM is often called deformable template, flexible matching, or nonlinear template matching, and defined as the optimization problem of two-dimensional warping (2DW) which specifies the pixel-to-pixel correspondence between two subjected character image patterns. The pattern distance evaluated under optimized 2DW is invariant to a certain range of geometric deformations. Thus, by using the EM distance as a discriminant function, recognition systems robust to the deformations of handwritten characters can be realized. In this paper, EM techniques are classified according to the type of 2DW and the properties of each class are outlined. Several topics around EM, such as the category-dependent deformation tendency of handwritten characters, are also discussed.

[1]  Katsuhiko Sakaue,et al.  Optimization Approaches in Computer Vision and Image Processing , 1999 .

[2]  Hiromitsu Yamada,et al.  A nonlinear normalization method for handprinted kanji character recognition - line density equalization , 1990, Pattern Recognit..

[3]  Seiichi Uchida,et al.  Handwritten character recognition using monotonic and continuous two-dimensional warping , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[4]  Ching Y. Suen,et al.  Historical review of OCR research and development , 1992, Proc. IEEE.

[5]  H. Sakoe,et al.  Prototype setting for elastic matching-based image pattern recognition , 2004, ICPR 2004.

[6]  Seiichi Uchida,et al.  A monotonic and continuous two-dimensional warping based on dynamic programming , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[7]  Roberto Pieraccini,et al.  Connected and degraded text recognition using planar hidden Markov models , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[8]  Yasuaki Nakano,et al.  Recognition of Chinese characters , 1973 .

[9]  Horst Bunke,et al.  Off-Line, Handwritten Numeral Recognition by Perturbation Method , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  D. Burr A dynamic model for image registration , 1981 .

[11]  Hermann Ney,et al.  Local context in non-linear deformation models for handwritten character recognition , 2004, ICPR 2004.

[12]  Seiichi Uchida,et al.  Piecewise linear two-dimensional warping , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[13]  Seong-Whan Lee,et al.  Nonlinear shape normalization methods for the recognition of large-set handwritten characters , 1994, Pattern Recognit..

[14]  Alan N. Willson,et al.  Motion vector optimization of control grid interpolation and overlapped block motion compensation using iterative dynamic programming , 1996, 1996 8th European Signal Processing Conference (EUSIPCO 1996).

[15]  Anil K. Jain,et al.  Representation and Recognition of Handwritten Digits Using Deformable Templates , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Oscar E. Agazzi,et al.  Keyword Spotting in Poorly Printed Documents using Pseudo 2-D Hidden Markov Models , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Yann LeCun,et al.  Efficient Pattern Recognition Using a New Transformation Distance , 1992, NIPS.

[18]  Chin-Hui Lee,et al.  Minimum error rate training for PHMM-based text recognition , 1999, IEEE Trans. Image Process..

[19]  Toru Wakahara,et al.  Shape Matching Using LAT and its Application to Handwritten Numeral Recognition , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Roger K. Moore A Dynamic Programming Algorithm for the Distance Between Two Finite Areas , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Laurence Likforman-Sulem,et al.  A comparative study between decision fusion and data fusion in Markovian printed character recognition , 2002, Object recognition supported by user interaction for service robots.

[22]  Nikos Fakotakis,et al.  A new shape transformation approach to handwritten character recognition , 2002, Object recognition supported by user interaction for service robots.

[23]  Hermann Ney,et al.  Experiments with an extended tangent distance , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[24]  J. Tsukumo Handprinted Kanji character recognition based on flexible template matching , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[25]  Patrice Y. Simard,et al.  Learning Prototype Models for Tangent Distance , 1994, NIPS.

[26]  Akira Tomono,et al.  Affine-Invariant Recognition of Gray-Scale Characters Using Global Affine Transformation Correlation , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Masaki Nakagawa,et al.  An off-line character recognition method employing model-dependent pattern normalization by an elastic membrane model , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[28]  Hiroshi Sako,et al.  Handwritten digit recognition: investigation of normalization and feature extraction techniques , 2004, Pattern Recognit..

[29]  Roberto Pieraccini,et al.  Dynamic planar warping for optical character recognition , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[30]  Seong-Whan Lee,et al.  A truly 2-D hidden Markov model for off-line handwritten character recognition , 1998, Pattern Recognit..

[31]  Hermann Ney,et al.  Adaptation in statistical pattern recognition using tangent vectors , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Chen-Mie Wu,et al.  Unconstrained-endpoint dynamic space-warping algorithm with experiments in binary English character images , 1995 .

[33]  Volker Märgner,et al.  Script recognition using inhomogeneous P2DHMM and hierarchical search space reduction , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[34]  Masaki Nakagawa,et al.  An On-Line/Off-Line Compatible Character Recognition Method Based on a Dynamic Model , 1997 .

[35]  Jin Hyung Kim,et al.  Modeling and recognition of cursive words with hidden Markov models , 1995, Pattern Recognit..

[36]  Yoshiki Mizukami A handwritten Chinese character recognition system using hierarchical displacement extraction based on directional features , 1998, Pattern Recognit. Lett..

[37]  Anil K. Jain,et al.  Feature extraction methods for character recognition-A survey , 1996, Pattern Recognit..

[38]  Daming Shi,et al.  Handwritten Chinese Radical Recognition Using Nonlinear Active Shape Models , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Geoffrey E. Hinton,et al.  Using Generative Models for Handwritten Digit Recognition , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Kazumi Odaka,et al.  Adaptive Normalization of Handwritten Characters Using Global/Local Affine Transformation , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  E. Tanaka A two dimensional context-dependent similarity measure , 1985 .

[42]  Seiichi Uchida,et al.  Handwritten character recognition using piecewise linear two-dimensional warping , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[43]  Hiromitsu Yamada,et al.  Effect of the perturbed correlation method for optical character recognition , 1997, Pattern Recognit..

[44]  G. M. Quenot The 'orthogonal algorithm' for optical flow detection using dynamic programming , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[45]  Daniel Keysers,et al.  Elastic image matching is NP-complete , 2003, Pattern Recognit. Lett..

[46]  Hiromitsu Nishimura,et al.  Off-line hand-written character recognition using integrated 1D HMMs based on feature extraction filters , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[47]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[48]  Gerhard Rigoll,et al.  Multi-branch and two-pass HMM modeling approaches for off-line cursive handwriting recognition , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[49]  Paul D. Gader,et al.  Handwritten Word Recognition Using Segmentation-Free Hidden Markov Modeling and Segmentation-Based Dynamic Programming Techniques , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Seiichi Uchida,et al.  Handwritten character recognition using elastic matching based on a class-dependent deformation model , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[51]  Kazuhiko Yamamoto,et al.  Research on Machine Recognition of Handprinted Characters , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.