Penacée: A Neural Net System for Recognizing On-Line Handwriting

We report on progress in handwriting recognition and signature verification. Our system, which uses pen-trajectory information, is suitable for use in pen-based computers. It has a multimodular architecture whose central trainable module is a time-delay neural network. Results comparing our system and a commercial recognizer are presented. Our best recognizer makes three times less errors on hand-printed word recognition than the commercial one.

[1]  Isabelle Guyon,et al.  Recognition-Based Segmentation of On-Line Hand-Printed Words , 1992, NIPS.

[2]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[3]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[4]  David Haussler,et al.  What Size Net Gives Valid Generalization? , 1989, Neural Computation.

[5]  Roberto Pieraccini,et al.  Time-Warping Network: A Neural Approach to Hidden Markov Model Based Speech Recognition , 1993, Int. J. Pattern Recognit. Artif. Intell..

[6]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[7]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[8]  Pierre Baldi,et al.  Neural Networks for Fingerprint Recognition , 1993, Neural Computation.

[9]  Isabelle Guyon,et al.  Computer aided cleaning of large databases for character recognition , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[10]  H. Bourlard,et al.  Links Between Markov Models and Multilayer Perceptrons , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Ching Y. Suen,et al.  The State of the Art in Online Handwriting Recognition , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  R. Pfeifer,et al.  Connectionism in Perspective , 1989 .

[13]  Isabelle Guyon,et al.  Recognition-based segmentation of on-line run-on handprinted words: Input vs. output segmentation , 1994, Pattern Recognit..

[14]  Yann LeCun,et al.  Writer independent and writer adaptive neural network for on-line character recognition , 1992 .

[15]  Isabelle Guyon,et al.  Writer-adaptation for on-line handwritten character recognition , 1993, Proceedings of 2nd International Conference on Document Analysis and Recognition (ICDAR '93).

[16]  Harris Drucker,et al.  Boosting Performance in Neural Networks , 1993, Int. J. Pattern Recognit. Artif. Intell..

[17]  Y. Le Cun,et al.  Shortest path segmentation: a method for training a neural network to recognize character strings , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[18]  Richard P. Lippmann,et al.  Review of Neural Networks for Speech Recognition , 1989, Neural Computation.

[19]  Kevin J. Lang.  A time delay neural network architecture for speech recognition , 1989 .

[20]  James D. Keeler,et al.  Integrated Segmentation and Recognition of Hand-Printed Numerals , 1990, NIPS.

[21]  Vladimir Vapnik,et al.  Estimation of Dependences Based on Empirical Data: Springer Series in Statistics (Springer Series in Statistics) , 1982 .

[22]  Yann LeCun,et al.  Generalization and network design strategies , 1989 .

[23]  James D. Keeler,et al.  A Self-Organizing Integrated Segmentation and Recognition Neural Net , 1991, NIPS.

[24]  John S. Bridle,et al.  Alpha-nets: A recurrent 'neural' network architecture with a hidden Markov model interpretation , 1990, Speech Commun..

[25]  Isabelle Guyon,et al.  Structural Risk Minimization for Character Recognition , 1991, NIPS.

[26]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[27]  Isabelle Guyon,et al.  Design of a neural network character recognizer for a touch terminal , 1991, Pattern Recognit..