Towards an art based mathematical editor, that uses on-line handwritten symbol recognition

A new mathematical editor, based on the recognition of run-on discrete handwritten symbols, is proposed. The tested laboratory prototype of the system, modular and adaptable to the user habits and site requirements, uses a natural handwriting interface as well as human gestures. Two methods were used for symbol recognition, namely the state-of-the-art elastic matching algorithm and an Adaptive Resonance Theory neural architecture. The neural solution is proved to be better adapted to the cognitive nature of the problem and faster in both learning and test phases. Finally a novel attribute grammar permits the detection and subsequent correction of errors in the mathematical expressions.

[1]  I. Guyon,et al.  Handwritten digit recognition: applications of neural network chips and automatic learning , 1989, IEEE Communications Magazine.

[2]  Josef Raviv,et al.  Decision making in Markov chains applied to the problem of pattern recognition , 1967, IEEE Trans. Inf. Theory.

[3]  C. Mannes,et al.  A neural network model of spatio-temporal pattern recognition, recall, and timing , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[4]  P. A. Chou,et al.  Recognition of Equations Using a Two-Dimensional Stochastic Context-Free Grammar , 1989, Other Conferences.

[5]  Stephen Grossberg,et al.  Working Memory Networks for Learning Temporal Order with Application to Three-Dimensional Visual Object Recognition , 1992, Neural Computation.

[6]  C. Faure,et al.  Structural analysis of handwritten mathematical expressions , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[7]  K. H. Hanne,et al.  Combined graphic- and natural language-interaction (design and implementation) , 1989 .

[8]  R. H. Anderson,et al.  Two-Dimensional Mathematical Notation , 1977 .

[9]  Robert F. Port,et al.  Representation and Recognition of Temporal Patterns , 1990 .

[10]  Réjean Plamondon,et al.  On-line recognition of handprinted characters: Survey and beta tests , 1990, Pattern Recognit..

[11]  S. Grossberg,et al.  How does a brain build a cognitive code? , 1980, Psychological review.

[12]  King-Sun Fu,et al.  Syntactic Pattern Recognition And Applications , 1968 .

[13]  Lambert Schomaker,et al.  Using stroke- or character-based self-organizing maps in the recognition of on-line, connected cursive script , 1993, Pattern Recognit..

[14]  Jan Maluszynski,et al.  Relating Logic Programs and Attribute Grammars , 1985, J. Log. Program..

[15]  David J. Burr,et al.  Elastic Matching of Line Drawings , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Godfried T. Toussaint,et al.  Experiments in Text Recognition with the Modified Viterbi Algorithm , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Emmanuel Skordalakis,et al.  Rule-based systems and pattern recognition , 1987, Pattern Recognit. Lett..

[18]  Charles C. Tappert,et al.  Cursive Script Recognition by Elastic Matching , 1982, IBM J. Res. Dev..

[19]  Pietro G. Morasso,et al.  Recognition experiments of cursive dynamic handwriting with self-organizing networks , 1993, Pattern Recognit..

[20]  Richard Lippmann,et al.  Review of Neural Networks for Speech Recognition , 1989, Neural Computation.

[21]  Stephen Grossberg,et al.  Studies of mind and brain , 1982 .

[22]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[23]  Stephen Grossberg,et al.  ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[24]  Stephen Grossberg,et al.  Art 2: Self-Organization Of Stable Category Recognition Codes For Analog Input Patterns , 1988, Other Conferences.

[25]  Dana S. Nau,et al.  Expert computer systems , 1983, Computer.

[26]  Stephen Grossberg,et al.  Working memories for storage and recall of arbitrary temporal sequences , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[27]  King-Sun Fu,et al.  Attributed Grammar-A Tool for Combining Syntactic and Statistical Approaches to Pattern Recognition , 1980, IEEE Transactions on Systems, Man, and Cybernetics.

[28]  Gerald Sommer,et al.  Pattern Recognition by Self-Organizing Neural Networks , 1994 .

[29]  Stephen Grossberg,et al.  A Theory of Human Memory: Self-Organization and Performance of Sensory-Motor Codes, Maps, and Plans , 1982 .

[30]  Lindsay J. Evett,et al.  Fast dictionary look-up for contextual word recognition , 1990, Pattern Recognit..

[31]  J.P. Banquet,et al.  An integrated neural network-event-related potentials model of temporal and probability context effects on event categorization , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[32]  King-Sun Fu,et al.  VLSI architecture for dynamic time-warp recognition of handwritten symbols , 1986, IEEE Trans. Acoust. Speech Signal Process..

[33]  Sargur N. Srihari,et al.  Experiments in Text Recognition with Binary n-Gram and Viterbi Algorithms , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Steven Skiena,et al.  Tablet: personal computer of the year 2000 , 1988, CACM.

[35]  V. K. Govindan,et al.  Character recognition - A review , 1990, Pattern Recognit..

[36]  S. Grossberg,et al.  ART 2: self-organization of stable category recognition codes for analog input patterns. , 1987, Applied optics.

[37]  Arto I. Kankaanpaa.  FIDS-A flat-panel interactive display system , 1988, IEEE Computer Graphics and Applications.

[38]  Rodney Cotterill,et al.  Models of brain function , 1989 .

[39]  Ching Y. Suen,et al.  The State of the Art in Online Handwriting Recognition , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  S. Levinson,et al.  Considerations in dynamic time warping algorithms for discrete word recognition , 1978 .

[41]  Stephen Grossberg,et al.  Comparative performance measures of fuzzy ARTMAP, learned vector quantization, and back propagation for handwritten character recognition , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[42]  Catherine G. Wolf,et al.  The Use of Hand-Drawn Gestures for Text Editing , 1987, Int. J. Man Mach. Stud..

[43]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[44]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[45]  Godfried T. Toussaint,et al.  The use of context in pattern recognition , 1978, Pattern Recognit..

[46]  R. Atkinson,et al.  The control of short-term memory. , 1971, Scientific American.

[47]  Donald E. Knuth,et al.  The TEX Book , 1984 .