The State of the Art in Online Handwriting Recognition

This survey describes the state of the art of online handwriting recognition during a period of renewed activity in the field. It is based on an extensive review of the literature, including journal articles, conference proceedings, and patents. Online versus offline recognition, digitizer technology, and handwriting properties and recognition problems are discussed. Shape recognition algorithms, preprocessing and postprocessing techniques, experimental systems, and commercial products are examined. >

[1]  T. G. Evans,et al.  Cyclops-I, a Second Generation Recognition System , 1899 .

[2]  J. A. Turner,et al.  Linear Current Division in Resistive Areas, its Application to Computer Graphics , 1899 .

[3]  G. G. Wright.  The writing of Arabic numerals , 1952 .

[4]  T. L. Dimond,et al.  Devices for reading handwritten characters , 1899, IRE-ACM-AIEE '57 (Eastern).

[5]  Ulric Neisser,et al.  A Note on Human Recognition of Hand-Printed Characters , 1960, Inf. Control..

[6]  J. Strackee,et al.  A handwriting simulator. , 1962, Physics in medicine and biology.

[7]  Murray Eden,et al.  Handwriting and pattern recognition , 1962, IRE Trans. Inf. Theory.

[8]  L. D. Earnest,et al.  Machine Recognition of Cursive Writing , 1962, IFIP Congress.

[9]  Wilbur H. Highleyman,et al.  Data for Character Recognition Studies , 1963, IEEE Transactions on Electronic Computers.

[10]  T. G. Evans,et al.  CYCLOPS-1: a second-generation recognition system , 1963, AFIPS '63 (Fall).

[11]  Paul Mermelstein,et al.  A system for automatic recognition of handwritten words , 1899, AFIPS '64 (Fall, part I).

[12]  Murray Eden,et al.  Experiments on Computer Recognition of Connected Handwritten Words , 1964, Inf. Control..

[13]  Waren Teitelman,et al.  Real time recognition of hand-drawn characters , 1964, AFIPS '64 (Fall, part I).

[14]  Richard M. Brown,et al.  On-Line Computer Recognition of Handprinted Characters , 1964, IEEE Trans. Electron. Comput..

[15]  T. O. Ellis,et al.  The RAND tablet: a man-machine graphical communication device , 1964, AFIPS '64 (Fall, part I).

[16]  Nilo A Lindgren,et al.  Machine recognition of human language Part III - Cursive script recognition , 1965, IEEE Spectrum.

[17]  Gabriel F. Groner.  Real-time recognition of handprinted text , 1966, AFIPS '66 (Fall).

[18]  C. J. Tunis,et al.  Handprinting Input device for computer systems , 1967, IEEE Spectrum.

[19]  W. G. Koster,et al.  Analysis and Synthesis of Handwriting , 1967 .

[20]  John F. Heafner,et al.  On-Line Computer Classification of Handprinted Chinese Characters as a Translation Aid , 1967, IEEE Trans. Electron. Comput..

[21]  T. W. Sze,et al.  On recognition of handwriting Chinese characters , 1967 .

[22]  T. W. Sze,et al.  A method of recognition of hand drawn line patterns , 1967 .

[23]  James F. Teixeira,et al.  The Sylvania data tablet: a new approach to graphic data input , 1968, AFIPS '68 (Spring).

[24]  Robert H. Anderson.  Syntax-directed recognition of hand-printed two-dimensional mathematics , 1967, Symposium on Interactive Systems for Experimental Applied Mathematics.

[25]  Richard O. Duda,et al.  Experiments in the recognition of hand-printed text, part II: context analysis , 1968, AFIPS '68 (Fall, part II).

[26]  J. H. Munson,et al.  Experiments in the recognition of hand-printed text, part I: character recognition , 1968, AFIPS '68 (Fall, part II).

[27]  George M. Miller.  On-line recognition of hand-generated symbols , 1969, AFIPS '69 (Fall).

[28]  A. M. Hlady.  A touch sensitive X-Y position encoder for computer input , 1969, AFIPS '69 (Fall).

[29]  Arnold L. Knoll,et al.  Experiments with "Characteristic Loci" for Recognition of Handprinted Characters , 1969, IEEE Transactions on Computers.

[30]  George M. Miller.  Real-Time Classification of Handwritten Script Words , 1971, IFIP Congress.

[31]  Marilyn Bohl,et al.  Information processing , 1971 .

[32]  L. D. Harmon,et al.  Automatic recognition of print and script , 1972 .

[33]  A. Nielsen,et al.  Pattern Recognition Using Dynamic Pictorial Information , 1972 .

[34]  G. Fursin,et al.  Recognition of handwritten symbols in the process of writing , 1972 .

[35]  Chin-Chuan Cheng.  Computer-Based Chinese Teaching Program at Illinois. , 1972 .

[36]  Robert F. Sproull,et al.  Principles in interactive computer graphics , 1973 .

[37]  Shang-Chun Chen.  Computer aided learning of the writing of chinese characters. , 1973 .

[38]  V. Michael Powers.  Pen direction sequences in character recognition , 1973, Pattern Recognit..

[39]  Kenneth M. Sayre,et al.  Machine recognition of handwritten words: A project report , 1973, Pattern Recognit..

[40]  M Yasuhara,et al.  [Experimental studies of handwriting process]. , 1974, Iyo denshi to seitai kogaku. Japanese journal of medical electronics and biological engineering.

[41]  Barry A. Blesser,et al.  A Theoretical Approach for Character Recognition Based on Phenomenological Attributes , 1974, Int. J. Man Mach. Stud..

[42]  Ching Y. Suen,et al.  Handwriting Education--A Bibliography of Contemporary Publications. , 1975 .

[43]  Roger W. Ehrich,et al.  Experiments in the Contextual Recognition of Cursive Script , 1975, IEEE Transactions on Computers.

[44]  Sebastiano Impedovo,et al.  Real-Time Recognition of Handwritten Numerals , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[45]  M. Naus,et al.  Why a Y is not a V: a new look at the distinctive features of letters. , 1976, Journal of experimental psychology. Human perception and performance.

[46]  Hiroshi Yoshida,et al.  An on-line character recognition aimed at a substitution for a billing machine keyboard , 1976, Pattern Recognit..

[47]  Barry Blesser,et al.  Psychophysical Techniques for Investigating the Distinctive Features of Letters. , 1976 .

[48]  Barry A. Blesser,et al.  Empirical tests for feature selection based on a psychological theory of character recognition , 1976, Pattern Recognit..

[49]  Fumihiko Kimura,et al.  An Interactive Geometrical Design System with Handwriting Input , 1977, IFIP Congress.

[50]  Hewitt D. Crane,et al.  Special Feature: An On-Line Data Entry System for Hand-Printed Characters* , 1977, Computer.

[51]  Adele Goldberg,et al.  Personal Dynamic Media , 1977, Computer.

[52]  C. N. Liu,et al.  Automatic signature verification based on accelerometry , 1977 .

[53]  Jean-François Allouis.  Use of High-Speed Microprocessors for Digital Synthesis , 1978, ICMC.

[54]  Anna Maria Fanelli,et al.  A Fourier descriptor set for recognizing nonstylized numerals , 1978 .

[55]  Mabo Robert Ito,et al.  On-line computer recognition of proposed standard ANSI(USASI) handprinted characters , 1978, Pattern Recognit..

[56]  M Berthod,et al.  Learning in syntactic recognition of symbols drawn on a graphic tablet , 1979 .

[57]  RAOUF F. H. FARAG,et al.  Word-Level Recognition of Cursive Script , 1979, IEEE Transactions on Computers.

[58]  D. J. Grover.  Graphics tablets—a review , 1979 .

[59]  Jacques Duvernoy,et al.  Stability and stationarity of cursive handwriting , 1979, Pattern Recognit..

[60]  Hans-Leo Teulings,et al.  Computer-Aided Analysis of Handwriting Movements. , 1979 .

[61]  A. Wing.  Variability in Handwritten Characters. , 1979 .

[62]  John M. Hollerbach.  UNDERSTANDING MANIPULATOR CONTROL BY SYNTHESIZING HUMAN HANDWRITING. , 1979 .

[63]  Kazuhiko Yamamoto,et al.  Recognition of handprinted characters by an outermost point method , 1980, Pattern Recognit..

[64]  J. S. Lew.  Kinematic theory of signature verification measurements , 1980 .

[65]  Patrick A. V. Hall,et al.  Approximate String Matching , 1994, Encyclopedia of Algorithms.

[66]  Shin-ichi Hanaki,et al.  On-line recognition of handprinted Kanji characters , 1980, Pattern Recognit..

[67]  O. Kato,et al.  A Handwriting Input System for Japanese , 1980, IFIP Congress.

[68]  John S. Lew,et al.  Optimal Accelerometer Layouts for Data Recovery in Signature Verification , 1980, IBM J. Res. Dev..

[69]  M. Berthod,et al.  Automatic recognition of handprinted characters—The state of the art , 1980, Proceedings of the IEEE.

[70]  Ernesto F. Yhap,et al.  An On-Line Chinese Character Recognition System , 1981, IBM J. Res. Dev..

[71]  David J. Burr,et al.  Elastic Matching of Line Drawings , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[72]  Katsuo Ikeda,et al.  On-line recognition of hand-written characters utilizing positional and stroke vector sequences , 1981, Pattern Recognit..

[73]  H. Inose.  Scientific information systems in Japan , 1981 .

[74]  Y. H. Huh,et al.  On-line recognition of hand-printed Korean characters , 1982, Pattern Recognit..

[75]  Barry A. Blesser,et al.  Skeletons: A link between theoretical and physical letter descriptions , 1982, Pattern Recognit..

[76]  K. Yoshida,et al.  Online Handwritten Character Recognition for a Personal Computer System , 1982, IEEE Transactions on Consumer Electronics.

[77]  Ching Y. Suen,et al.  A Method for Selecting Constrained Hand-Printed Character Shapes for Machine Recognition , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[78]  Charles C. Tappert,et al.  Cursive Script Recognition by Elastic Matching , 1982, IBM J. Res. Dev..

[79]  Ioan Doré Landau,et al.  An On-Line Procedure for Recognition of Handprinted Alphanumeric Characters , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[80]  Sargur N. Srihari,et al.  A String Correction Algorithm for Cursive Script Recognition , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[81]  Ben Shneiderman,et al.  The future of interactive systems and the emergence of direct manipulation , 1982 .

[82]  Hewitt D. Crane,et al.  Automatic signature verification using a three-axis force-sensitive pen , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[83]  J. Gyoba,et al.  [Reaction time and eye movements in the recognition task of hand-written Katakana-letters: an experimental verification of the discriminant analysis of letter recognition by Hayashi's Quantification]. , 1983, Shinrigaku kenkyu : The Japanese journal of psychology.

[84]  David Sankoff,et al.  Time Warps, String Edits, and Macromolecules: The Theory and Practice of Sequence Comparison , 1983 .

[85]  Hiroki Arakawa.  On-line recognition of handwritten characters - alphanumerics, Hiragana, Katakana, Kanji , 1983, Pattern Recognit..

[86]  S. Ganapathy,et al.  Preprocessing techniques for cursive script word recognition , 1983, Pattern Recognit..

[87]  C Y Suen,et al.  Handwriting generation, perception and recognition. , 1983, Acta psychologica.

[88]  J. Kruskal.  An Overview of Sequence Comparison: Time Warps, String Edits, and Macromolecules , 1983 .

[89]  David J. Burr,et al.  Designing a Handwriting Reader , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[90]  J. Freyd,et al.  Representing the dynamics of a static form , 1983, Memory & cognition.

[91]  Alison Lee,et al.  Enhancing the usability of an Office Information System through direct manipulation , 1983, CHI '83.

[92]  Kazuhiko Yamamoto,et al.  Research on Machine Recognition of Handprinted Characters , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[93]  James D. Foley,et al.  The human factors of computer graphics interaction techniques , 1984, IEEE Computer Graphics and Applications.

[94]  Jean Paul Haton,et al.  A Syntactic Approach for Handwritten Mathematical Formula Recognition , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[95]  R. Haralick.  Computer analysis and perception, vol, 1: Visual signals , 1984 .

[96]  P. J. G. Keuss,et al.  Motor aspects of handwriting : approaches to movement in graphic behavior , 1984 .

[97]  Wolfgang Doster,et al.  Word Processing with On-Line Script Recognition , 1984, IEEE Micro.

[98]  Barry Blesser,et al.  Interactive Recognition of Handprinted Characters for Computer Input , 1985, IEEE Computer Graphics and Applications.

[99]  Theodosios Pavlidis,et al.  An automatic beautifier for drawings and illustrations , 1985, SIGGRAPH.

[100]  Yoichi Watanabe,et al.  A psychological approach to the human recognition of ambiguous characters. , 1985 .

[101]  Frank Fallside,et al.  Dynamic Programming in the Recognition of Connected Handwritten Script , 1985, CAIA.

[102]  King-Sun Fu,et al.  VLSI architecture for dynamic time-warp recognition of handwritten symbols , 1986, IEEE Trans. Acoust. Speech Signal Process..

[103]  J. Mantas,et al.  An overview of character recognition methodologies , 1986, Pattern Recognit..

[104]  Pieter de Bruyne.  Compact Large-Area Graphic Digitizer for Personal Computers , 1986, IEEE Computer Graphics and Applications.

[105]  C. Tappert.  An Adaptive System for Handwriting Recognition , 1986 .

[106]  Hiroshi Murase,et al.  Online hand-sketched figure recognition , 1986, Pattern Recognit..

[107]  T. K. Worthington,et al.  IBM dynamic signature verification , 1986, Comput. Secur..

[108]  H. Kao,et al.  Graphonomics : contemporary research in handwriting , 1986 .

[109]  Catherine G. Wolf.  CAN PEOPLE USE GESTURE COMMANDS? , 1986, SGCH.

[110]  Malayappan Shridhar,et al.  Recognition of isolated and simply connected handwritten numerals , 1986, Pattern Recognition.

[111]  Robert H. Davis,et al.  Recognition of handwritten characters - a review , 1986, Image Vis. Comput..

[112]  Ching Y. Suen.  Computational Studies of the Most Frequent Chinese Words and Sounds , 1986, World Scientific Series in Computer Science.

[113]  I. Masuda,et al.  Stroke-order-independent on-line character recognition algorithm and its application , 1986 .

[114]  Kin Hong Wong,et al.  Script recognition using hidden Markov models , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[115]  Graham Leedham,et al.  Automatic recognition and transcription of Pitman's handwritten shorthand - An approach to shortforms , 1987, Pattern Recognit..

[116]  Ching Y. Suen,et al.  Computer Recognition of Totally unconstrained Handwritten ZIP Codes , 1987, Int. J. Pattern Recognit. Artif. Intell..

[117]  Jean R. Ward,et al.  Digitizer Technology: Performance Characteristics and the Effects on the User Interface , 1987, IEEE Computer Graphics and Applications.

[118]  Jerome M. Kurtzberg,et al.  Feature Analysis for Symbol Recognition by Elastic Matching , 1987, IBM J. Res. Dev..

[119]  Catherine G. Wolf,et al.  The Use of Hand-Drawn Gestures for Text Editing , 1987, Int. J. Man Mach. Stud..

[120]  Arto I. Kankaanpaa.  FIDS-A flat-panel interactive display system , 1988, IEEE Computer Graphics and Applications.

[121]  Jean R. Ward,et al.  A model for variability effects in handprinting with implications for the design of handwriting character recognition systems , 1988, IEEE Trans. Syst. Man Cybern..

[122]  Steven Skiena,et al.  Tablet: personal computer of the year 2000 , 1988, CACM.

[123]  KEH-JIANN CHEN,et al.  A System for on-Line Recognition of Chinese Characters , 1988, Int. J. Pattern Recognit. Artif. Intell..

[124]  Hiroshi Murase.  Online recognition of free-format Japanese handwritings , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[125]  Alan C. Bovik,et al.  Microprocessor-based recognition of handprinted characters from a tablet input , 1988, Pattern Recognit..

[126]  A. Kundu,et al.  Recognition of handwritten script: a hidden Markov model based approach , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[127]  Haruhiko Kojima,et al.  Online hand-drawn line-figure recognition and its application , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[128]  T. Wakahara.  Online cursive script recognition using local affine transformation , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[129]  Yasuo Ishii,et al.  A Kanji Recognition Method which detects Writing Errors , 1988, Int. J. Pattern Recognit. Artif. Intell..

[130]  Réjean Plamondon,et al.  Automatic signature verification and writer identification - the state of the art , 1989, Pattern Recognit..

[131]  Sargur N. Srihari,et al.  Off-Line Cursive Script Word Recognition , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[132]  Joonki Kim,et al.  On-Line Gesture Recognition by Feature Analysis , 1989, Computer Vision and Shape Recognition.