Neural network models and their application to handwritten digit recognition

Several neural network paradigms are discussed, and their application to the recognition of handwritten digits is considered. In particular, linear autoassociative systems, threshold logic networks, background error propagation models, Hopfield networks, and Boltzmann machines are considered. An explanation of each technique is presented and its application to digit recognition is discussed. The tradeoffs of time and space complexity versus recognition accuracy are considered. The objective is to determine the applicability of these techniques to the real-world need of the United States Postal Service (USPS) for a high-accuracy handwritten digit recognition algorithm. Recognition experiments are presented that were performed on a database of over 10000 handwritten digits that were extracted from live mail in a USPS mail-processing facility. The time required by each method and the recognition rates of the methods are discussed.<<ETX>>

[1]  H. C. LONGUET-HIGGINS,et al.  Holographic Model of Temporal Recall , 1968, Nature.

[2]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[3]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[4]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[6]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.