Artificial Neural Networks: A Tutorial

Artificial neural nets (ANNs) are massively parallel systems with large numbers of interconnected simple processors. The article discusses the motivations behind the development of ANNs and describes the basic biological neuron and the artificial computational model. It outlines network architectures and learning processes, and presents some of the most commonly used ANN models. It concludes with character recognition, a successful ANN application.

[1]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[2]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[3]  D. E. Rumelhart,et al.  chapter Parallel Distributed Processing, Exploration in the Microstructure of Cognition , 1986 .

[4]  R. Palmer,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[5]  Patrick J. Grother,et al.  The First Census Optical Character Recognition Systems Conference | NIST , 1992 .

[6]  Gerald Sommer,et al.  Pattern Recognition by Self-Organizing Neural Networks , 1994 .

[7]  Omid Omidvar,et al.  Neural Networks and Pattern Recognition , 1997 .

[8]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[9]  Nils J. Nilsson,et al.  Learning Machines: Foundations of Trainable Pattern-Classifying Systems , 1965 .

[10]  Marvin Minsky,et al.  Logical Versus Analogical or Symbolic Versus Connectionist or Neat Versus Scruffy , 1991, AI Mag..

[11]  Jianchang Mao,et al.  A comparative study of different classifiers for handprinted character recognition , 1994 .

[12]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[13]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[14]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[15]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[16]  A. A. Mullin,et al.  Principles of neurodynamics , 1962 .

[17]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[18]  Mark A. Fanty,et al.  Computing with structured neural networks , 1988, Computer.

[19]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[20]  Anil K. Jain,et al.  Neural networks and pattern recognition , 1994 .

[21]  Benny Lautrup,et al.  Neural Networks: Computers With Intuition , 1990 .

[22]  S. Grossberg,et al.  Pattern Recognition by Self-Organizing Neural Networks , 1991 .

[23]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[24]  R. Lippmann,et al.  An introduction to computing with neural nets , 1987, IEEE ASSP Magazine.

[25]  Widrow,et al.  DARPA Neural Network Stdy , 1988 .

[26]  Marvin Minsky,et al.  Perceptrons: An Introduction to Computational Geometry , 1969 .

[27]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[28]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[29]  James A. Anderson,et al.  Neurocomputing: Foundations of Research , 1988 .