Recent progress in neural networks

In the past several years, much progress has been made in neural network technology. Neural networks have been used in many applications of signal processing to classify different sets of patterns. This paper presents some of the trends relevant to application of neural technology. No comprehensive review of the state of the art is attempted. Rather, the emphasis is selectively on certain current trends, as new ideas, that in the author's opinion show promise for the future. However, the reader should note that neural network technology is in a state of flux with several alternative theoretical models and approaches. The paper deals with the practical aspects of the research in neural networks. The basic concepts of neural networks and progress in learning algorithms are briefly reviewed, followed by a discussion of the trends relevant to hardware implementations of these networks. Finally, hybrids comprising neural networks, expert systems, and genetic algorithms are considered.

[1]  Edward A. Rietman,et al.  Back-propagation learning and nonidealities in analog neural network hardware , 1991, IEEE Trans. Neural Networks.

[2]  Y. F. Huang,et al.  Bounds on number of hidden neurons of multilayer perceptrons in classification and recognition , 1990, IEEE International Symposium on Circuits and Systems.

[3]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[4]  Philip D. Wasserman,et al.  Neural computing - theory and practice , 1989 .

[5]  Jorma Laaksonen,et al.  Variants of self-organizing maps , 1990, International 1989 Joint Conference on Neural Networks.

[6]  D. R. Collins,et al.  Neural network algorithms and implementations , 1990, IEEE International Symposium on Circuits and Systems.

[7]  L.M. Reyneri,et al.  Mixing analog and digital techniques for silicon neural networks , 1990, IEEE International Symposium on Circuits and Systems.

[8]  Tony R. Martinez.  Consistency and generalization in incrementally trained connectionist networks , 1990, IEEE International Symposium on Circuits and Systems.

[9]  Terrence J. Sejnowski,et al.  NETtalk: a parallel network that learns to read aloud , 1988 .

[10]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[11]  H J Caulfield.  Parallel N(4) weighted optical interconnections. , 1987, Applied optics.

[12]  D. Psaltis,et al.  Invariance and discrimination properties of the optical associative loop , 1988, IEEE 1988 International Conference on Neural Networks.

[13]  Atsushi Hiramatsu,et al.  ATM communications network control by neural networks , 1990, IEEE Trans. Neural Networks.

[14]  Stephen Grossberg.  Cognition, learning, reinforcement, and rhythm , 1987 .

[15]  William A. Fisher,et al.  A programmable analog neural network processor , 1991, IEEE Trans. Neural Networks.

[16]  R. Lippmann,et al.  An introduction to computing with neural nets , 1987, IEEE ASSP Magazine.

[17]  Matthew Zeidenberg,et al.  Neural networks in artificial intelligence , 1990, Ellis Horwood series in artificial intelligence.

[18]  L.-S. Lee,et al.  A continuous-time optical neural network , 1988, IEEE 1988 International Conference on Neural Networks.

[19]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[21]  D. B. Fogel,et al.  AN INFORMATION CRITERION FOR OPTIMAL NEURAL NETWORK SELECTION , 1990, 1990 Conference Record Twenty-Fourth Asilomar Conference on Signals, Systems and Computers, 1990..

[22]  Nabil H. Farhat.  Photonic Neurocomputers And Learning Machines , 1990, Optics & Photonics.

[23]  A. Mathur,et al.  Hybrid neural network and pattern classification learning algorithms , 1990, IEEE International Symposium on Circuits and Systems.

[24]  Richard P. Brent,et al.  Fast training algorithms for multilayer neural nets , 1991, IEEE Trans. Neural Networks.

[25]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[26]  Alan F. Murray,et al.  Pulse-stream VLSI neural networks mixing analog and digital techniques , 1991, IEEE Trans. Neural Networks.