Temporal signal processing with high-speed hybrid analog-digital neural networks

There are many problems which fall into the class of temporal signal processing. These problems have in common the need to relate the temporal properties of their inputs. Conventional solutions to these problems often have high hardware overhead, complex algorithmic solutions, or loss of information through the transformation of temporal properties of the input. To this end, a biologically motivated artificial and neural processing element has been developed. As in biological neurons, processing is time dependent and is implemented using both analog and digital techniques. These characteristics make the PE directly applicable a large class of temporal signal processing problems typically encountered in engineering and science. Multiple aspects of the PE behavior are adjustable, which produces a very wide range of behaviors from simple systems with only a few moderately connected processing elements. The processing element models are custom designed electric circuits based on basic CMOS components and therefore all developed systems can be directly implemented in any standard integrated CMOS technology. The integrated implementation, custom design, and a wide range of adaptable behaviors join to produce a very fast, low-hardware solution to complex spatiotemporal signal processing problems. Seven novel systems based on the hybrid PE are discussed as they relate to commonly encountered temporal signal processing problems.

[1]  Alan F. Murray,et al.  Asynchronous VLSI neural networks using pulse-stream arithmetic , 1988 .

[2]  Teuvo Kohonen,et al.  An introduction to neural computing , 1988, Neural Networks.

[3]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[4]  Mark R. DeYong,et al.  Computational Capabilities of Biologically-Realistic Analog Processing Elements , 1991 .

[5]  Richard Durbin,et al.  The computing neuron , 1989 .

[6]  H. Wigström,et al.  Physiological mechanisms underlying long-term potentiation , 1988, Trends in Neurosciences.

[7]  J. Barnden,et al.  Winner-take-all networks: Time-based versus activation-based mechanisms for various selection goals , 1990, IEEE International Symposium on Circuits and Systems.

[8]  Y. Takefuji,et al.  Analog components for the VLSI of neural networks , 1990, IEEE Circuits and Devices Magazine.

[9]  D. C. Van Essen,et al.  Concurrent processing streams in monkey visual cortex , 1988, Trends in Neurosciences.

[10]  Erich J. Smythe.  Temporal Representations in a Connectionist Speech System , 1988, NIPS.

[11]  Yaser S. Abu-Mostafa,et al.  Analog Neural Networks as Decoders , 1990, NIPS.

[12]  Mark R. DeYong,et al.  The design, fabrication, and test of a new VLSI hybrid analog-digital neural processing element , 1992, IEEE Trans. Neural Networks.

[13]  Idan Segev,et al.  Methods in Neuronal Modeling , 1988 .

[14]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[15]  J. Nicholls.  From neuron to brain , 1976 .

[16]  Roman Borisyuk,et al.  A Model of Neural Oscillator for a Unified Submodule , 1988, NIPS.

[17]  David C. Tam,et al.  Signal Processing by Multiplexing and Demultiplexing in Neurons , 1990, NIPS.

[18]  Srinivas Kankanahalli.  Selection in massively parallel connectionist networks , 1991 .

[19]  Jack L. Meador,et al.  Programmable impulse neural circuits , 1991, IEEE Trans. Neural Networks.

[20]  Misha Mahowald,et al.  A silicon model of early visual processing , 1993, Neural Networks.

[21]  John Lazzaro,et al.  A Silicon Model Of Auditory Localization , 1989, Neural Computation.

[22]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[23]  Howard C. Card,et al.  Silicon models of associative learning in Aplysia , 1990, Neural Networks.

[24]  José G. Delgado-Frias,et al.  VLSI for Artificial Intelligence and Neural Networks , 1991, Springer US.

[25]  Rodney A. Brooks,et al.  A Robot that Walks; Emergent Behaviors from a Carefully Evolved Network , 1989, Neural Computation.

[26]  Matthew A. Wilson,et al.  The simulation of large-scale neural networks , 1989 .

[27]  Bart Kosko,et al.  Neural networks and fuzzy systems: a dynamical systems approach to machine intelligence , 1991 .

[28]  D. Junge.  Nerve and muscle excitation , 1976 .

[29]  Geoffrey E. Hinton,et al.  Symbols Among the Neurons: Details of a Connectionist Inference Architecture , 1985, IJCAI.

[30]  Michael G. Dyer,et al.  High-level Inferencing in a Connectionist Network , 1989 .

[31]  C. Miall,et al.  The diversity of neuronal properties , 1989 .

[32]  Alan F. Murray,et al.  Pulse-stream VLSI neural networks mixing analog and digital techniques , 1991, IEEE Trans. Neural Networks.

[33]  Howard C. Card,et al.  Vlsi Devices and Circuits for Neural Networks , 1989, Int. J. Neural Syst..

[34]  Allen I. Selverston,et al.  A consideration of invertebrate central pattern generators as computational data bases , 1988, Neural Networks.

[35]  S. Kaplan.  The Physiology of Thought , 1950 .