Design of parallel hardware neural network systems from custom analog VLSI 'building block' chips

Hardware to implement feedforward neural networks has been developed for the evaluation of learning algorithms and prototyping of applications. To allow the construction of networks with arbitrary architectures, CMOS VLSI building-block components (e.g. arrays of neurons and synapses) have been designed. These can be cascaded to form networks with hundreds of neurons per layer. A 64-channel multiplexer input neuron chip serves to buffer stored charges for injection into the first synaptic layer. A 32*32 synapse chip design uses multiplier circuits to generate a conductance from stored analog charges representing weights. A 32-channel variable-gain neuron chip applies an adjustable-gain sigmoidal activation function to the sum of currents from the previous synaptic layer. Learning is performed by a host computer that can download weights and inputs onto the feedforward hardware, and read resultant network outputs. Weights and input values are stored as charges on on-chip capacitors; these are serially and invisibly refreshed by off-chip circuits that convert values stored in digital memory into analog signals.<<ETX>>

[1]  Silvio P. Eberhardt,et al.  Considerations For Hardware Implementations Of Neural Networks , 1988, Twenty-Second Asilomar Conference on Signals, Systems and Computers.

[2]  J.N. Babanezhad,et al.  A 20-V four-quadrant CMOS analog multiplier , 1985, IEEE Journal of Solid-State Circuits.

[3]  L. A. Akers,et al.  A limited-interconnect synthetic neural IC , 1988, IEEE 1988 International Conference on Neural Networks.

[4]  J. Bailey,et al.  Why VLSI implementations of associative VLCNs require connection multiplexing , 1988, IEEE 1988 International Conference on Neural Networks.

[5]  F.J. Kub,et al.  Architecture for large microelectronic supervised learning artificial neural networks using a hybrid digital-analog approach , 1988, Neural Networks.

[6]  Robert B. Allen,et al.  Stochastic Learning Networks and their Electronic Implementation , 1987, NIPS.

[7]  Alexander Moopenn,et al.  Electronic Implementation of Associative Memory Based on Neural Network Models , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  A. A. Abidi,et al.  An Analog CMOS Backward Error-propagation LSI , 1988, Twenty-Second Asilomar Conference on Signals, Systems and Computers.

[9]  S K Khanna,et al.  Electronic hardware implementations of neural networks. , 1987, Applied optics.

[10]  W. Guggenbuhl,et al.  A versatile building block: the CMOS differential difference amplifier , 1987 .