Adaptive Analog VLSI Neural Systems

Overview. Introduction to neural computing. MOS devices and circuits. Analogue VLSI building blocks. Kakadu - a micropower neural network. Supervised learning in an analog framework. A micropower intracardiac electrogram classifier. On-chip perturbation based learning. An analog memory technique. Switched capacitor techniques. A high speed image understanding system. A Boltzmann machine learning system. References. Index.

[1]  J. Shott,et al.  A 200 mV self-testing encoder/decoder using Stanford ultra-low-power CMOS , 1994, Proceedings of IEEE International Solid-State Circuits Conference - ISSCC '94.

[2]  Alan F. Murray.  Analogue noise-enhanced learning in neural network circuits , 1991 .

[3]  I. Z. Fisher.  MONTE CARLO METHOD IN STATISTICAL PHYSICS , 1959 .

[4]  Neil Weste,et al.  Principles of CMOS VLSI Design , 1985 .

[5]  M. A. Jabri,et al.  On the training of limited precision multi-layer perceptrons , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[6]  Y. Tsividis.  Operation and modeling of the MOS transistor , 1987 .

[7]  Philip H. W. Leong,et al.  VLSI implementation of neural networks with application to signal processing , 1991, 1991., IEEE International Sympoisum on Circuits and Systems.

[8]  S. Grossberg.  On learning and energy-entropy dependence in recurrent and nonrecurrent signed networks , 1969 .

[9]  Garrison W. Cottrell,et al.  Image compression by back-propagation: An example of extensional programming , 1988 .

[10]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[11]  R. Gregorian,et al.  Switched-capacitor circuit design , 1983, Proceedings of the IEEE.

[12]  Bernd-Peter Paris,et al.  Neural networks for multiuser detection in code-division multiple-access communications , 1992, IEEE Trans. Commun..

[13]  Jean-Didier Legat,et al.  Analog storage of adjustable synaptic weights , 1992, Defense, Security, and Sensing.

[14]  Takashi Morie,et al.  An all-analog expandable neural network LSI with on-chip backpropagation learning , 1994, IEEE J. Solid State Circuits.

[15]  Daniele D. Caviglia,et al.  Selfrefreshing analogue memory cell for variable synaptic weights , 1991 .

[16]  Malcolm R. Haskard,et al.  Analog VLSI design - nMOS and CMOS , 1988, Prentice Hall Silicon systems engineering series.

[17]  V. A. Pedroni.  Self-contained error-compensated N-valued memory for neural applications , 1994, Proceedings of the Fourth International Conference on Microelectronics for Neural Networks and Fuzzy Systems.

[18]  Yannis Tsividis,et al.  Design of Mos Vlsi Circuits for Telecommunications , 1985 .

[19]  H. T. Nguyen,et al.  A neural network implementation of an input access scheme in a high-speed packet switch , 1989, IEEE Global Telecommunications Conference, 1989, and Exhibition. 'Communications Technology for the 1990s and Beyond.

[20]  Marwan A. Jabri,et al.  Summed Weight Neuron Perturbation: An O(N) Improvement Over Weight Perturbation , 1992, NIPS.

[21]  Marwan A. Jabri,et al.  WATTLE: A Trainable Gain Analogue VLSI Neural Network , 1993, NIPS.

[22]  Hans Peter Graf,et al.  Address Block Location with a Neural Net System , 1993, NIPS.

[23]  S. Kirkpatrick,et al.  Infinite-ranged models of spin-glasses , 1978 .

[24]  T.X. Brown,et al.  Neural networks for switching , 1989, IEEE Communications Magazine.

[25]  A. Hiramatsu.  ATM communications network control by neural network , 1989, International 1989 Joint Conference on Neural Networks.

[26]  Jan Van der Spiegel,et al.  Design and Fabrication of VLSI Components for a General Purpose Analog Neural Computer , 1989, Analog VLSI Implementation of Neural Systems.

[27]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[28]  Robert B. Allen,et al.  Learning of stable states in stochastic asymmetric networks , 1990, IEEE Trans. Neural Networks.

[29]  M. Hoff,et al.  An analog input/output microprocessor for signal processing , 1979, 1979 IEEE International Solid-State Circuits Conference. Digest of Technical Papers.

[30]  Marwan A. Jabri,et al.  MUME — A Multi-Net Multi-Architecture Neural Simulation Environment , 1994 .

[31]  Eric A. Vittoz,et al.  Micropower Techniques , 1994 .

[32]  Marwan A. Jabri,et al.  Algorithmic and implementation issues in analog low power learning neural network chips , 1993, J. VLSI Signal Process..

[33]  Vincent Peiris.  Mixed analog digital VLSI implementation of a kohonen neural network , 1994 .

[34]  Randall L. Geiger,et al.  VLSI Design Techniques for Analog and Digital Circuits , 1989 .

[35]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[36]  C. N. Berglund.  Analog performance limitations of charge-transfer dynamic shift registers , 1971 .

[37]  C. N. Berglund,et al.  Incomplete transfer in charge-transfer devices , 1973 .

[38]  Yaser S. Abu-Mostafa,et al.  Hints and the VC Dimension , 1993, Neural Computation.

[39]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[40]  Robert B. Allen,et al.  Performance of a Stochastic Learning Microchip , 1990, NIPS.

[41]  Lawrence D. Jackel,et al.  VLSI implementation of a neural network memory with several hundreds of neurons , 1987 .

[42]  Alexander Moopenn,et al.  Digital-Analog Hybrid Synapse Chips for Electronic Neural Networks , 1989, NIPS.

[43]  A. Marrakchi,et al.  A neural net arbitrator for large crossbar packet-switches , 1989 .

[44]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[45]  B. Hochet,et al.  Multivalued MOS memory for variable-synapse neural networks , 1989 .

[46]  Robert B. Allen,et al.  Stochastic Learning Networks and their Electronic Implementation , 1987, NIPS.

[47]  D. Hammerstrom,et al.  Neural networks at work , 1993, IEEE Spectrum.

[48]  Philip Heng Wai Leong,et al.  Kakadu - A Low Power Analogue Neural Network Classifier , 1993, Int. J. Neural Syst..

[49]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[50]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[51]  Marwan A. Jabri,et al.  A low-power network for on-line diagnosis of heart patients , 1995, IEEE Micro.

[52]  John J. Paulos,et al.  The Effects of Precision Constraints in a Backpropagation Learning Network , 1990, Neural Computation.

[53]  Thomas Kailath,et al.  Model-free distributed learning , 1990, IEEE Trans. Neural Networks.

[54]  M. R. Sweet,et al.  Radiation exposure effects on the performance of an electrically trainable artificial neural network (ETANN) , 1993 .

[55]  Alan F. Murray,et al.  Analogue Neural Vlsi: A Pulse Stream Approach , 1994 .

[56]  Gert Cauwenberghs,et al.  A Fast Stochastic Error-Descent Algorithm for Supervised Learning and Optimization , 1992, NIPS.

[57]  Robert G. Meyer,et al.  Analysis and Design of Analog Integrated Circuits , 1993 .

[58]  Lionel Tarassenko,et al.  On-Chip Learning With Analogue Vlsi Neural Networks , 1993, Int. J. Neural Syst..

[59]  Yun Xie,et al.  Analysis of the effects of quantization in multilayer neural networks using a statistical model , 1992, IEEE Trans. Neural Networks.

[60]  D. Kunz,et al.  Channel assignment for cellular radio using neural networks , 1991 .

[61]  J. Orbach.  Principles of Neurodynamics. Perceptrons and the Theory of Brain Mechanisms. , 1962 .

[62]  S. Grossberg.  Contour Enhancement , Short Term Memory , and Constancies in Reverberating Neural Networks , 1973 .

[63]  Bernard Widrow,et al.  30 years of adaptive neural networks: perceptron, Madaline, and backpropagation , 1990, Proc. IEEE.

[64]  Teuvo Kohonen,et al.  Associative memory. A system-theoretical approach , 1977 .

[65]  Philip H. W. Leong,et al.  MATIC—An Intracardiac Tachycardia Classification System , 1992, Pacing and clinical electrophysiology : PACE.

[66]  A. S. Grove.  Physics and Technology of Semiconductor Devices , 1967 .

[67]  H.P. Graf,et al.  A reconfigurable CMOS neural network , 1990, 1990 37th IEEE International Conference on Solid-State Circuits.

[68]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[69]  G. J. Gibson,et al.  Adaptive channel equaliza-tion using a polynomial-perceptron structure , 1990 .

[71]  Gert Cauwenberghs.  Analog VLSI autonomous systems for learning and optimization , 1994 .

[72]  Tj Sejnowski,et al.  Skeleton filters in the brain , 2014 .

[73]  Simon M. Tam,et al.  Implementation and performance of an analog nonvolatile neural network , 1993 .

[74]  Janice M. Jenkins,et al.  Identification of ventricular tachycardia using morphologic analysis of the intraventricular electrogram , 1988 .

[75]  Marwan A. Jabri,et al.  A hybrid analog and digital VLSI neural network for intracardiac morphology classification , 1995 .

[76]  Ron Meir,et al.  A Parallel Gradient Descent Method for Learning in Analog VLSI Neural Networks , 1992, NIPS.

[77]  Robert B. Allen,et al.  Relaxation Networks for Large Supervised Learning Problems , 1990, NIPS.

[78]  James D. Lyle.  SBus: Information, Applications, and Experience , 1992 .

[79]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[80]  Gert Cauwenberghs.  A Learning Analog Neural Network Chip with Continuous-Time Recurrent Dynamics , 1993, NIPS.