Analog Neural Networks in Autonomous Systems

iii Summary Signal processing in animals is characterized by high parallelism, robustness, adaptivity and low power consumption, which results in a superior performance in sensory motor control tasks compared to artiicial systems. The analog neural network approach tries to come closer to the original than other artiicial systems by exploiting the underlying hardware's physical properties rather than avoiding most of them. However, learning analog neural networks used so far did not yet result in too many practical applications, because the artiicial neural networks mainly in use rely on a numerical accuracy that is typically not provided by analog hardware implementations. Natural nervous systems demonstrate high robustness, as required for an analog hardware implementation. Hence, a deeper understanding of`hardware-friendly' learning principles may enable the construction of artiicial systems that share more of a natural sys-tem's properties than they do today. This thesis provides new results on how diierent principles of animal learning can be performed employing a simple Hebbian learning rule and short-term dynamics. A combination of classical and operant conditioning was implemented in neural networks comprising neuromimetic analog hardware circuits controlling a physical mobile robot. These networks enabled the robot to learn local maneuvers, in which forward and backward movements were combined. A variety of further networks is introduced performing visual preprocessing, adaptive feedback, adaptive timed responses, parallel learning at diierent rates and other tasks. The robustness of this approach is demonstrated by the innuence of hardware failures and mismatches of, e.g., sensor preprocessing. Analytical considerations reveal similarities to other learning methods and clarify network properties. A key issue is the stability of the resulting behavior. A physical system controlled by learning hardware with several plastic elements was not demonstrated before. Moreover, a new neural network approach to adaptive self-localization is introduced, which enables a mobile robot to enhance its position estimation in an adaptive way. An analytical convergence result, performance in a simulated environment and, to a minor extent, tests in physical robots are reported. Consequences of the work presented here and future aspects of analog neural networks are outlined in a concluding chapter. Netze werden in einem abschlieeenden Kapitel zusammengefaat.

[1]  J.M. Zurada,et al.  Analog implementation of neural networks , 1992, IEEE Circuits and Devices Magazine.

[2]  W. Walter A Machine that Learns , 1951 .

[3]  Rodney A. Brooks Autonomous mobile robots , 1990 .

[4]  John Hallam,et al.  Really Useful Robots , 1989, IAS.

[5]  Klaus Landzettel,et al.  Multisensory Shared Autonomy - A Key Issue In The Space Robot Technology Experiment ROTEX , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  James A. Anderson,et al.  Neurocomputing: Foundations of Research , 1988 .

[7]  C. Schneider,et al.  Analog CMOS synaptic learning circuits adapted from invertebrate biology , 1991 .

[8]  J. O’Keefe A review of the hippocampal place cells , 1979, Progress in Neurobiology.

[9]  N. Schmajuk,et al.  A neural network approach to hippocampal function in classical conditioning. , 1991, Behavioral neuroscience.

[10]  Lex A. Akers,et al.  An adaptive neural processing node , 1993, IEEE Trans. Neural Networks.

[11]  N. Mackintosh A Theory of Attention: Variations in the Associability of Stimuli with Reinforcement , 1975 .

[12]  Misha A. Mahowald,et al.  An Analog VLSI System for Stereoscopic Vision , 1994 .

[13]  Misha Mahowald,et al.  A silicon model of early visual processing , 1993, Neural Networks.

[14]  Karl Goser,et al.  Robot Learning in Analog Neural Hardware , 1996, ICANN.

[15]  T. Sejnowski,et al.  Associative long-term depression in the hippocampus induced by hebbian covariance , 1989, Nature.

[16]  L. Squire "Memory and the hippocampus: A synthesis from findings with rats, monkeys, and humans": Correction. , 1992 .

[17]  B Sakmann,et al.  Detailed passive cable models of whole-cell recorded CA3 pyramidal neurons in rat hippocampal slices , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  Jerzy B. Lont Analog CMOS implementation of a multi-layer perceptron with nonlinear synapses , 1992, IEEE Trans. Neural Networks.

[19]  Howard C. Card,et al.  Is VLSI neural learning robust against circuit limitations? , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[20]  Ulrich Nehmzow,et al.  Experiments in Competence Acquisition for Autonomous Mobile Robots , 1992 .

[21]  Y. Takefuji,et al.  Analog components for the VLSI of neural networks , 1990, IEEE Circuits and Devices Magazine.

[22]  Sridhar Mahadevan,et al.  Scaling Reinforcement Learning to Robotics by Exploiting the Subsumption Architecture , 1991, ML.

[23]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[24]  D. Willshaw,et al.  Must what goes up come down? , 1989, Nature.

[25]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.

[26]  Rodney A. Brooks,et al.  Achieving Artificial Intelligence through Building Robots , 1986 .

[27]  Paul Hasler,et al.  Circuit implementation of a trainable neural network using the generalized Hebbian algorithm with supervised techniques , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[28]  Randal C. Nelson,et al.  Using Flow Field Divergence For Obstacle Avoidance: Towards Qualitative Vision , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[29]  N. Franceschini,et al.  From insect vision to robot vision , 1992 .

[30]  S. Grossberg A neural model of attention, reinforcement and discrimination learning. , 1975, International review of neurobiology.

[31]  R. F. Thompson,et al.  Neural mechanisms of classical conditioning in mammals. , 1990, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[32]  K. Goser,et al.  Implementation of a biologically inspired neuron-model in FPGA , 1996, Proceedings of Fifth International Conference on Microelectronics for Neural Networks.

[33]  C. Mead,et al.  Neuromorphic analogue VLSI. , 1995, Annual review of neuroscience.

[34]  Leonardo Maria Reyneri,et al.  An Analysis on the Performance of Silicon Implementations of Backpropagation Algorithms for Artificial Neural Networks , 1991, IEEE Trans. Computers.

[35]  Lloyd W. Massengill,et al.  An analog neural hardware implementation using charge-injection multipliers and neutron-specific gain control , 1992, IEEE Trans. Neural Networks.

[36]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[37]  Bernabé Linares-Barranco,et al.  A real-time clustering microchip neural engine , 1996, IEEE Trans. Very Large Scale Integr. Syst..

[38]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[39]  J W Donahoe,et al.  A selectionist approach to reinforcement. , 1993, Journal of the experimental analysis of behavior.

[40]  Paul E. Hasler,et al.  Single Transistor Learning Synapses , 1994, NIPS.

[41]  Stephen Grossberg,et al.  A neural model of timed response learning in the cerebellum , 1994, Neural Networks.

[42]  D. McFarland,et al.  Animal robotics-from self-sufficiency to autonomy , 1994, Proceedings of PerAc '94. From Perception to Action.

[43]  Tomaso Poggio,et al.  Optical flow: computational properties and networks, biological and analog , 1989 .

[44]  Allen M. Waxman,et al.  Mobile robot visual mapping and localization: A view-based neurocomputational architecture that emulates hippocampal place learning , 1994, Neural Networks.

[45]  Douglas A. Baxter,et al.  A learning rule based on empirically-derived activity-dependent neuromodulation supports operant conditioning in a small network , 1992, Neural Networks.

[46]  Jun Tani Essential Dynamical Structure in Learnable Autonomous Robots , 1995, ECAL.

[47]  Tim Smithersy Mapbuilding Using Self-organising Networks in \really Useful Robots" , 1991 .

[48]  Y. Frégnac,et al.  Temporal covariance of postsynaptic membrane potential and synaptic input--role in synaptic efficacy in visual cortex. , 1993, Progress in brain research.

[49]  R. Kesner,et al.  Memory for spatial location: Functional dissociation of entorhinal cortex and hippocampus , 1994, Psychobiology.

[50]  Maja J. Matarić,et al.  Navigating with a rat brain: a neurobiologically-inspired model for robot spatial representation , 1991 .

[51]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[52]  Ulrich Nehmzow,et al.  Autonomous Acquisition of Sensor-Motor Couplings in Robots , 1994 .

[53]  L. Squire Memory and the hippocampus: a synthesis from findings with rats, monkeys, and humans. , 1992, Psychological review.

[54]  T. Serrano,et al.  A CMOS VLSI analog current-mode high-speed ART1 chip , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[55]  Benjamin Kuipers,et al.  A robot exploration and mapping strategy based on a semantic hierarchy of spatial representations , 1991, Robotics Auton. Syst..

[56]  E. A. Vittoz,et al.  Analog VLSI hardware: what is missing for industrial realisations? , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[57]  Karl Goser,et al.  Exponential Hebbian On-Line Learning Implemented in FPGAs , 1996, ICANN.

[58]  Andreas B,et al.  An Approach to Adaptive Self-LocalizationAndreas B uhlmeier , 2022 .

[59]  I N Bronstein,et al.  Taschenbuch der Mathematik , 1966 .

[60]  Allen M. Waxman,et al.  Visual learning, adaptive expectations, and behavioral conditioning of the mobile robot MAVIN , 1991, Neural Networks.

[61]  Shigeo Abe,et al.  Neural Networks and Fuzzy Systems , 1996, Springer US.

[62]  Ben J. A. Kröse,et al.  Learning from delayed rewards , 1995, Robotics Auton. Syst..

[63]  Michael Georgiopoulos,et al.  Analogue circuit design and implementation of an adaptive resonance theory (ART) neural network architecture , 1994 .

[64]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[65]  James S. Morgan,et al.  A Hierarchical Network of Control Systems that Learn: Modeling Nervous System Function During Classical and Instrumental Conditioning , 1993, Adapt. Behav..

[66]  Analog neural networks and behavior based robotics , 1995 .

[67]  Ben J. A. Kröse,et al.  Distributed adaptive control: The self-organization of structured behavior , 1992, Robotics Auton. Syst..

[68]  L.D. Jackel,et al.  Analog electronic neural network circuits , 1989, IEEE Circuits and Devices Magazine.

[69]  S. Grossberg,et al.  Neural dynamics of attentionally modulated Pavlovian conditioning: Conditioned reinforcement, inhibition, and opponent processing , 1987, Psychobiology.

[70]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[71]  David P. M. Northmore,et al.  Switched-capacitor neuromorphs with wide-range variable dynamics , 1995, IEEE Trans. Neural Networks.

[72]  Mark R. DeYong,et al.  The design, fabrication, and test of a new VLSI hybrid analog-digital neural processing element , 1992, IEEE Trans. Neural Networks.

[73]  E. Fiesler,et al.  Hardware-friendly learning algorithms for neural networks: an overview , 1996, Proceedings of Fifth International Conference on Microelectronics for Neural Networks.

[74]  S. Amari Topographic organization of nerve fields , 1979, Neuroscience Letters.

[75]  Christoph Herwig,et al.  Visual motion processing for active observers , 1996 .

[76]  Christof Koch,et al.  Vision Chips: Implementing Vision Algorithms with Analog VLSI Circuits , 1994 .

[77]  H. Withagen,et al.  Implementing backpropagation with analog hardware , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[78]  Michel Declercq,et al.  Implementation of a learning Kohonen neuron based on a new multilevel storage technique , 1991 .

[79]  R. Douglas,et al.  A silicon neuron , 1991, Nature.

[80]  D A Durfee,et al.  Comparison of floating gate neural network memory cells in standard VLSI CMOS technology , 1992, IEEE Trans. Neural Networks.

[81]  Alan F. Murray,et al.  Analogue Neural Vlsi: A Pulse Stream Approach , 1994 .

[82]  S. Grossberg,et al.  A neural network model of adaptively timed reinforcement learning and hippocampal dynamics. , 1992, Brain research. Cognitive brain research.

[83]  Andreas Buhlmeier,et al.  Remote Control of Mobile Robot via Internet , 1996 .

[84]  A. F. Murray Silicon implementation of neural networks , 1991 .

[85]  W. Singer,et al.  Long-term depression of excitatory synaptic transmission and its relationship to long-term potentiation , 1993, Trends in Neurosciences.

[86]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.