From SAB90 to SAB94: four years of animat research

This paper builds on a previous review of significant research on adaptive behavior in animats. It summarizes the current state of the art and suggests some directions likely to provide interesting results in the near future.

[1]  Stewart W. Wilson.  The animat path to AI , 1991 .

[2]  Gerhard Manteuffel.  A biological visuo-motor system: how dissimilar maps interact to produce behavior , 1991 .

[3]  Hillel J. Chiel,et al.  The neural basis of behavioral choice in an artificial insect , 1991 .

[4]  Stewart W. Wilson,et al.  Robot Ethology: A Proposal for the Research into Intelligent Autonomous Systems , 1991 .

[5]  John R. Koza,et al.  Evolution and co-evolution of computer programs to control independently-acting agents , 1991 .

[6]  Cynthia Kurtz.  The evolution of information gathering: operational constraints , 1991 .

[7]  Jan Paredis,et al.  The evolution of behavior: some experiments , 1991 .

[8]  J. R. P. Halperin,et al.  Machine motivation , 1991 .

[9]  Stewart W. Wilson,et al.  Schemas for Prey-Catching in Frog and Toad , 1991 .

[10]  Stewart W. Wilson,et al.  A Possibility for Implementing Curiosity and Boredom in Model-Building Neural Controllers , 1991 .

[11]  Stewart W. Wilson,et al.  The Causal Analysis of an Adaptive System: Sex-Ratio Decisions as Observed in a Parasitic Wasp and Simulated by a Network Model , 1991 .

[12]  Dave Cliff,et al.  The computational hoverfly; a study in computational neuroethology , 1991 .

[13]  Ulrich Nehmzow,et al.  Mapbuilding using self-organising networks in “really useful robots” , 1991 .

[14]  H. L. Roitblat,et al.  Cognitive action theory as a control architecture , 1991 .

[15]  Pattie Maes,et al.  A bottom-up mechanism for behavior selection in an artificial creature , 1991 .

[16]  David R. Jefferson,et al.  Representations for artificial organisms , 1991 .

[17]  Richard S. Sutton,et al.  Reinforcement learning architectures for animats , 1991 .

[18]  Jean-Arcady Meyer,et al.  Simulation of adaptive behavior in animats: review and prospect , 1991 .

[19]  Luc Steels,et al.  Towards a theory of emergent functionality , 1991 .

[20]  Jean-Louis Deneubourg,et al.  The dynamics of collective sorting robot-like ants and ant-like robots , 1991 .

[21]  Peter M. Todd,et al.  Exploring adaptive agency II: simulating the evolution of associative learning , 1991 .

[22]  Rodney A. Brooks,et al.  Challenges for complete creature architectures , 1991 .

[23]  Vittorio Maniezzo,et al.  The rise of interaction: intrinsic simulation modeling of the onset of interacting behaviour , 1991 .

[24]  Michael A. Arbib,et al.  Hierarchical dishabituation of visual discrimination in toads , 1991 .

[25]  George Kiss,et al.  Autonomous agents, AI and chaos theory , 1991 .

[26]  Benjamin Kuipers,et al.  Learning hill-climbing functions as a strategy for generating behaviors in a mobile robot , 1991 .

[27]  Long-Ji Lin,et al.  Self-improving reactive agents: case studies of reinforcement learning frameworks , 1991 .

[28]  Maja J. Matarić,et al.  Navigating with a rat brain: a neurobiologically-inspired model for robot spatial representation , 1991 .

[29]  John E. W. Mayhew,et al.  Computer simulation of an animal environment , 1991 .

[30]  Holk Cruse.  Coordination of leg movement in walking animals , 1991 .

[31]  F. Toates,et al.  Ethological and psychological models of motivation-towards a synthesis , 1991 .

[32]  Wai K. Yeap,et al.  Four important issues in cognitive mapping , 1991 .

[33]  Guy Theraulaz,et al.  Task differentiation in Polistes wasp colonies: a model for self-organizing groups of robots , 1991 .

[34]  Jean-Arcady Meyer,et al.  Biomimetic Sonar Processing: From Dolphin Echolocation to Artificial Neural Networks , 1991 .

[35]  Jean-Arcady Meyer,et al.  Lookahead Planning and Latent Learning in a Classifier System , 1991 .

[36]  Jean-Arcady Meyer,et al.  Eight Principles for Building an Intelligent Robot , 1991 .

[37]  Lashon B. Booker,et al.  Instinct as an inductive bias for learning behavioral sequences , 1991 .

[38]  Claus Ronald. Kube,et al.  Collective robotic intelligence , 1992 .

[39]  William R. Uttal,et al.  The Swimmer: An Integrated Computational Model of a Perceptual-Motor System , 1992 .

[40]  Inman Harvey,et al.  Issues in evolutionary robotics , 1993 .

[41]  John E. W. Mayhew,et al.  Building Long-range Cognitive Maps using Local Landmarks , 1993 .

[42]  Ronald C. Arkin,et al.  Dimensions of communication and social organization in multi-agent robotic systems , 1993 .

[43]  Eugénio Oliveira,et al.  Dynamic selection of action sequences , 1993 .

[44]  Tom M. Mitchell,et al.  Reinforcement learning with hidden states , 1993 .

[45]  Pattie Maes,et al.  Behavior-based artificial intelligence , 1993 .

[46]  Michael L. Littman,et al.  An optimization-based categorization of reinforcement learning environments , 1993 .

[47]  Marco Colombetti,et al.  Learning to control an autonomous robot by distributed genetic algorithms , 1993 .

[48]  Stewart W. Wilson,et al.  Environment structure and adaptive behavior from the ground up , 1993 .

[49]  Franz Oppacher,et al.  An evolutionary approach to cognition , 1993 .

[50]  Inman Harvey,et al.  Evolving visually guided robots , 1993 .

[51]  Ralph Hartley.  Propulsion and guidance in a simulation of the worm , 1993 .

[52]  A. Harry Klopf,et al.  Extensions of the associative control process (ACP) network: hierarchies and provable optimality , 1993 .

[53]  Sunil Cherian,et al.  A neural network based behavior hierarchy for locomotion control , 1993 .

[54]  Hugh T. Blair,et al.  Dynamics of spatial navigation: an adaptive neural network , 1993 .

[55]  Madan M. Gupta,et al.  A distributed adaptive control system for a quadruped mobile robot , 1993, IEEE International Conference on Neural Networks.

[56]  Jürgen Schmidhuber,et al.  Planning simple trajectories using neural subgoal generators , 1993 .

[57]  Holly A. Yanco,et al.  An adaptive communication protocol for cooperating mobile robots , 1993 .

[58]  Patrick W. Moore,et al.  Representation and processing of acoustic information in a biomimetic neural network , 1993 .

[59]  Toby Tyrell,et al.  The use of hierarchies for action selection , 1993 .

[60]  Domenico Parisi,et al.  Neural networks with motivational units , 1993 .

[61]  Craig W. Reynolds.  An evolved, vision-based behavioral model of coordinated group motion , 1993 .

[62]  John E. R. Staddon.  A note on rate-sensitive habituation , 1993 .

[63]  Ian Horswill.  A simple, cheap, and robust visual navigation system , 1993 .

[64]  Maja J. Matarić,et al.  Designing emergent behaviors: from local interactions to collective intelligence , 1993 .

[65]  Frank Weber,et al.  Implementing inner drive through competence reflection , 1993 .

[66]  Thomas Ulrich Vogel.  Learning biped robot obstacle crossing , 1993 .

[67]  David Kortenkamp,et al.  A directional spreading activation network for mobile robot navigation , 1993 .

[68]  Jonas Karlsson,et al.  Learning via task decomposition , 1993 .

[69]  Lynne E. Parker,et al.  Adaptive action selection for cooperative agent teams , 1993 .

[70]  Dario Floreano.  Emergence of nest-based foraging strategies in ecosystems of neural networks , 1993 .

[71]  Randall D. Beer,et al.  A qualitative dynamical analysis of evolved locomotion controllers , 1993 .

[72]  Jeffrey Dean,et al.  Artificial neural nets for controlling a 6-legged walking system , 1993 .

[73]  Simon Giszter.  Behavior networks and force fields for simulation spinal reflex behaviors of the frog , 1993 .

[74]  J. Peng,et al.  Efficient Learning and Planning Within the Dyna Framework , 1993, IEEE International Conference on Neural Networks.

[75]  Paul F. M. J. Verschure,et al.  Categorization, representations, and the dynamics of system-environment interaction: a case study in autonomous systems , 1993 .

[76]  Gerhard Weiß,et al.  Action selection and learning in multi-agent environments , 1993, Forschungsberichte, TU Munich.

[77]  Jacques Ferber,et al.  From Tom Thumb to the Dockers: some experiments with foraging robots , 1993 .

[78]  A. Harry Klopf,et al.  Modeling nervous system function with a hierarchical network of control systems that learn , 1993 .

[79]  Paul F. M. J. Verschure,et al.  Designing efficiently navigating non-goal-directed robots , 1993 .

[80]  Michael A. Arbib,et al.  Anuran visuomotor coordination for detour behavior: from retina to motor schemas , 1993 .

[81]  Robert E. Smith,et al.  Evolving artificial insect brains for artificial compound eye robotics , 1993 .

[82]  Michael G. Dyer,et al.  Evolution of herding behavior in artificial animals , 1993 .

[83]  Stewart W. Wilson,et al.  The blind breeding the blind: adaptive behavior without looking , 1994 .

[84]  Toshio Fukuda,et al.  Two-link-robot brachiation with connectionist Q-learning , 1994 .

[85]  Hugues Bersini.  Reinforcement learning for homeostatic endogenous variables , 1994 .

[86]  J. Roughgarden,et al.  The effect of memory length on the foraging behavior of a lizard , 1994 .

[87]  Philippe Gaussier,et al.  A topological neural map for on-line learning: emergence of obstacle avoidance in a mobile robot , 1994 .

[88]  William D. Smart,et al.  Location recognition in rats and robots , 1994 .

[89]  Craig W. Reynolds.  Evolution of corridor following behavior in a noisy world , 1994 .

[90]  Luc Steels,et al.  A case study in the behavior-oriented design of autonomous agents , 1994 .

[91]  Dave Cliff,et al.  Protean behavior in dynamic games: arguments for the co-evolution of pursuit-evasion tactics , 1994 .

[92]  Francesco Mondada,et al.  Automatic creation of an autonomous agent: genetic evolution of a neural-network driven robot , 1994 .

[93]  Wayne M. Getz,et al.  Insect vision and olfaction: different neural architectures for different kinds of sensory signal? , 1994 .

[94]  D. Cliff.  From animals to animats 3 : proceedings of the Third International Conference on Simulation of Adaptive Behavior , 1994 .

[95]  Bruce Blumberg,et al.  Action-selection in hamsterdam: lessons from ethology , 1994 .

[96]  Michael L. Littman,et al.  Memoryless policies: theoretical limitations and practical results , 1994 .

[97]  Leonard N. Foner,et al.  Paying Attention to What's Important: Using Focus of Attention to Improve Unsupervised Learning , 1994 .

[98]  Ronald C. Arkin,et al.  Integration of reactive and telerobotic control in multi-agent robotic systems , 1994 .

[99]  Barbara Webb,et al.  Robotic experiments in cricket phonotaxis , 1994 .

[100]  Randall D. Beer,et al.  Integrating reactive, sequential, and learning behavior using dynamical neural networks , 1994 .

[101]  Michael K. Sahota.  Action selection for robots in dynamic environments through inter-behaviour bidding , 1994 .

[102]  Simon Giszter.  Reinforcement tuning of action synthesis and selection in a “virtual frog” , 1994 .

[103]  Tony J. Prescott,et al.  Spatial learning and representation in animats , 1994 .

[104]  Ashley M. Aitken,et al.  An architecture for learning to behave , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[105]  Gilles Venturini,et al.  Adaptation in dynamic environments through a minimal probability of exploration , 1994 .

[106]  Tom Scutt.  The five neuron trick: using classical conditioning to learn how to seek light , 1994 .

[107]  Jean-Jacques E. Slotine,et al.  Stability in adaptation and learning , 1994 .

[108]  Rémi Munos,et al.  Reinforcement learning with dynamic covering of state-action space: partitioning Q-learning , 1994 .

[109]  Stéphane Bura,et al.  MINIMEME: of life and death in the noosphere , 1994 .

[110]  Gregory M. Werner,et al.  Using second order neural connections for motivation of behavioral choices , 1994 .

[111]  Jean-Arcady Meyer,et al.  A hierarchical classifier system implementing a motivationally autonomous animat , 1994 .

[112]  Nestor A. Schmajuk,et al.  Behavioral dynamics of escape and avoidance: a neural network approach , 1994 .

[113]  John F. Kolen,et al.  The importance of leaky levels for behavior-based AI , 1994 .

[114]  M. Matarić.  Learning to Behave Socially , 1994 .

[115]  Pietro Morasso,et al.  Self-organizing topographic maps and motor planning , 1994 .

[116]  Anthony G. Pipe,et al.  A hybrid architecture for learning continuous environmental models in maze problems , 1994 .

[117]  Herbert L. Roitblat,et al.  Mechanism and process in animal behavior: models of animals, animals as models , 1994 .

[118]  Fabrizio Mura,et al.  Visual control of altitude and speed in a flying agent , 1994 .

[119]  William Chesters,et al.  Connectionist environment modelling in a real robot , 1994 .

[120]  Peter de Bourcier,et al.  Signalling and territorial aggression: an investigation by means of synthetic behavioral ecology , 1994 .

[121]  Rodney A. Brooks,et al.  Coherent behavior from many adaptive processes , 1994 .

[122]  Patrick R. Green.  How to watch your step: biological evidence and an initial model , 1994 .

[123]  Ulrich Nehmzow,et al.  Achieving rapid adaptations in robots by means of external tuition , 1994 .

[124]  P. Grobstein.  From Animals to Animats 2: Proceedings of the Second International Conference on Simulation of Adaptive Behavior , 1994 .

[125]  Frederick Toates.  What is cognitive and what is not cognitive , 1994 .

[126]  Simon Benhamou,et al.  A place navigation algorithm based on elementary computing procedures and associative memories , 1994 .

[127]  Masao Kubo,et al.  Learning coordinated motions in a competition for food between ant colonies , 1994 .

[128]  P. Husbands,et al.  Seeing the Light: Artiicial Evolution, Real Vision Seeing the Light: Artiicial Evolution, Real Vision , 1994 .

[129]  Michael A. Arbib,et al.  Modeling the role of cerebellum in prism adaptation , 1994 .

[130]  Stanley J. Rosenschein,et al.  From Animals to Animats: Proceedings of the First International Conference on Simulation of Adaptive Behavior , 1996 .

[131]  Liane Gabora,et al.  Should I Stay or Should I Go: Coordinating Biological Needs with Continuously-updated Assessments of the Environment , 1993, ArXiv.