Exploration, Navigation and Cognitive Mapping

We present a modified version of Schmajuk and Thieme's (1992) neural network model of spatial navigation. The new model differs from the original in several ways. First, whereas the early model assumed no a priori knowledge of the space to be explored, the present model assumes a repre sentation of the environment as a set of potentially connected locations. Second, whereas in the original model the decision as to what place to move to next is based on the comparison of the predictions of the goal when each of the alternative places is briefly entered; in the present paper this decision is based on the comparison of the activation of each of the alternative places when the goal is activated. Computer simulations show that the present network offers a novel descrip tion of latent learning in terms of the competition between exploration and exploitation.

[1]  Jian Wu,et al.  Models for map building and navigation , 1993, IEEE Trans. Syst. Man Cybern..

[2]  Jean-Arcady Meyer,et al.  BIOLOGICALLY BASED ARTIFICIAL NAVIGATION SYSTEMS: REVIEW AND PROSPECTS , 1997, Progress in Neurobiology.

[3]  Sara J. Shettleworth,et al.  Time horizons of pigeons on a two-armed bandit , 1989, Animal Behaviour.

[4]  J S Taube,et al.  Head Direction Cells in Rats with Hippocampal or Overlying Neocortical Lesions: Evidence for Impaired Angular Path Integration , 1999, The Journal of Neuroscience.

[5]  R. Bolles,et al.  Effect of Hunger on Exploration in a Familiar Locale , 1962 .

[6]  Nestor A. Schmajuk,et al.  Place Learning and the Dynamics of Spatial Navigation: A Neural Network Approach , 1993, Adapt. Behav..

[7]  Booncharoen Sirinaovakul,et al.  Introduction to the Special Issue , 2002, Comput. Intell..

[8]  Nestor A. Schmajuk,et al.  Three-dimensional cognitive mapping with a neural network , 2001, Robotics Auton. Syst..

[9]  D. Kramer,et al.  Exploration versus exploitation: a field study of time allocation to environmental tracking by foraging chipmunks , 1991, Animal Behaviour.

[10]  J. Staddon,et al.  A Dynamic Route Finder for the Cognitive Map , 1998 .

[11]  David W. Payton,et al.  Intelligent real-time control of robotic vehicles , 1991, CACM.

[12]  Neil C. Rowe,et al.  Finding Optimal-Path Maps for Path Planning across Weighted Regions , 2000, Int. J. Robotics Res..

[13]  F. W. Irwin.  Purposive Behavior in Animals and Men , 1932, The Psychological Clinic.

[14]  D. Berlyne.  NOVELTY AND CURIOSITY AS DETERMINANTS OF EXPLORATORY BEHAVIOUR1 , 1950 .

[15]  J. Deutsch.  The structural basis of behavior , 1960 .

[16]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[17]  H T Blair,et al.  Maps, routes, and the hippocampus: A neural network approach , 1993, Hippocampus.

[18]  N. Miller,et al.  Facilitation of exploration by hunger in rats. , 1958, Journal of comparative and physiological psychology.

[19]  L. Nadel,et al.  The Hippocampus as a Cognitive Map , 1978 .

[20]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[21]  E. Fehrer,et al.  The effects on hunger and familiarity of locale on exploration. , 1956, Journal of comparative and physiological psychology.

[22]  David Kortenkamp,et al.  A directional spreading activation network for mobile robot navigation , 1993 .

[23]  David W. Payton,et al.  Internalized plans: A representation for action resources , 1990, Robotics Auton. Syst..

[24]  H. Blodgett,et al.  The effect of the introduction of reward upon the maze performance of rats , 1929 .

[25]  J. Borenstein.  Internal Correction of Dead-reckoning Errors With a Dual-drive Compliant Linkage Mobile Robot , 1995 .

[26]  David W. Payton,et al.  Multilevel Path Planning For Autonomous Vehicles , 1984, Other Conferences.

[27]  James R. Levenick.  NAPS: a Connectionist Implementation of Cognitive Maps , 1991 .

[28]  Maja J. Matarić,et al.  Navigating with a rat brain: a neurobiologically-inspired model for robot spatial representation , 1991 .

[29]  Johann Borenstein,et al.  Intemal correction of dead-reckoning errors with a dual-drive compliant linkage mobil robot , 1995, J. Field Robotics.

[30]  D. Zipser.  A computational model of hippocampal place fields. , 1985, Behavioral neuroscience.

[31]  N. Schmajuk.  Role of the hippocampus in temporal and spatial navigation An adaptive neural network , 1990, Behavioural Brain Research.

[32]  Nestor A. Schmajuk,et al.  Escape, Avoidance, and Imitation: A Neural Network Approach , 1997, Adapt. Behav..

[33]  Alan C. Schultz,et al.  Integrating Exploration, Localization, Navigation and Planning with a Common Representation , 1999, Auton. Robots.

[34]  G. Strang,et al.  Linear Algebra, Geodesy, and GPS , 1997 .