What is a cognitive map? Unravelling its mystery using robots

Despite years of research into cognitive mapping, the process remains controversial and little understood. A computational theory of cognitive mapping is needed, but developing it is difficult due to the lack of a clear interpretation of the empirical findings. For example, without knowing what a cognitive map is or how landmarks are defined, how does one develop a computational theory for it? We thus face the conundrum of trying to develop a theory without knowing what is computed. In this paper, we overcome the conundrum by abandoning the idea that the process begins by integrating successive views to form a global map of the environment experienced. Instead, we argue that cognitive mapping begins by remembering views as local maps and we empower a mobile robot with the process and study its behaviour as it acquires its “cognitive map”. Our results show that what is computed initially could be described as a “route” map and from it, some form of a “survey map” can be computed. The latter, as it turns out, bears much of the characteristics of a cognitive map. Based on our findings, we discuss what a cognitive map is, how cognitive mapping evolves and why such a process also supports the perception of a stable world.

[1]  A. Etienne,et al.  Role of dead reckoning in navigation , 1998 .

[2]  Tobias Meilinger,et al.  Putting Egocentric and Allocentric into Perspective , 2010, Spatial Cognition.

[3]  R. Menzel,et al.  Two spatial memories for honeybee navigation , 2000, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[4]  Barbara Tversky,et al.  Cognitive Maps, Cognitive Collages, and Spatial Mental Models , 1993, COSIT.

[5]  Timothy P. McNamara,et al.  Updating in Models of Spatial Memory , 2006, Spatial Cognition.

[6]  N. Newcombe,et al.  Is there a geometric module for spatial orientation? squaring theory and evidence , 2005, Psychonomic bulletin & review.

[7]  Daniel R. Montello,et al.  The Perception and Cognition of Environmental Distance: Direct Sources of Information , 1997, COSIT.

[8]  Bernhard Schölkopf,et al.  View-Based Cognitive Mapping and Path Planning , 1995, Adapt. Behav..

[9]  Wolfram Burgard,et al.  Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters , 2007, IEEE Transactions on Robotics.

[10]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[11]  Ronald A. Rensink,et al.  Change blindness: past, present, and future , 2005, Trends in Cognitive Sciences.

[12]  Ken Cheng,et al.  Whither geometry? Troubles of the geometric module , 2008, Trends in Cognitive Sciences.

[13]  Andrew Crompton,et al.  Perceived Distance in the City as a Function of Time , 2006 .

[14]  D. R. Montello A New Framework for Understanding the Acquisition of Spatial Knowledge in Large-Scale Environments , 1998 .

[15]  Ken Cheng,et al.  25 years of research on the use of geometry in spatial reorientation: a current theoretical perspective , 2013, Psychonomic Bulletin & Review.

[16]  Paul Graham,et al.  View-based navigation in insects: how wood ants (Formica rufa L.) look at and are guided by extended landmarks. , 2002, The Journal of experimental biology.

[17]  B. Bridgeman,et al.  Landmarks facilitate visual space constancy across saccades and during fixation , 2010, Vision Research.

[18]  H. Wallach Perceiving a stable environment when one moves. , 1987, Annual review of psychology.

[19]  Paul Graham,et al.  View-based matching can be more than image matching: The importance of considering an animal's perspective , 2012, i-Perception.

[20]  Wai-Kiang Yeap,et al.  On Egocentric and Allocentric Maps , 2014, Spatial Cognition.

[21]  B. A. Cartwright,et al.  How honey bees use landmarks to guide their return to a food source , 1982, Nature.

[22]  Barbara Hayes-Roth,et al.  Differences in spatial knowledge acquired from maps and navigation , 1982, Cognitive Psychology.

[23]  A. Bennett,et al.  Do animals have cognitive maps? , 1996, The Journal of experimental biology.

[24]  F. N. Shemyakin General problems of orientation in space and space representations , 1962 .

[25]  SIMON BENHAMOU,et al.  No evidence for cognitive mapping in rats , 1996, Animal Behaviour.

[26]  J. O'Regan,et al.  Solving the "real" mysteries of visual perception: the world as an outside memory. , 1992, Canadian journal of psychology.

[27]  Vicki G. Morwitz,et al.  Spatial categorization and time perception: Why does it take less time to get home? , 2011 .

[28]  Wolfram Burgard,et al.  Robust Monte Carlo localization for mobile robots , 2001, Artif. Intell..

[29]  M. Jeanne Sholl,et al.  The Role of a Self-Reference System in Spatial Navigation , 2001, COSIT.

[30]  D. Wood,et al.  Cognitive Transformation of Information from Urban Geographic Fields to Mental Maps , 1976 .

[31]  Eric Mandelbaum,et al.  Numerical Architecture , 2013, Top. Cogn. Sci..

[32]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.

[33]  Andrew U. Frank,et al.  Spatial Information Theory A Theoretical Basis for GIS , 1997, Lecture Notes in Computer Science.

[34]  D. E. Irwin Integrating Information Across Saccadic Eye Movements , 1996 .

[35]  A. Koriat,et al.  Toward a psychology of memory accuracy. , 2000, Annual review of psychology.

[36]  Kevin Lynch,et al.  The Image of the City , 1960 .

[37]  Wai-Kiang Yeap,et al.  How Albot0 Finds Its Way Home: A Novel Approach to Cognitive Mapping Using Robots , 2011, Top. Cogn. Sci..

[38]  Matthew D. M. Pawley,et al.  Reply to Cheung et al.: The cognitive map hypothesis remains the best interpretation of the data in honeybee navigation , 2014, Proceedings of the National Academy of Sciences.

[39]  P. Day The Organisation of Learning , 1977 .

[40]  Allen Cheung,et al.  The information content of panoramic images II: view-based navigation in nonrectangular experimental arenas. , 2008, Journal of experimental psychology. Animal behavior processes.

[41]  A. Siegel,et al.  The development of spatial representations of large-scale environments. , 1975, Advances in child development and behavior.

[42]  Collett,et al.  Learning walks and landmark guidance in wood ants (Formica rufa) , 1999, The Journal of experimental biology.

[43]  M. F. Brown,et al.  Does a cognitive map guide choices in the radial-arm maze? , 1992, Journal of experimental psychology. Animal behavior processes.

[44]  Aiden E. G. F. Arnold,et al.  A critical review of the allocentric spatial representation and its neural underpinnings: toward a network-based perspective , 2014, Front. Hum. Neurosci..

[45]  T. Gärling,et al.  Behavior and environment : psychological and geographical approaches , 1993 .

[46]  K. Bach Varieties of Reference , 1994 .

[47]  D. R. Montello,et al.  Spatial knowledge acquisition from direct experience in the environment: Individual differences in the development of metric knowledge and the integration of separately learned places , 2006, Cognitive Psychology.

[48]  R. Wehner,et al.  Path Integration Provides a Scaffold for Landmark Learning in Desert Ants , 2010, Current Biology.

[49]  Timothy P. McNamara,et al.  How Are the Locations of Objects in the Environment Represented in Memory? , 2003, Spatial Cognition.

[50]  Ubbo Visser,et al.  Egocentric qualitative spatial knowledge representation for physical robots , 2004, Robotics Auton. Syst..

[51]  Thomas S. Collett,et al.  How do insects use path integration for their navigation? , 2000, Biological Cybernetics.

[52]  Weimin Mou,et al.  Allocentric and egocentric updating of spatial memories. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[53]  H. Deubel Localization of targets across saccades: Role of landmark objects , 2004 .

[54]  Michael J. Rovine,et al.  Sketch-map variables as predictors of way-finding performance , 1989 .

[55]  P. Kappeler,et al.  Spatial memory in the grey mouse lemur (Microcebus murinus) , 2009, Animal Cognition.

[56]  Leo Polansky,et al.  Elucidating the significance of spatial memory on movement decisions by African savannah elephants using state–space models , 2015, Proceedings of the Royal Society B: Biological Sciences.

[57]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[58]  R. Passingham The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[59]  J. Cohen,et al.  Rats form cognitive maps from spatial configurations of proximal arm cues in an enclosed 4-arm radial maze , 2003 .

[60]  D. Appleyard Styles and Methods of Structuring a City , 1970 .

[61]  Benjamin Kuipers,et al.  A robot exploration and mapping strategy based on a semantic hierarchy of spatial representations , 1991, Robotics Auton. Syst..

[62]  William H. Warren,et al.  Environmental stability modulates the role of path integration in human navigation , 2015, Cognition.

[63]  K. Cheng A purely geometric module in the rat's spatial representation , 1986, Cognition.

[64]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[65]  Eric Mandelbaum,et al.  The automatic and the ballistic: Modularity beyond perceptual processes , 2015 .

[66]  Michael F Land,et al.  Vision and the representation of the surroundings in spatial memory , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[67]  Alex D. M. Dewar,et al.  Still no convincing evidence for cognitive map use by honeybees , 2014, Proceedings of the National Academy of Sciences.

[68]  David E. Irwin,et al.  The role of the saccade target object in the perception of a visually stable world , 2000, Perception & psychophysics.

[69]  Petra Jansen-Osmann,et al.  Is Route Learning More Than Serial Learning? , 2008, Spatial Cogn. Comput..

[70]  Lincoln Smith,et al.  Linked Local Navigation for Visual Route Guidance , 2007, Adapt. Behav..

[71]  Douglas D Gaffin,et al.  Autonomous Visual Navigation of an Indoor Environment Using a Parsimonious, Insect Inspired Familiarity Algorithm , 2016, PloS one.

[72]  Neil Burgess,et al.  A metric for the cognitive map: found at last? , 2006, Trends in Cognitive Sciences.

[73]  K. Schill,et al.  Representation of space: image-like or sensorimotor? , 2009, Spatial vision.

[74]  N. Mackintosh Do not ask whether they have a cognitive map , but how they find their way about , 2002 .

[75]  James W. Pellegrino,et al.  Chapter 3 Psychological Perspectives on Spatial Cognition Thomas , 1993 .

[76]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[77]  Giorgio Vallortigara,et al.  View-based strategy for reorientation by geometry , 2010, Journal of Experimental Biology.

[78]  N. Burgess,et al.  Spatial memory: how egocentric and allocentric combine , 2006, Trends in Cognitive Sciences.

[79]  E. Spelke,et al.  Human Spatial Representation: Insights from Animals , 2002 .

[80]  Uljana Feest,et al.  Operationism in psychology: what the debate is about, what the debate should be about. , 2005, Journal of the history of the behavioral sciences.

[81]  H. Barrett,et al.  Modularity in cognition: framing the debate. , 2006, Psychological review.

[82]  B. Scholl Object Persistence in Philosophy and Psychology , 2007 .

[83]  A. Fitzgibbon,et al.  Humans Ignore Motion and Stereo Cues in Favor of a Fictional Stable World , 2006, Current Biology.

[84]  Andrew W. Fitzgibbon,et al.  View-Based Approaches to Spatial Representation in Human Vision , 2009, Statistical and Geometrical Approaches to Visual Motion Analysis.

[85]  F. Dyer,et al.  The role of orientation flights on homing performance in honeybees. , 1999, The Journal of experimental biology.

[86]  Christophe Boesch,et al.  Sophisticated Euclidean maps in forest chimpanzees , 2009, Animal Behaviour.

[87]  S. Doherty,et al.  A conceptual model and empirical analysis of children's acquisition of spatial knowledge , 1985 .

[88]  William E. Marsh,et al.  Representation of impossible worlds in the cognitive map , 2015, Cognitive Processing.

[89]  R. Downs,et al.  Image and Environment: Cognitive Mapping and Spatial Behavior , 2017 .