Solving the detour problem in navigation: a model of prefrontal and hippocampal interactions

Adapting behavior to accommodate changes in the environment is an important function of the nervous system. A universal problem for motile animals is the discovery that a learned route is blocked and a detour is required. Given the substantial neuroscience research on spatial navigation and decision-making it is surprising that so little is known about how the brain solves the detour problem. Here we review the limited number of relevant functional neuroimaging, single unit recording and lesion studies. We find that while the prefrontal cortex (PFC) consistently responds to detours, the hippocampus does not. Recent evidence suggests the hippocampus tracks information about the future path distance to the goal. Based on this evidence we postulate a conceptual model in which: Lateral PFC provides a prediction error signal about the change in the path, frontopolar and superior PFC support the re-formulation of the route plan as a novel subgoal and the hippocampus simulates the new path. More data will be required to validate this model and understand (1) how the system processes the different options; and (2) deals with situations where a new path becomes available (i.e., shortcuts).

[1]  R U Muller,et al.  Head-direction cells recorded from the postsubiculum in freely moving rats. I. Description and quantitative analysis , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[2]  André A. Fenton,et al.  Linear Look-Ahead in Conjunctive Cells: An Entorhinal Mechanism for Vector-Based Navigation , 2012, Front. Neural Circuits.

[3]  John L Kubie,et al.  Heading‐vector navigation based on head‐direction cells and path integration , 2009, Hippocampus.

[4]  J. O'Doherty,et al.  Model‐Based fMRI and Its Application to Reward Learning and Decision Making , 2007, Annals of the New York Academy of Sciences.

[5]  Thackery I. Brown,et al.  Which Way Was I Going? Contextual Retrieval Supports the Disambiguation of Well Learned Overlapping Navigational Routes , 2010, The Journal of Neuroscience.

[6]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[7]  C. Schmidt,et al.  Partially segregated neural networks for spatial and contextual memory in virtual navigation , 2008, Hippocampus.

[8]  J. O’Keefe,et al.  Neuronal computations underlying the firing of place cells and their role in navigation , 1996, Hippocampus.

[9]  Hideki Nakano,et al.  Long-term plasticity in hippocampal place-cell representation of environmental geometry , 2002 .

[10]  J. O’Keefe,et al.  Geometric determinants of the place fields of hippocampal neurons , 1996, Nature.

[11]  A. Luria.  Higher Cortical Functions in Man , 1980, Springer US.

[12]  G. Winocur,et al.  Memory for familiar environments learned in the remote past: fMRI studies of healthy people and an amnesic person with extensive bilateral hippocampal lesions , 2007, Hippocampus.

[13]  A. Owen,et al.  Anterior prefrontal cortex: insights into function from anatomy and neuroimaging , 2004, Nature Reviews Neuroscience.

[14]  M. Coltheart.  What has functional neuroimaging told us about the organization of mind? , 2011 .

[15]  J. Glowinski,et al.  Anatomical and electrophysiological evidence for a direct projection from ammon's horn to the medial prefrontal cortex in the rat , 2004, Experimental Brain Research.

[16]  Caswell Barry,et al.  Neural systems supporting navigation , 2015, Current Opinion in Behavioral Sciences.

[17]  T. Shallice,et al.  Deficits in strategy application following frontal lobe damage in man. , 1991, Brain : a journal of neurology.

[18]  Hugo J. Spiers,et al.  Place Field Repetition and Purely Local Remapping in a Multicompartment Environment , 2013, Cerebral cortex.

[19]  H. Spiers,et al.  Prefrontal and medial temporal lobe interactions in long-term memory , 2003, Nature Reviews Neuroscience.

[20]  C. Thinus-Blanc,et al.  Route planning in cats, in relation to the visibility of the goal , 1983, Animal Behaviour.

[21]  J. Duncan.  The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour , 2010, Trends in Cognitive Sciences.

[22]  P. Gisquet-Verrier,et al.  Functional role of rat prelimbic-infralimbic cortices in spatial memory: evidence for their involvement in attention and behavioural flexibility , 2000, Behavioural Brain Research.

[23]  Richard N A Henson,et al.  The Scale of Functional Specialization within Human Prefrontal Cortex , 2010, The Journal of Neuroscience.

[24]  Morris Moscovitch,et al.  An investigation of the effects of hippocampal lesions in rats on pre‐ and postoperatively acquired spatial memory in a complex environment , 2010, Hippocampus.

[25]  R. Knight,et al.  The Hippocampus and Entorhinal Cortex Encode the Path and Euclidean Distances to Goals during Navigation , 2014, Current Biology.

[26]  Larry R. Squire,et al.  Memory for places learned long ago is intact after hippocampal damage , 1999, Nature.

[27]  Eleanor A. Maguire,et al.  Thoughts, behaviour, and brain dynamics during navigation in the real world , 2006, NeuroImage.

[28]  N. Chapuis,et al.  Detour and Shortcut Abilities in Several Species of Mammals , 1987 .

[29]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[30]  Dylan A. Simon,et al.  Neural Correlates of Forward Planning in a Spatial Decision Task in Humans , 2011, The Journal of Neuroscience.

[31]  Katherine R. Sherrill,et al.  Hippocampus and Retrosplenial Cortex Combine Path Integration Signals for Successful Navigation , 2013, The Journal of Neuroscience.

[32]  Elisa Ciaramelli,et al.  The role of ventromedial prefrontal cortex in navigation: A case of impaired wayfinding and rehabilitation , 2008, Neuropsychologia.

[33]  R. Morris,et al.  Place navigation impaired in rats with hippocampal lesions , 1982, Nature.

[34]  N Burgess,et al.  Bilateral hippocampal pathology impairs topographical and episodic memory but not visual pattern matching , 2001, Hippocampus.

[35]  A. Redish,et al.  Behavioral and neurophysiological correlates of regret in rat decision-making on a neuroeconomic task , 2014, Nature Neuroscience.

[36]  M. Quirk,et al.  Representation of Spatial Goals in Rat Orbitofrontal Cortex , 2006, Neuron.

[37]  Martin J. Chadwick,et al.  A local anchor for the brain's compass , 2014, Nature Neuroscience.

[38]  Magnus Lindgren,et al.  Contribution of Subregions of Human Frontal Cortex to Novelty Processing , 2012, Journal of Cognitive Neuroscience.

[39]  Hugo J Spiers,et al.  A navigational guidance system in the human brain , 2007, Hippocampus.

[40]  E. Maguire,et al.  The dynamic nature of cognition during wayfinding , 2008, Journal of environmental psychology.

[41]  T. Shallice.  Specific impairments of planning. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[42]  Eduardo F. Morales,et al.  An Introduction to Reinforcement Learning , 2011 .

[43]  D. Hassabis,et al.  A Goal Direction Signal in the Human Entorhinal/Subicular Region , 2015, Current Biology.

[44]  Thackery I. Brown,et al.  Contributions of medial temporal lobe and striatal memory systems to learning and retrieving overlapping spatial memories. , 2014, Cerebral cortex.

[45]  W. Scoville,et al.  LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS , 1957, Journal of neurology, neurosurgery, and psychiatry.

[46]  H. Eichenbaum,et al.  Interplay of Hippocampus and Prefrontal Cortex in Memory , 2013, Current Biology.

[47]  Kate Jeffery,et al.  Horizontal biases in rats’ use of three-dimensional space , 2011, Behavioural Brain Research.

[48]  R. Passingham,et al.  The Neurobiology of the Prefrontal Cortex: Anatomy, Evolution, and the Origin of Insight , 2012 .

[49]  Andrew M. Wikenheiser,et al.  Hippocampal theta sequences reflect current goals , 2015, Nature Neuroscience.

[50]  G. Winocur,et al.  “I have often walked down this street before”: fMRI Studies on the hippocampus and other structures during mental navigation of an old environment , 2004, Hippocampus.

[51]  B Poucet,et al.  Medial prefrontal lesions in the rat and spatial navigation: evidence for impaired planning. , 1995, Behavioral neuroscience.

[52]  V. Bohbot,et al.  Dissociable contributions of the prefrontal cortex to hippocampus- and caudate nucleus-dependent virtual navigation strategies , 2015, Neurobiology of Learning and Memory.

[53]  T. Braver,et al.  The Role of Frontopolar Cortex in Subgoal Processing during Working Memory , 2002, NeuroImage.

[54]  J. M. Anderson,et al.  Responses of human frontal cortex to surprising events are predicted by formal associative learning theory , 2001, Nature Neuroscience.

[55]  Aiden E. G. F. Arnold,et al.  A critical review of the allocentric spatial representation and its neural underpinnings: toward a network-based perspective , 2014, Front. Hum. Neurosci..

[56]  C. Büchel,et al.  Differential Recruitment of the Hippocampus, Medial Prefrontal Cortex, and the Human Motion Complex during Path Integration in Humans , 2007, The Journal of Neuroscience.

[57]  Torkel Hafting,et al.  Conjunctive Representation of Position, Direction, and Velocity in Entorhinal Cortex , 2006, Science.

[58]  Laure Rondi-Reig,et al.  How the cerebellum may monitor sensory information for spatial representation , 2014, Front. Syst. Neurosci..

[59]  J. Taube,et al.  Where am I and how will I get there from here? A role for posterior parietal cortex in the integration of spatial information and route planning , 2009, Neurobiology of Learning and Memory.

[60]  D. Nitz.  Tracking Route Progression in the Posterior Parietal Cortex , 2006, Neuron.

[61]  Stephen Lawrie,et al.  Functional Specialization within Rostral Prefrontal Cortex (Area 10): A Meta-analysis , 2006, Journal of Cognitive Neuroscience.

[62]  Jian Xu,et al.  Persistent posterior and transient anterior medial temporal lobe activity during navigation , 2010, NeuroImage.

[63]  B. Milner.  Effects of Different Brain Lesions on Card Sorting: The Role of the Frontal Lobes , 1963 .

[64]  C. Thinus-Blanc,et al.  The role of exploratory experience in a shortcut task by golden hamsters (Mesocricetus auratus) , 1987 .

[65]  J. Grafman,et al.  Are the frontal lobes implicated in “planning” functions? Interpreting data from the Tower of Hanoi , 1995, Neuropsychologia.

[66]  Richard S. J. Frackowiak,et al.  Knowing where and getting there: a human navigation network. , 1998, Science.

[67]  J. D. McGaugh,et al.  Inactivation of Hippocampus or Caudate Nucleus with Lidocaine Differentially Affects Expression of Place and Response Learning , 1996, Neurobiology of Learning and Memory.

[68]  R P Kesner,et al.  Involvement of rodent prefrontal cortex subregions in strategy switching. , 1999, Behavioral neuroscience.

[69]  J. O’Keefe,et al.  Boundary Vector Cells in the Subiculum of the Hippocampal Formation , 2009, The Journal of Neuroscience.

[70]  Morris Moscovitch,et al.  Remote spatial memory in an amnesic person with extensive bilateral hippocampal lesions , 2000, Nature Neuroscience.

[71]  N Burgess,et al.  Unilateral temporal lobectomy patients show lateralized topographical and episodic memory deficits in a virtual town. , 2001, Brain : a journal of neurology.

[72]  N. Burgess.  Spatial Cognition and the Brain , 2008, Annals of the New York Academy of Sciences.

[73]  J. D. Bruin,et al.  A behavioural analysis of rats with damage to the medial prefrontal cortex using the morris water maze: evidence for behavioural flexibility, but not for impaired spatial navigation , 1994, Brain Research.

[74]  Matthijs A. A. van der Meer,et al.  Integrating hippocampus and striatum in decision-making , 2007, Current Opinion in Neurobiology.

[75]  H. J. Spiers,et al.  The neuroscience of remote spatial memory: A tale of two cities , 2007, Neuroscience.

[76]  Brad E. Pfeiffer,et al.  Hippocampal place cell sequences depict future paths to remembered goals , 2013, Nature.

[77]  Neil Burgess,et al.  Forward and Backward Inference in Spatial Cognition , 2013, PLoS Comput. Biol..

[78]  C. H. Honzik,et al.  Degrees of hunger, reward and non-reward, and maze learning in rats, and Introduction and removal of reward, and maze performance in rats , 1930 .

[79]  Ariane S Etienne,et al.  Path integration in mammals , 2004, Hippocampus.

[80]  R. Muller,et al.  Head-direction cells recorded from the postsubiculum in freely moving rats. II. Effects of environmental manipulations , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[81]  Neil Burgess,et al.  Attractor Dynamics in the Hippocampal Representation of the Local Environment , 2005, Science.

[82]  R. Kesner,et al.  Involvement of the Prelimbic–Infralimbic Areas of the Rodent Prefrontal Cortex in Behavioral Flexibility for Place and Response Learning , 1999, The Journal of Neuroscience.

[83]  J. Duncan,et al.  Common regions of the human frontal lobe recruited by diverse cognitive demands , 2000, Trends in Neurosciences.

[84]  T. Robbins,et al.  Stop-signal inhibition disrupted by damage to right inferior frontal gyrus in humans , 2003, Nature Neuroscience.

[85]  Matthijs A. A. van der Meer,et al.  Information Processing in Decision-Making Systems , 2012, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[86]  Hugo J. Spiers,et al.  Keeping the goal in mind: Prefrontal contributions to spatial navigation , 2008, Neuropsychologia.

[87]  Alice Alvernhe,et al.  Local remapping of place cell firing in the Tolman detour task , 2011, The European journal of neuroscience.

[88]  M. Ullsperger,et al.  Neurophysiology of performance monitoring and adaptive behavior. , 2014, Physiological reviews.

[89]  Raymond P. Kesner,et al.  Memory for objects and their locations: The role of the hippocampus in retention of object–place associations , 2004, Neurobiology of Learning and Memory.

[90]  Christopher J. Fox,et al.  Detection of unexpected events during spatial navigation in humans: bottom‐up attentional system and neural mechanisms , 2008, The European journal of neuroscience.

[91]  B. Gold,et al.  Common and Distinct Mechanisms of Cognitive Flexibility in Prefrontal Cortex , 2011, The Journal of Neuroscience.

[92]  E. Maguire,et al.  Navigation around London by a taxi driver with bilateral hippocampal lesions. , 2006, Brain : a journal of neurology.

[93]  E. Tolman.  Cognitive maps in rats and men. , 1948, Psychological review.

[94]  J. O’Keefe,et al.  Modeling place fields in terms of the cortical inputs to the hippocampus , 2000, Hippocampus.

[95]  Jeffrey S Taube,et al.  Head direction cell activity and behavior in a navigation task requiring a cognitive mapping strategy , 2004, Behavioural Brain Research.

[96]  H. Spiers,et al.  Path integration following temporal lobectomy in humans , 2001, Neuropsychologia.

[97]  A. Bennett,et al.  Do animals have cognitive maps? , 1996, The Journal of experimental biology.

[98]  H. Eichenbaum,et al.  Hippocampal Neurons Encode Information about Different Types of Memory Episodes Occurring in the Same Location , 2000, Neuron.

[99]  R. Shayna Rosenbaum,et al.  Patterns of preserved and impaired spatial memory in a case of developmental amnesia , 2015, Front. Hum. Neurosci..

[100]  Hugo J. Spiers,et al.  Dissociation between Dorsal and Ventral Posterior Parietal Cortical Responses to Incidental Changes in Natural Scenes , 2013, PloS one.

[101]  Cameron S Carter,et al.  Stimulus and response conflict processing during perceptual decision making , 2009, Cognitive, affective & behavioral neuroscience.

[102]  Douglas A. Nitz,et al.  The Posterior Parietal Cortex: Interface Between Maps of External Spaces and the Generation of Action Sequences , 2014 .

[103]  J. Bermúdez,et al.  The organization of the mind , 2013 .

[104]  Iroise Dumontheil,et al.  The gateway hypothesis of rostral prefrontal cortex (area 10) function , 2007, Trends in Cognitive Sciences.

[105]  Aiden E. G. F. Arnold,et al.  Differential neural network configuration during human path integration , 2014, Front. Hum. Neurosci..

[106]  J. Duncan.  The Structure of Cognition: Attentional Episodes in Mind and Brain , 2013, Neuron.

[107]  Larry R Squire,et al.  Neural basis of the cognitive map: Path integration does not require hippocampus or entorhinal cortex , 2008, Proceedings of the National Academy of Sciences.

[108]  Angelo Arleo,et al.  Spatial Learning and Action Planning in a Prefrontal Cortical Network Model , 2011, PLoS Comput. Biol..

[109]  Philippe Gaussier,et al.  The hippocampo-cortical loop: Spatio-temporal learning and goal-oriented planning in navigation , 2013, Neural Networks.

[110]  Matthijs A. A. van der Meer,et al.  Ventral striatum: a critical look at models of learning and evaluation , 2011, Current Opinion in Neurobiology.

[111]  G. Winocur,et al.  Functional neuroanatomy of remote episodic, semantic and spatial memory: a unified account based on multiple trace theory , 2005, Journal of anatomy.

[112]  Larry R Squire,et al.  Contrasting effects on path integration after hippocampal damage in humans and rats , 2013, Proceedings of the National Academy of Sciences.

[113]  Jonathan R. Whitlock,et al.  Navigating from hippocampus to parietal cortex , 2008, Proceedings of the National Academy of Sciences.

[114]  Alex Martin,et al.  Access the most recent version at doi: 10.1101/lm.251906 , 2006 .

[115]  Nathaniel D. Daw,et al.  Grid Cells, Place Cells, and Geodesic Generalization for Spatial Reinforcement Learning , 2011, PLoS Comput. Biol..

[116]  R. Passingham.  The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[117]  John O'Keefe,et al.  The cognitive map as a hippocampus , 1979, Behavioral and Brain Sciences.

[118]  J. Avery.  Critical review. , 2006, The Journal of the Arkansas Medical Society.

[119]  E. Save,et al.  Coding for spatial goals in the prelimbic/infralimbic area of the rat frontal cortex. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[120]  W. Penfield,et al.  THE FRONTAL LOBE IN MAN: A CLINICAL STUDY OF MAXIMUM REMOVALS , 1935 .

[121]  G. Stratton.  University of California publications in psychology , 1976 .

[122]  P. Burgess,et al.  Executive function , 2008, Current Biology.

[123]  R. Knight,et al.  Insights into Human Behavior from Lesions to the Prefrontal Cortex , 2014, Neuron.

[124]  E. Maguire,et al.  Newcastle University Eprints , 2022 .

[125]  A. Dickinson,et al.  Prediction Error during Retrospective Revaluation of Causal Associations in Humans fMRI Evidence in Favor of an Associative Model of Learning , 2004, Neuron.

[126]  Dorothy Tse,et al.  References and Notes Supporting Online Material Materials and Methods Figs. S1 to S5 Tables S1 to S3 Electron Impact (ei) Mass Spectra Chemical Ionization (ci) Mass Spectra References Schemas and Memory Consolidation Research Articles Research Articles Research Articles Research Articles , 2022 .

[127]  C. Frith,et al.  Involvement of rostral prefrontal cortex in selection between stimulus‐oriented and stimulus‐independent thought , 2005, The European journal of neuroscience.

[128]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[129]  Peter Dayan,et al.  Hippocampal Contributions to Control: The Third Way , 2007, NIPS.

[130]  L. Nadel,et al.  Spatial memory deficits in patients with lesions to the right hippocampus and to the right parahippocampal cortex , 1998, Neuropsychologia.

[131]  D. Amaral,et al.  The Hippocampal Formation , 2009 .

[132]  M. Moser,et al.  Spatial Memory in the Rat Requires the Dorsolateral Band of the Entorhinal Cortex , 2005, Neuron.

[133]  E. Koechlin,et al.  The role of the anterior prefrontal cortex in human cognition , 1999, Nature.

[134]  Christopher H. Chatham,et al.  Cognitive Control Reflects Context Monitoring, Not Motoric Stopping, in Response Inhibition , 2012, PloS one.

[135]  John Duncan,et al.  The role of Area 10 (BA10) in human multitasking and in social cognition: A lesion study , 2011, Neuropsychologia.

[136]  Michael E. Hasselmo,et al.  A Model of Prefrontal Cortical Mechanisms for Goal-directed Behavior , 2005, Journal of Cognitive Neuroscience.

[137]  Alice Alvernhe,et al.  Different CA1 and CA3 Representations of Novel Routes in a Shortcut Situation , 2008, The Journal of Neuroscience.

[138]  Christian F. Doeller,et al.  Anterior Hippocampus and Goal-Directed Spatial Decision Making , 2011, The Journal of Neuroscience.

[139]  P. Dayan,et al.  States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning , 2010, Neuron.

[140]  T. Robbins,et al.  Effects of orbitofrontal, infralimbic and prelimbic cortical lesions on serial spatial reversal learning in the rat , 2007, Behavioural Brain Research.