Prefrontal Dynamics Associated with Efficient Detours and Shortcuts: A Combined Functional Magnetic Resonance Imaging and Magnetoencenphalography Study

Central to the concept of the “cognitive map” is that it confers behavioral flexibility, allowing animals to take efficient detours, exploit shortcuts, and avoid alluring, but unhelpful, paths. The neural underpinnings of such naturalistic and flexible behavior remain unclear. In two neuroimaging experiments, we tested human participants on their ability to navigate to a set of goal locations in a virtual desert island riven by lava, which occasionally spread to block selected paths (necessitating detours) or receded to open new paths (affording real shortcuts or false shortcuts to be avoided). Detours activated a network of frontal regions compared with shortcuts. Activity in the right dorsolateral PFC specifically increased when participants encountered tempting false shortcuts that led along suboptimal paths that needed to be differentiated from real shortcuts. We also report modulation in event-related fields and theta power in these situations, providing insight to the temporal evolution of response to encountering detours and shortcuts. These results help inform current models as to how the brain supports navigation and planning in dynamic environments.

[1]  Danesh Shahnazian,et al.  Subgoal- and Goal-related Reward Prediction Errors in Medial Prefrontal Cortex , 2019, Journal of Cognitive Neuroscience.

[2]  Arne D. Ekstrom,et al.  Behavioral correlates of human hippocampal delta and theta oscillations during navigation. , 2011, Journal of neurophysiology.

[3]  Neil Burgess,et al.  Medial Prefrontal–Medial Temporal Theta Phase Coupling in Dynamic Spatial Imagery , 2017, Journal of Cognitive Neuroscience.

[4]  Kathrin C. J. Eschmann,et al.  Topographical differences of frontal-midline theta activity reflect functional differences in cognitive control abilities , 2018, Brain and Cognition.

[5]  Eleanor A. Maguire,et al.  Thoughts, behaviour, and brain dynamics during navigation in the real world , 2006, NeuroImage.

[6]  Anthony E. Richardson,et al.  Spatial abilities at different scales: Individual differences in aptitude-test performance and spatial-layout learning , 2006 .

[7]  R. Oostenveld,et al.  Neuronal Dynamics Underlying High- and Low-Frequency EEG Oscillations Contribute Independently to the Human BOLD Signal , 2011, Neuron.

[8]  R. Passingham The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[9]  N. Chapuis,et al.  Detour and Shortcut Abilities in Several Species of Mammals , 1987 .

[10]  Hugo J. Spiers,et al.  Human Spatial Navigation , 2018 .

[11]  Beatrix Emo,et al.  Hippocampal and prefrontal processing of network topology to simulate the future , 2017, Nature Communications.

[12]  Joseph T. McGuire,et al.  A Neural Signature of Hierarchical Reinforcement Learning , 2011, Neuron.

[13]  Karl J. Friston,et al.  The Neural Representation of Prospective Choice during Spatial Planning and Decisions , 2017, PLoS biology.

[14]  D. Hassabis,et al.  Deconstructing episodic memory with construction , 2007, Trends in Cognitive Sciences.

[15]  Christian F. Doeller,et al.  Movement-Related Theta Rhythm in Humans: Coordinating Self-Directed Hippocampal Learning , 2012, PLoS biology.

[16]  B. Staresina,et al.  Oscillations and Episodic Memory: Addressing the Synchronization/Desynchronization Conundrum , 2016, Trends in Neurosciences.

[17]  Dylan A. Simon,et al.  Neural Correlates of Forward Planning in a Spatial Decision Task in Humans , 2011, The Journal of Neuroscience.

[18]  Morris Moscovitch,et al.  An investigation of the effects of hippocampal lesions in rats on pre‐ and postoperatively acquired spatial memory in a complex environment , 2010, Hippocampus.

[19]  R. Knight,et al.  The Hippocampus and Entorhinal Cortex Encode the Path and Euclidean Distances to Goals during Navigation , 2014, Current Biology.

[20]  C. H. Honzik,et al.  Degrees of hunger, reward and non-reward, and maze learning in rats, and Introduction and removal of reward, and maze performance in rats , 1930 .

[21]  Timothy Edward John Behrens,et al.  Dissociable contributions of ventromedial prefrontal and posterior parietal cortex to value-guided choice , 2014, NeuroImage.

[22]  Richard S. J. Frackowiak,et al.  Knowing where and getting there: a human navigation network. , 1998, Science.

[23]  V. Srinivasa Chakravarthy,et al.  Basal Ganglia System as an Engine for Exploration , 2014, Encyclopedia of Computational Neuroscience.

[24]  S. Ishii,et al.  Resolution of Uncertainty in Prefrontal Cortex , 2006, Neuron.

[25]  Christian F. Doeller,et al.  Medial prefrontal theta phase coupling during spatial memory retrieval , 2014, Hippocampus.

[26]  G. Lynch,et al.  Human Cortical during Free Exploration Encodes Space and Predicts Subsequent Memory , 2013 .

[27]  B. Balleine,et al.  The Role of Learning in the Operation of Motivational Systems , 2002 .

[28]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[29]  D. Hassabis,et al.  Hippocampal place cells construct reward related sequences through unexplored space , 2015, eLife.

[30]  G. Winocur,et al.  “I have often walked down this street before”: fMRI Studies on the hippocampus and other structures during mental navigation of an old environment , 2004, Hippocampus.

[31]  Paul J. Laurienti,et al.  An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets , 2003, NeuroImage.

[32]  Hugo J. Spiers,et al.  Keeping the goal in mind: Prefrontal contributions to spatial navigation , 2008, Neuropsychologia.

[33]  Alice Alvernhe,et al.  Local remapping of place cell firing in the Tolman detour task , 2011, The European journal of neuroscience.

[34]  S. Hanslmayr,et al.  Oscillatory power decreases and long-term memory: the information via desynchronization hypothesis , 2012, Front. Hum. Neurosci..

[35]  Alice Alvernhe,et al.  Different CA1 and CA3 Representations of Novel Routes in a Shortcut Situation , 2008, The Journal of Neuroscience.

[36]  Hugo J. Spiers,et al.  Solving the detour problem in navigation: a model of prefrontal and hippocampal interactions , 2015, Front. Hum. Neurosci..

[37]  Jian Xu,et al.  Persistent posterior and transient anterior medial temporal lobe activity during navigation , 2010, NeuroImage.

[38]  C. Thinus-Blanc,et al.  The role of exploratory experience in a shortcut task by golden hamsters (Mesocricetus auratus) , 1987 .

[39]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[40]  M. Hasselmo,et al.  Models of spatial and temporal dimensions of memory , 2017, Current Opinion in Behavioral Sciences.

[41]  Michael A. DiSano,et al.  Variability of the Relationship between Electrophysiology and BOLD-fMRI across Cortical Regions in Humans , 2011, The Journal of Neuroscience.

[42]  G. Buzsáki Theta rhythm of navigation: Link between path integration and landmark navigation, episodic and semantic memory , 2005, Hippocampus.

[43]  Christian F. Doeller,et al.  Anterior Hippocampus and Goal-Directed Spatial Decision Making , 2011, The Journal of Neuroscience.

[44]  Robert Oostenveld,et al.  Trial-by-trial coupling between EEG and BOLD identifies networks related to alpha and theta EEG power increases during working memory maintenance , 2009, NeuroImage.

[45]  M. Frank,et al.  Frontal theta as a mechanism for cognitive control , 2014, Trends in Cognitive Sciences.

[46]  Russell A. Epstein,et al.  The cognitive map in humans: spatial navigation and beyond , 2017, Nature Neuroscience.

[47]  J. O’Keefe,et al.  Space in the brain: how the hippocampal formation supports spatial cognition , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[48]  Matthew V. Mollison,et al.  Electrophysiological correlates of high-level perception during spatial navigation , 2009, Psychonomic bulletin & review.

[49]  Jason D. Ozubko,et al.  Long-term consolidation switches goal proximity coding from hippocampus to retrosplenial cortex , 2017, bioRxiv.

[50]  Arne D. Ekstrom,et al.  Oscillations Go the Distance: Low-Frequency Human Hippocampal Oscillations Code Spatial Distance in the Absence of Sensory Cues during Teleportation , 2016, Neuron.

[51]  F. Carver,et al.  Human Hippocampal and Parahippocampal Theta during Goal-Directed Spatial Navigation Predicts Performance on a Virtual Morris Water Maze , 2008, The Journal of Neuroscience.

[52]  C. Schmidt,et al.  Partially segregated neural networks for spatial and contextual memory in virtual navigation , 2008, Hippocampus.

[53]  J. Jacobs Hippocampal theta oscillations are slower in humans than in rodents: implications for models of spatial navigation and memory , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[54]  Tobias U. Hauser,et al.  The feedback-related negativity (FRN) revisited: New insights into the localization, meaning and network organization , 2014, NeuroImage.

[55]  Caswell Barry,et al.  Neural systems supporting navigation , 2015, Current Opinion in Behavioral Sciences.

[56]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[57]  S. Raghavachari,et al.  Distinct patterns of brain oscillations underlie two basic parameters of human maze learning. , 2001, Journal of neurophysiology.

[58]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[59]  Jean Gotman,et al.  Low-frequency theta oscillations in the human hippocampus during real-world and virtual navigation , 2017, Nature Communications.

[60]  S. Hanslmayr,et al.  Temporal-Pattern Similarity Analysis Reveals the Beneficial and Detrimental Effects of Context Reinstatement on Human Memory , 2015, The Journal of Neuroscience.

[61]  Morris Moscovitch,et al.  Hippocampal and Retrosplenial Goal Distance Coding After Long-term Consolidation of a Real-World Environment , 2019, Cerebral cortex.

[62]  T. Shallice Specific impairments of planning. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[63]  Michael E. Hasselmo,et al.  Neuromodulation, theta rhythm and rat spatial navigation , 2002, Neural Networks.

[64]  Brad E. Pfeiffer,et al.  Hippocampal place cell sequences depict future paths to remembered goals , 2013, Nature.

[65]  Christopher J. Fox,et al.  Detection of unexpected events during spatial navigation in humans: bottom‐up attentional system and neural mechanisms , 2008, The European journal of neuroscience.

[66]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.

[67]  Marshall G. Hussain Shuler,et al.  Rationalizing spatial exploration patterns of wild animals and humans through a temporal discounting framework , 2016, Proceedings of the National Academy of Sciences.

[68]  C. Thinus-Blanc,et al.  Route planning in cats, in relation to the visibility of the goal , 1983, Animal Behaviour.

[69]  N. Burgess,et al.  Human hippocampal theta power indicates movement onset and distance travelled , 2017, Proceedings of the National Academy of Sciences.