Building the Arrow of Time… Over Time: A Sequence of Brain Activity Mapping Imagined Events in Time and Space.

When moving, the spatiotemporal unfolding of events is bound to our physical trajectory, and time and space become entangled in episodic memory. When imagining past or future events, or being in different geographical locations, the temporal and spatial dimensions of mental events can be independently accessed and manipulated. Using time-resolved neuroimaging, we characterized brain activity while participants ordered historical events from different mental perspectives in time (e.g., when imagining being 9 years in the future) or in space (e.g., when imagining being in Cayenne). We describe 2 neural signatures of temporal ordinality: an early brain response distinguishing whether participants were mentally in the past, the present or the future (self-projection in time), and a graded activity at event retrieval, indexing the mental distance between the representation of the self in time and the event. Neural signatures of ordinality and symbolic distances in time were distinct from those observed in the homologous spatial task: activity indicating spatial order and distances overlapped in latency in distinct brain regions. We interpret our findings as evidence that the conscious representation of time and space share algorithms (egocentric mapping, distance, and ordinality computations) but different implementations with a distinctive status for the psychological "time arrow."

[1]  Virginie van Wassenhove Minding time in an amodal representational space. , 2009, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[2]  P. Enticott,et al.  The neural underpinnings of vicarious experience , 2014, Front. Hum. Neurosci..

[3]  R. Leahy,et al.  EEG and MEG: forward solutions for inverse methods , 1999, IEEE Transactions on Biomedical Engineering.

[4]  M. Petrides,et al.  Specialized systems for the processing of mnemonic information within the primate frontal cortex. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[5]  Alana T. Wong,et al.  Remembering the past and imagining the future: Common and distinct neural substrates during event construction and elaboration , 2007, Neuropsychologia.

[6]  Morris Moscovitch,et al.  Mental space travel: damage to posterior parietal cortex prevents egocentric navigation and reexperiencing of remote spatial memories. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[7]  E. Denkova,et al.  Experiencing past and future personal events: Functional neuroimaging evidence on the neural bases of mental time travel , 2008, Brain and Cognition.

[8]  Masatoshi Itoh,et al.  Thinking of the future and past: the roles of the frontal pole and the medial temporal lobes , 2003, NeuroImage.

[9]  Joachim Gross,et al.  Good practice for conducting and reporting MEG research , 2013, NeuroImage.

[10]  Donna Rose Addis,et al.  Mental time travel and the shaping of the human mind , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[11]  S. Gallagher Philosophical conceptions of the self: implications for cognitive science , 2000, Trends in Cognitive Sciences.

[12]  G. Winocur,et al.  Episodic Memory and Beyond: The Hippocampus and Neocortex in Transformation. , 2016, Annual review of psychology.

[13]  M. Hämäläinen,et al.  Realistic conductivity geometry model of the human head for interpretation of neuromagnetic data , 1989, IEEE Transactions on Biomedical Engineering.

[14]  A. Dale,et al.  Distributed current estimates using cortical orientation constraints , 2006, Human brain mapping.

[15]  Arne D. Ekstrom,et al.  Complementary Roles of Human Hippocampal Subregions during Retrieval of Spatiotemporal Context , 2014, The Journal of Neuroscience.

[16]  Arne D. Ekstrom,et al.  Dissociable networks involved in spatial and temporal order source retrieval , 2011, NeuroImage.

[17]  M. D’Esposito,et al.  Environmental Knowledge Is Subserved by Separable Dorsal/Ventral Neural Areas , 1997, The Journal of Neuroscience.

[18]  C. Summerfield,et al.  An information theoretical approach to prefrontal executive function , 2007, Trends in Cognitive Sciences.

[19]  Sylvain Baillet,et al.  Magnetoencephalography for brain electrophysiology and imaging , 2017, Nature Neuroscience.

[20]  Jeffrey M. Zacks,et al.  Neuroimaging Studies of Mental Rotation: A Meta-analysis and Review , 2008, Journal of Cognitive Neuroscience.

[21]  D. Hassabis,et al.  Using Imagination to Understand the Neural Basis of Episodic Memory , 2007, The Journal of Neuroscience.

[22]  Preston P. Thakral,et al.  Increased hippocampus to ventromedial prefrontal connectivity during the construction of episodic future events , 2018, Hippocampus.

[23]  David J. Foster,et al.  Memory and Space: Towards an Understanding of the Cognitive Map , 2015, The Journal of Neuroscience.

[24]  R. Buckner,et al.  Self-projection and the brain , 2007, Trends in Cognitive Sciences.

[25]  D. Yves von Cramon,et al.  Thinking about the future versus the past in personal and non-personal contexts , 2008, Brain Research.

[26]  G. Winocur,et al.  The cognitive neuroscience of remote episodic, semantic and spatial memory , 2006, Current Opinion in Neurobiology.

[27]  Guillén Fernández,et al.  Persistent schema-dependent hippocampal-neocortical connectivity during memory encoding and postencoding rest in humans , 2010, Proceedings of the National Academy of Sciences.

[28]  S. Taulu,et al.  Suppression of Interference and Artifacts by the Signal Space Separation Method , 2003, Brain Topography.

[29]  R. Ilmoniemi,et al.  Magnetoencephalography-theory, instrumentation, and applications to noninvasive studies of the working human brain , 1993 .

[30]  T. McCormack,et al.  The dual systems in temporal cognition: A spatial analogy , 2018, Behavioral and Brain Sciences.

[31]  Aiden E. G. F. Arnold,et al.  A critical review of the allocentric spatial representation and its neural underpinnings: toward a network-based perspective , 2014, Front. Hum. Neurosci..

[32]  Arne D. Ekstrom,et al.  Multiple interacting brain areas underlie successful spatiotemporal memory retrieval in humans , 2014, Scientific Reports.

[33]  Martin Luessi,et al.  MNE software for processing MEG and EEG data , 2014, NeuroImage.

[34]  O. Flanagan,et al.  Narrative and Consciousness: Literature, Psychology and the Brain , 2003 .

[35]  Russell A. Epstein,et al.  Outside Looking In: Landmark Generalization in the Human Navigational System , 2015, The Journal of Neuroscience.

[36]  John A. King,et al.  Memory for events and their spatial context: models and experiments. , 2001, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[37]  D. Hassabis,et al.  Deconstructing episodic memory with construction , 2007, Trends in Cognitive Sciences.

[38]  M. Wittmann The inner sense of time: how the brain creates a representation of duration , 2013, Nature Reviews Neuroscience.

[39]  Teresa McCormack,et al.  Memory and temporal perspective: The role of temporal frameworks in memory development. , 1999 .

[40]  G. Buzsáki,et al.  Memory, navigation and theta rhythm in the hippocampal-entorhinal system , 2013, Nature Neuroscience.

[41]  Baptiste Gauthier,et al.  Time Is Not Space: Core Computations and Domain-Specific Networks for Mental Travels , 2016, The Journal of Neuroscience.

[42]  K. Miller,et al.  Human Retrosplenial Cortex Displays Transient Theta Phase Locking with Medial Temporal Cortex Prior to Activation during Autobiographical Memory Retrieval , 2013, The Journal of Neuroscience.

[43]  Joseph R. Madsen,et al.  Human theta oscillations exhibit task dependence during virtual maze navigation , 1999, Nature.

[44]  Russell A. Epstein,et al.  Where Am I Now? Distinct Roles for Parahippocampal and Retrosplenial Cortices in Place Recognition , 2007, The Journal of Neuroscience.

[45]  Peter C. Hansen,et al.  MEG. An introduction to methods , 2010 .

[46]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.

[47]  Nikos Makris,et al.  Automatically parcellating the human cerebral cortex. , 2004, Cerebral cortex.

[48]  S. Preston,et al.  Empathy: Its ultimate and proximate bases. , 2001, The Behavioral and brain sciences.

[49]  H. Karnath,et al.  Spatial orientation and the representation of space with parietal lobe lesions. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[50]  Arne D. Ekstrom,et al.  Frequency–specific network connectivity increases underlie accurate spatiotemporal memory retrieval , 2013, Nature Neuroscience.

[51]  R. Henson,et al.  Differential roles for medial prefrontal and medial temporal cortices in schema-dependent encoding: From congruent to incongruent , 2013, Neuropsychologia.

[52]  Andrew W. Young,et al.  Egocentric Disorientation following Bilateral Parietal Lobe Damage , 2005, Cortex.

[53]  K. Szpunar,et al.  Neural substrates of envisioning the future , 2007, Proceedings of the National Academy of Sciences.

[54]  Arne D. Ekstrom,et al.  Oscillations Go the Distance: Low-Frequency Human Hippocampal Oscillations Code Spatial Distance in the Absence of Sensory Cues during Teleportation , 2016, Neuron.

[55]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[56]  David Cai,et al.  Effects of Firing Variability on Network Structures with Spike-Timing-Dependent Plasticity , 2018, Front. Comput. Neurosci..

[57]  E. Tulving,et al.  Consciousness of subjective time in the brain , 2010, Proceedings of the National Academy of Sciences.

[58]  R. Nathan Spreng,et al.  The Common Neural Basis of Autobiographical Memory, Prospection, Navigation, Theory of Mind, and the Default Mode: A Quantitative Meta-analysis , 2009, Journal of Cognitive Neuroscience.

[59]  M. Corballis,et al.  The evolution of foresight: What is mental time travel, and is it unique to humans? , 2007, The Behavioral and brain sciences.

[60]  Murdock,et al.  The serial position effect of free recall , 1962 .

[61]  G. Committeri,et al.  Distributed cognitive maps reflecting real distances between places and views in the human brain , 2014, Front. Hum. Neurosci..

[62]  David C. Rubin,et al.  The Role of Narrative in Recollection: A View from Cognitive Psychology and Neuropsychology , 2012 .

[63]  Olivier Piguet,et al.  Self-projection and the default network in frontotemporal dementia , 2012, Nature Reviews Neurology.

[64]  E. Tulving Episodic memory: from mind to brain. , 2002, Annual review of psychology.

[65]  Olaf Blanke,et al.  Temporal Dissociation of Neocortical and Hippocampal Contributions to Mental Time Travel Using Intracranial Recordings in Humans , 2018, Front. Comput. Neurosci..

[66]  Marc W Howard,et al.  Time and space in the hippocampus , 2015, Brain Research.

[67]  Arne D. Ekstrom,et al.  Space, time, and episodic memory: The hippocampus is all over the cognitive map , 2018, Hippocampus.

[68]  Olaf Blanke,et al.  Subjective mental time: the functional architecture of projecting the self to past and future , 2009, The European journal of neuroscience.

[69]  Baptiste Gauthier,et al.  Cognitive mapping in mental time travel and mental space navigation , 2016, Cognition.

[70]  Gilles de Hollander Combining Computational Models of Cognition and Neural Data to Learn about Mixed Task Strategies , 2016 .

[71]  N. Burgess,et al.  Spatial memory: how egocentric and allocentric combine , 2006, Trends in Cognitive Sciences.

[72]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[73]  D. Schacter,et al.  Remembering the past to imagine the future: the prospective brain , 2007, Nature Reviews Neuroscience.

[74]  Olaf Blanke,et al.  The mental time line: An analogue of the mental number line in the mapping of life events , 2009, Consciousness and Cognition.

[75]  Jean Gotman,et al.  Low-frequency theta oscillations in the human hippocampus during real-world and virtual navigation , 2017, Nature Communications.

[76]  John Christie,et al.  Temporal Order Judgments Activate Temporal Parietal Junction , 2009, The Journal of Neuroscience.

[77]  Roberto Cabeza,et al.  The Short and Long of It: Neural Correlates of Temporal-order Memory for Autobiographical Events , 2008, Journal of Cognitive Neuroscience.

[78]  Olaf Blanke,et al.  Self in Time: Imagined Self-Location Influences Neural Activity Related to Mental Time Travel , 2008, The Journal of Neuroscience.

[79]  Neal J. Cohen,et al.  Differential contributions of hippocampus and medial prefrontal cortex to self-projection and self-referential processing , 2015, Neuropsychologia.

[80]  Dmitri Lavro,et al.  Processing ordinality and quantity: ERP evidence of separate mechanisms , 2013, Brain and Cognition.