Imagining predictions: mental imagery as mental emulation

We argue that the primary function of mental imagery is to allow us to generate specific predictions based upon past experience. All imagery allows us to answer ‘what if’ questions by making explicit and accessible the likely consequences of being in a specific situation or performing a specific action. Imagery is also characterized by its reliance on perceptual representations and activation of perceptual brain systems. We use this conception of imagery to argue that all imagery is simulation—more specifically, it is a specific type of simulation in which the mental processes that ‘run’ the simulation emulate those that would actually operate in the simulated scenario. This type of simulation, which we label emulation, has benefits over other types of simulations that merely mimic the content of the simulated scenario.

[1]  G. Hesslow Conscious thought as simulation of behaviour and perception , 2002, Trends in Cognitive Sciences.

[2]  Timothy D. Wilson,et al.  Prospection: Experiencing the Future , 2007, Science.

[3]  J. Clement Creative Model Construction in Scientists and Students: The Role of Imagery, Analogy, and Mental Simulation , 2008 .

[4]  S. Kosslyn,et al.  Transcranial Magnetic Stimulation of Primary Motor Cortex Affects Mental Rotation , 2022 .

[5]  Friedemann Pulvermüller,et al.  Brain mechanisms linking language and action , 2005, Nature Reviews Neuroscience.

[6]  J. C. Rothwell,et al.  Dynamic changes in corticospinal excitability during motor imagery , 1999, Experimental Brain Research.

[7]  S. Petersen,et al.  Memory's echo: vivid remembering reactivates sensory-specific cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[8]  J. Decety,et al.  Functional anatomy of execution, mental simulation, observation, and verb generation of actions: A meta‐analysis , 2001, Human brain mapping.

[9]  Carolyn Copper,et al.  Does mental practice enhance performance , 1994 .

[10]  D. Levine,et al.  Visual and spatial mental imagery: Dissociable systems of representation , 1988, Cognitive Psychology.

[11]  R. Cabeza,et al.  Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies , 2000, Journal of Cognitive Neuroscience.

[12]  M. Hegarty,et al.  Individual differences in mental animation during mechanical reasoning , 1994, Memory & cognition.

[13]  R. Buckner,et al.  THE COGNITIVE NEUROSCIENCE OF REMEMBERING , 2001 .

[14]  N. Roese Counterfactual thinking. , 1997, Psychological bulletin.

[15]  S. Kosslyn,et al.  Visual mental imagery induces retinotopically organized activation of early visual areas. , 2005, Cerebral cortex.

[16]  S. Kosslyn,et al.  Regional cerebral blood flow during script-driven imagery in childhood sexual abuse-related PTSD: A PET investigation. , 1999, The American journal of psychiatry.

[17]  M. Dadds,et al.  Imagery in human classical conditioning. , 1997, Psychological bulletin.

[18]  M Hegarty,et al.  Mental animation in the visuospatial sketchpad: Evidence from dual-task studies , 1997, Memory & cognition.

[19]  M. Jeannerod The representing brain: Neural correlates of motor intention and imagery , 1994, Behavioral and Brain Sciences.

[20]  John J. Clement,et al.  Creative Model Construction in Scientists and Students , 2008 .

[21]  M. Bar,et al.  Cortical Analysis of Visual Context , 2003, Neuron.

[22]  L. Craighero,et al.  Corticospinal excitability is specifically modulated by motor imagery: a magnetic stimulation study , 1998, Neuropsychologia.

[23]  Stella Christie,et al.  Four types of visual mental imagery processing in upright and tilted observers. , 2003, Brain research. Cognitive brain research.

[24]  L. Barsalou Situated simulation in the human conceptual system , 2003 .

[25]  Andreas Wohlschläger,et al.  Simulating biological and non-biological motion , 2008, Brain and Cognition.

[26]  Noriaki Hattori,et al.  Functional Imaging of Gustatory Perception and Imagery: Btop-downq Processing of Gustatory Signals , 2004 .

[27]  Stephen M Kosslyn,et al.  Sequential processes in image generation , 1988, Cognitive Psychology.

[28]  M. Jeannerod Neural Simulation of Action: A Unifying Mechanism for Motor Cognition , 2001, NeuroImage.

[29]  J. Ogden,et al.  Visual object agnosia, prosopagnosia, achromatopsia, loss of visual imagery, and autobiographical amnesia following recovery from cortical blindness: Case M.H. , 1993, Neuropsychologia.

[30]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[31]  Rainer Goebel,et al.  Dynamic Premotor-to-Parietal Interactions during Spatial Imagery , 2008, The Journal of Neuroscience.

[32]  Koen Lamberts,et al.  The encoding–retrieval relationship: retrieval as mental simulation , 2008, Trends in Cognitive Sciences.

[33]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[34]  A. Tversky,et al.  The simulation heuristic , 1982 .

[35]  V. Gallese The manifold nature of interpersonal relations: the quest for a common mechanism. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[36]  Jennifer M. Shephard,et al.  Spatial versus object visualizers: A new characterization of visual cognitive style , 2005, Memory & cognition.

[37]  Morris Moscovitch,et al.  Visual imagery deficits, impaired strategic retrieval, or memory loss: disentangling the nature of an amnesic person’s autobiographical memory deficit , 2004, Neuropsychologia.

[38]  D. Hassabis,et al.  Deconstructing episodic memory with construction , 2007, Trends in Cognitive Sciences.

[39]  Alan C. Evans,et al.  Hearing in the Mind's Ear: A PET Investigation of Musical Imagery and Perception , 1996, Journal of Cognitive Neuroscience.

[40]  N Butters,et al.  The dissociation of anterograde and retrograde amnesia in a patient with herpes encephalitis. , 1992, Journal of clinical and experimental neuropsychology.

[41]  D. Schacter,et al.  Episodic Simulation of Future Events , 2008, Annals of the New York Academy of Sciences.

[42]  D C Rubin,et al.  Visual memory-deficit amnesia: a distinct amnesic presentation and etiology. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[43]  Benjamin J. Shannon,et al.  Parietal lobe contributions to episodic memory retrieval , 2005, Trends in Cognitive Sciences.

[44]  M. Diamond,et al.  Primary Motor and Sensory Cortex Activation during Motor Performance and Motor Imagery: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[45]  L. Barsalou Grounded cognition. , 2008, Annual review of psychology.

[46]  M. Denis,et al.  Reopening the Mental Imagery Debate: Lessons from Functional Anatomy , 1998, NeuroImage.

[47]  Shelley E. Taylor,et al.  Harnessing the imagination. Mental simulation, self-regulation, and coping. , 1998, The American psychologist.

[48]  J. Watson,et al.  Conditioned emotional reactions , 1920 .

[49]  S. Kosslyn Image and Brain: The Resolution of the Imagery Debate , 1994, Journal of Cognitive Neuroscience.

[50]  D. Hassabis,et al.  Using Imagination to Understand the Neural Basis of Episodic Memory , 2007, The Journal of Neuroscience.

[51]  David W. Green,et al.  Mental simulation and argument , 2006 .

[52]  R. Gordon Folk Psychology as Simulation , 1986 .

[53]  V. Gallese Intentional attunement: A neurophysiological perspective on social cognition and its disruption in autism , 2006, Brain Research.

[54]  D. Schacter,et al.  The Brain's Default Network , 2008, Annals of the New York Academy of Sciences.

[55]  M. Bar The proactive brain: using analogies and associations to generate predictions , 2007, Trends in Cognitive Sciences.

[56]  D. Ingvar “Hyperfrontal” distribution of the cerebral grey matter flow in resting wakefulness; on the functional anatomy of the conscious state , 1979, Acta neurologica Scandinavica.

[57]  J. Fisher Does Simulation Theory Really Involve Simulation? , 2006 .

[58]  S. Kosslyn,et al.  When is early visual cortex activated during visual mental imagery? , 2003, Psychological bulletin.

[59]  S. Kosslyn Image and mind , 1982 .

[60]  M. Hegarty Mechanical reasoning by mental simulation , 2004, Trends in Cognitive Sciences.

[61]  D. Hassabis,et al.  Patients with hippocampal amnesia cannot imagine new experiences , 2007, Proceedings of the National Academy of Sciences.

[62]  Morris Moscovitch,et al.  Characterizing spatial and temporal features of autobiographical memory retrieval networks: a partial least squares approach , 2004, NeuroImage.

[63]  R. Buckner,et al.  Opinion TRENDS in Cognitive Sciences Vol.11 No.2 Self-projection and the brain , 2022 .