A meta-analytic review of multisensory imagery identifies the neural correlates of modality-specific and modality-general imagery

The relationship between imagery and mental representations induced through perception has been the subject of philosophical discussion since antiquity and of vigorous scientific debate in the last century. The relatively recent advent of functional neuroimaging has allowed neuroscientists to look for brain-based evidence for or against the argument that perceptual processes underlie mental imagery. Recent investigations of imagery in many new domains and the parallel development of new meta-analytic techniques now afford us a clearer picture of the relationship between the neural processes underlying imagery and perception, and indeed between imagery and other cognitive processes. This meta-analysis surveyed 65 studies investigating modality-specific imagery in auditory, tactile, motor, gustatory, olfactory, and three visual sub-domains: form, color and motion. Activation likelihood estimate (ALE) analyses of activation foci reported within- and across sensorimotor modalities were conducted. The results indicate that modality-specific imagery activations generally overlap with—but are not confined to—corresponding somatosensory processing and motor execution areas, and suggest that there is a core network of brain regions recruited during imagery, regardless of task. These findings have important implications for investigations of imagery and theories of cognitive processes, such as perceptually-based representational systems.

[1]  K Sathian,et al.  Visual cortical activity during tactile perception in the sighted and the visually deprived. , 2005, Developmental psychobiology.

[2]  S. Kosslyn,et al.  Brain areas underlying visual mental imagery and visual perception: an fMRI study. , 2004, Brain research. Cognitive brain research.

[3]  Nina S. Hsu,et al.  Chromaticity of color perception and object color knowledge , 2012, Neuropsychologia.

[4]  Sarah H. Creem-Regehr,et al.  Neural correlates of two imagined egocentric transformations , 2007, NeuroImage.

[5]  Russell A. Poldrack,et al.  Large-scale automated synthesis of human functional neuroimaging data , 2011, Nature Methods.

[6]  R. Goebel,et al.  Matching two imagined clocks: the functional anatomy of spatial analysis in the absence of visual stimulation. , 2000, Cerebral cortex.

[7]  S. Kosslyn,et al.  When is early visual cortex activated during visual mental imagery? , 2003, Psychological bulletin.

[8]  M. Mesulam,et al.  Dissociation of Neural Representation of Intensity and Affective Valuation in Human Gustation , 2003, Neuron.

[9]  R. Zatorre,et al.  When that tune runs through your head: a PET investigation of auditory imagery for familiar melodies. , 1999, Cerebral cortex.

[10]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[11]  C. Delon-Martin,et al.  Experience induces functional reorganization in brain regions involved in odor imagery in perfumers , 2012, Human brain mapping.

[12]  S. Kosslyn,et al.  Visual memory and visual mental imagery recruit common control and sensory regions of the brain , 2012, Cognitive neuroscience.

[13]  S. Kosslyn,et al.  Mental Imagery of High- and Low-Resolution Gratings Activates Area 17 , 2001, NeuroImage.

[14]  Melvyn A. Goodale,et al.  Category-specific neural processing for naming pictures of animals and naming pictures of tools: An ALE meta-analysis , 2010, Neuropsychologia.

[15]  M. Brett,et al.  Large, colorful, or noisy? Attribute- and modality-specific activations during retrieval of perceptual attribute knowledge , 2001 .

[16]  Cyriel M. A. Pennartz,et al.  Modality-specific and modality-independent components of the human imagery system , 2010, NeuroImage.

[17]  Alan C. Evans,et al.  Hearing in the Mind's Ear: A PET Investigation of Musical Imagery and Perception , 1996, Journal of Cognitive Neuroscience.

[18]  Jobu Watanabe,et al.  Mental visual synthesis is originated in the fronto-temporal network of the left hemisphere. , 2004, Cerebral cortex.

[19]  S. Kosslyn,et al.  Topographical representations of mental images in primary visual cortex , 1995, Nature.

[20]  Chris McNorgan,et al.  Integrating conceptual knowledge within and across representational modalities , 2011, Cognition.

[21]  Hans-Jochen Heinze,et al.  Scanning silence: Mental imagery of complex sounds , 2005, NeuroImage.

[22]  M. Lindquist,et al.  Meta-analysis of functional neuroimaging data: current and future directions. , 2007, Social cognitive and affective neuroscience.

[23]  Leslie G. Ungerleider,et al.  Distributed Neural Systems for the Generation of Visual Images , 2000, Neuron.

[24]  Senichiro Kikuchi,et al.  Cerebral activation focusing on strong tasting food: a functional magnetic resonance imaging study , 2005, Neuroreport.

[25]  M. Petrides,et al.  Functional activation of the human brain during mental rotation , 1997, Neuropsychologia.

[26]  Guinevere F. Eden,et al.  Meta-Analysis of the Functional Neuroanatomy of Single-Word Reading: Method and Validation , 2002, NeuroImage.

[27]  Angela M. Uecker,et al.  ALE meta‐analysis: Controlling the false discovery rate and performing statistical contrasts , 2005, Human brain mapping.

[28]  Seung-Schik Yoo,et al.  Human brain mapping of auditory imagery: event-related functional MRI study , 2001, Neuroreport.

[29]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[30]  B. Bertenthal,et al.  Does Perception of Biological Motion Rely on Specific Brain Regions? , 2001, NeuroImage.

[31]  Bradley R. Buchsbaum,et al.  The Search for the Phonological Store: From Loop to Convolution , 2008, Journal of Cognitive Neuroscience.

[32]  M. Kiefer,et al.  The Sound of Concepts: Four Markers for a Link between Auditory and Conceptual Brain Systems , 2008, The Journal of Neuroscience.

[33]  M. Farah,et al.  A functional MRI study of mental image generation , 1997, Neuropsychologia.

[34]  P. Dechent,et al.  Is the human primary motor cortex involved in motor imagery? , 2004, Brain research. Cognitive brain research.

[35]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[36]  E. Wist,et al.  A mental route to motor learning: Improving trajectorial kinematics through imagery training , 1998, Behavioural Brain Research.

[37]  M. Petrides,et al.  Functional neuroimaging of odor imagery , 2005, NeuroImage.

[38]  W. K. Simmons,et al.  A common neural substrate for perceiving and knowing about color , 2007, Neuropsychologia.

[39]  Karl J. Friston,et al.  The Trouble with Cognitive Subtraction , 1996, NeuroImage.

[40]  E. Warrington,et al.  Categories of knowledge. Further fractionations and an attempted integration. , 1987, Brain : a journal of neurology.

[41]  R Todd Constable,et al.  Trying to detect taste in a tasteless solution: modulation of early gustatory cortex by attention to taste. , 2007, Chemical senses.

[42]  F. Craik,et al.  Levels of Pro-cessing: A Framework for Memory Research , 1975 .

[43]  Rieko Osu,et al.  The Neural Substrates of Biological Motion Perception: an fMRI Study , 2022 .

[44]  E T Bullmore,et al.  The functional anatomy of imagining and perceiving colour , 1998, Neuroreport.

[45]  B. Gulyás Neural networks for internal reading and visual imagery of reading: a PET study , 2001, Brain Research Bulletin.

[46]  R. Poldrack Can cognitive processes be inferred from neuroimaging data? , 2006, Trends in Cognitive Sciences.

[47]  S. Kosslyn,et al.  Visual mental imagery induces retinotopically organized activation of early visual areas. , 2005, Cerebral cortex.

[48]  Rutvik H. Desai,et al.  The neurobiology of semantic memory , 2011, Trends in Cognitive Sciences.

[49]  S. Kosslyn,et al.  Neural Systems Shared by Visual Imagery and Visual Perception: A Positron Emission Tomography Study , 1997, NeuroImage.

[50]  Tim Shallice,et al.  The different neural correlates of action and functional knowledge in semantic memory: an FMRI study. , 2008, Cerebral cortex.

[51]  J. Fiez,et al.  Functional heterogeneity within Broca's area during verbal working memory , 2002, Physiology & Behavior.

[52]  W. Singer,et al.  The constructive nature of vision: direct evidence from functional magnetic resonance imaging studies of apparent motion and motion imagery , 1998, The European journal of neuroscience.

[53]  Sharon L. Thompson-Schill,et al.  Color, Context, and Cognitive Style: Variations in Color Knowledge Retrieval as a Function of Task and Subject Variables , 2011, Journal of Cognitive Neuroscience.

[54]  S. Thompson-Schill Neuroimaging studies of semantic memory: inferring “how” from “where” , 2003, Neuropsychologia.

[55]  Lars-Göran Nilsson,et al.  Reactivation of Motor Brain Areas during Explicit Memory for Actions , 2001, NeuroImage.

[56]  H. Heinze,et al.  Cortical Activations during the Mental Rotation of Different Visual Objects , 2001, NeuroImage.

[57]  S. Kosslyn,et al.  Neural foundations of imagery , 2001, Nature Reviews Neuroscience.

[58]  Robyn T. Oliver,et al.  Remembrance of things touched: How sensorimotor experience affects the neural instantiation of object form , 2009, Neuropsychologia.

[59]  Angela R. Laird,et al.  Activation likelihood estimation meta-analysis revisited , 2012, NeuroImage.

[60]  S. Petersen,et al.  Memory's echo: vivid remembering reactivates sensory-specific cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[61]  Amanda L. Kaas,et al.  Imagery of a moving object: The role of occipital cortex and human MT/V5+ , 2010, NeuroImage.

[62]  J. Decety,et al.  Effect of subjective perspective taking during simulation of action: a PET investigation of agency , 2001, Nature Neuroscience.

[63]  E. T Bullmore,et al.  Cortical activity during rotational and linear transformations , 2000, Neuropsychologia.

[64]  Noriaki Hattori,et al.  Functional Imaging of Gustatory Perception and Imagery: Btop-downq Processing of Gustatory Signals , 2004 .

[65]  Hadas Lapid,et al.  The Privileged Brain Representation of First Olfactory Associations , 2009, Current Biology.

[66]  Floris P. de Lange,et al.  Motor Imagery in Mental Rotation: An fMRI Study , 2002, NeuroImage.

[67]  Sergio E. Chaigneau,et al.  THE SIMILARITY-IN-TOPOGRAPHY PRINCIPLE: RECONCILING THEORIES OF CONCEPTUAL DEFICITS , 2003, Cognitive neuropsychology.

[68]  B. Gulyás,et al.  Visual memory, visual imagery, and visual recognition of large field patterns by the human brain: functional anatomy by positron emission tomography. , 1995, Cerebral cortex.

[69]  Jonathan E. Jennings,et al.  An fMRI version of the Farnsworth-Munsell 100-Hue test reveals multiple color-selective areas in human ventral occipitotemporal cortex. , 1999, Cerebral cortex.

[70]  C. Richards,et al.  Brain activity during visual versus kinesthetic imagery: An fMRI study , 2009, Human brain mapping.

[71]  Sharlene D. Newman,et al.  Imagining material versus geometric properties of objects: an fMRI study. , 2005, Brain research. Cognitive brain research.

[72]  M. Hallett,et al.  Functional properties of brain areas associated with motor execution and imagery. , 2003, Journal of neurophysiology.

[73]  Ivan Toni,et al.  Neural Topography and Content of Movement Representations , 2005, Journal of Cognitive Neuroscience.

[74]  S. Kosslyn,et al.  Visual Mental Imagery Activates Topographically Organized Visual Cortex: PET Investigations , 1993, Journal of Cognitive Neuroscience.

[75]  Stephen R. Arnott,et al.  The Functional Organization of Auditory Working Memory as Revealed by fMRI , 2005, Journal of Cognitive Neuroscience.

[76]  L. Tyler,et al.  Towards a distributed account of conceptual knowledge , 2001, Trends in Cognitive Sciences.

[77]  K. Petersson,et al.  Cortical Brain Regions Associated with Color Processing: An FMRi Study , 2010, The open neuroimaging journal.

[78]  Seung-Schik Yoo,et al.  Neural substrates of tactile imagery: a functional MRI study , 2003, Neuroreport.

[79]  R. Dolan,et al.  Human orbitofrontal cortex mediates extinction learning while accessing conditioned representations of value , 2004, Nature Neuroscience.

[80]  Thomas Dierks,et al.  Tracking the Mind's Image in the Brain II Transcranial Magnetic Stimulation Reveals Parietal Asymmetry in Visuospatial Imagery , 2002, Neuron.

[81]  Richard S. J. Frackowiak,et al.  The role of the right hemisphere in the interpretation of figurative aspects of language. A positron emission tomography activation study. , 1994, Brain : a journal of neurology.

[82]  M. Denis,et al.  Functional Anatomy of Spatial Mental Imagery Generated from Verbal Instructions , 1996, The Journal of Neuroscience.

[83]  Zenon W. Pylyshyn,et al.  What the Mind’s Eye Tells the Mind’s Brain: A Critique of Mental Imagery , 1973 .

[84]  E. Tulving,et al.  Reactivation of encoding-related brain activity during memory retrieval. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[85]  Kenichi Ohki,et al.  Conversion of Working Memory to Motor Sequence in the Monkey Premotor Cortex , 2003, Science.

[86]  A. D’Ausilio,et al.  An fMRI investigation on image generation in different sensory modalities: the influence of vividness. , 2009, Acta psychologica.

[87]  D. Wolpert,et al.  Maintaining internal representations: the role of the human superior parietal lobe , 1998, Nature Neuroscience.