The format of mental imagery: from a critical review to an integrated embodied representation approach

The issue of the format of mental imagery is still an open debate. The classical analogue (depictive)–propositional (descriptive) debate has not provided definitive conclusions. Over the years, the debate has shifted within the frame of the embodied cognition approach, which focuses on the interdependence of perception, cognition and action. Although the simulation approach still retains the concept of representation, the more radical line of the embodied cognition approach emphasizes the importance of action and clearly disregards the concept of representation. In particular, the enactive approach focuses on motor procedures that allow the body to interact with the environment, whereas the sensorimotor approach focuses on the possession and exercise of sensorimotor knowledge about how the sensory input changes as a function of movement. In this review, the embodied approaches are presented and critically discussed. Then, in an attempt to show that the format of mental imagery varies according to the ability and the strategy used to represent information, the role of individual differences in imagery ability (e.g., vividness and expertise) and imagery strategy (e.g., object vs. spatial imagers) is reviewed. Since vividness is mainly associated with perceptual information, reflecting the activation level of specific imagery systems, whereas the preferred strategy used is mainly associated with perceptual (e.g., object imagery) or amodal and motor information (e.g., spatial imagery), the format of mental imagery appears to be based on dynamic embodied representations, depending on imagery abilities and imagery strategies.

[1]  Adam Reeves,et al.  The relationship between self-reported vividness and latency during mental size scaling of everyday items: phenomenological evidence of different types of imagery. , 2007, The American journal of psychology.

[2]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[3]  Gaspare Galati,et al.  Where did you “left” Piazza del Popolo? At your “right” temporo-parietal junction , 2015, Cortex.

[4]  Kan Zhang,et al.  The effects of visual imagery on face identification: an ERP study , 2012, Front. Hum. Neurosci..

[5]  Petra Jansen,et al.  Different Mental Rotation Performance in Students of Music, Sport and Education. , 2012 .

[6]  Martin Volker Butz,et al.  Goal-oriented gaze strategies afforded by object interaction , 2015, Vision Research.

[7]  R. Zatorre,et al.  Behavioral and neural correlates of perceived and imagined musical timbre , 2004, Neuropsychologia.

[8]  M. Denis,et al.  Neural bases of image and language interactions , 2002 .

[9]  S. J. Segal,et al.  Influence of imaged pictures and sounds on detection of visual and auditory signals. , 1970, Journal of experimental psychology.

[10]  Cyriel M. A. Pennartz,et al.  Modality-specific and modality-independent components of the human imagery system , 2010, NeuroImage.

[11]  N. Callow,et al.  Efficacy of external and internal visual imagery perspectives for the enhancement of performance on tasks in which form is important. , 1999 .

[12]  Martin V. Butz,et al.  It's in the eyes: Planning precise manual actions before execution. , 2016, Journal of vision.

[13]  Zenon W. Pylyshyn,et al.  The Imagery Debate: Analogue Media Versus Tacit Knowledge , 1988 .

[14]  M. Wiesmann,et al.  Investigation of breathing parameters during odor perception and olfactory imagery. , 2008, Chemical senses.

[15]  Xabier E. Barandiaran,et al.  Sensorimotor Life: An enactive proposal , 2017 .

[16]  A. Fu,et al.  Imagery perspective among young athletes: Differentiation between external and internal visual imagery , 2015, Journal of sport and health science.

[17]  Marco Schieppati,et al.  Imagined and actual arm movements have similar durations when performed under different conditions of direction and mass , 2002, Experimental Brain Research.

[18]  R A Finke,et al.  Some consequences of visualization in pattern identification and detection. , 1986, The American journal of psychology.

[19]  Hans-Jochen Heinze,et al.  Scanning silence: Mental imagery of complex sounds , 2005, NeuroImage.

[20]  E. Bisiach,et al.  Unilateral Neglect of Representational Space , 1978, Cortex.

[21]  Dov Sagi,et al.  Visual Imagery: Effects of Short- and Long-Term Memory , 1997, Journal of Cognitive Neuroscience.

[22]  S. Kosslyn,et al.  When is early visual cortex activated during visual mental imagery? , 2003, Psychological bulletin.

[23]  Martin V. Butz,et al.  Anticipatory eye fixations reveal tool knowledge for tool interaction , 2016, Experimental Brain Research.

[24]  M. J. Intons-Peterson,et al.  Sensory-perceptual qualities of images. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[25]  Cheves West Perky An Experimental study of imagination. , 1910 .

[26]  S. Kosslyn Image and mind , 1982 .

[27]  J. Gibson The Senses Considered As Perceptual Systems , 1967 .

[28]  Massimiliano Palmiero,et al.  The Role of Vividness of Visual Mental Imagery on Different Dimensions of Creativity , 2011 .

[29]  Z. Pylyshyn,et al.  The rate of “mental rotation” of images: A test of a holistic analogue hypothesis , 1979, Memory & cognition.

[30]  J. Cusack Creative Cognition: Theory, Research, and Applications , 1994 .

[31]  M. Arterberry,et al.  Illusory" Illusory Conjunctions: The Conjoining of Features of Visual and Imagined Stimuli , 1999 .

[32]  R. Stevenson,et al.  Difficulty in evoking odor images: The role of odor naming , 2007, Memory & cognition.

[33]  Bruno Laeng,et al.  Eye scanpaths during visual imagery reenact those of perception of the same visual scene , 2002, Cogn. Sci..

[34]  Maria Kozhevnikov,et al.  The new object‐spatial‐verbal cognitive style model: Theory and measurement , 2009 .

[35]  Allan Paivio,et al.  Changes in associative strategies and paired-associate learning over trials as a function of work imagery and type of learning set , 1969 .

[36]  Alan Richardson,et al.  Verbalizer-visualizer: A cognitive style dimension. , 1977 .

[37]  Zenon W. Pylyshyn,et al.  What the Mind’s Eye Tells the Mind’s Brain: A Critique of Mental Imagery , 1973 .

[38]  H. Leuthold,et al.  The representation of pitch in auditory imagery: Evidence from S-R compatibility and distance effects , 2011 .

[39]  A. Wohlschläger Mental object rotation and the planning of hand movements , 2001, Perception & psychophysics.

[40]  Massimiliano Palmiero,et al.  The representation of conceptual knowledge: visual, auditory, and olfactory imagery compared with semantic processing , 2013, Cognitive Processing.

[41]  A. Zeman,et al.  The neural correlates of visual imagery: A co-ordinate-based meta-analysis , 2018, Cortex.

[42]  Michael A. Motes,et al.  Object-Spatial Imagery: A New Self-Report Imagery Questionnaire , 2006 .

[43]  Nicholas A Giudice,et al.  Journal of Experimental Psychology : Learning , Memory , and Cognition Functional Equivalence of Spatial Images From Touch and Vision : Evidence From Spatial Updating in Blind and Sighted Individuals , 2011 .

[44]  J. Ushiba,et al.  Subjective Vividness of Kinesthetic Motor Imagery Is Associated With the Similarity in Magnitude of Sensorimotor Event-Related Desynchronization Between Motor Execution and Motor Imagery , 2018, Front. Hum. Neurosci..

[45]  Marie S. Burrage,et al.  Two Forms of Spatial Imagery , 2009, Psychological science.

[46]  Jan Degenaar,et al.  Sensorimotor theory of consciousness , 2015, Scholarpedia.

[47]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[48]  Z. Pylyshyn Mental imagery: In search of a theory , 2002, Behavioral and Brain Sciences.

[49]  The limitations of a purely enactive (non-representational) account of imagery , 2011 .

[50]  D. Moreau,et al.  Enhancing Spatial Ability Through Sport Practice Evidence for an Effect of Motor Training on Mental Rotation Performance , 2012 .

[51]  S. Kosslyn Image and brain: the resolution of the imagery debate , 1994 .

[52]  D. Eton,et al.  The measurement of imagery vividness: A test of the reliability and validity of the Vividness of Visual Imagery Questionnaire and the Vividness of Movement Imagery Questionnaire. , 1998 .

[53]  M J Farah,et al.  Mechanisms of imagery-perception interaction. , 1989, Journal of experimental psychology. Human perception and performance.

[54]  C. Richards,et al.  Brain activity during visual versus kinesthetic imagery: An fMRI study , 2009, Human brain mapping.

[55]  L. Roelofs Why Imagining Requires Content: A Reply to a Reply to an Objection to Radical Enactive Cognition , 2018, Thought: A Journal of Philosophy.

[56]  Sergio Della Sala,et al.  Reflections on aphantasia , 2016, Cortex.

[57]  N. Gangopadhyay,et al.  Vision without representation , 2010 .

[58]  R. Finke,et al.  Principles of mental imagery , 1989 .

[59]  A. Paivio Imagery and verbal processes , 1972 .

[60]  Stephen M. Kosslyn,et al.  Mental rotation is not easily cognitively penetrable , 2010 .

[61]  Seung-Schik Yoo,et al.  Neural substrates of tactile imagery: a functional MRI study , 2003, Neuroreport.

[62]  Massimiliano Palmiero,et al.  Creativity and Mental Imagery , 2016 .

[63]  E. Reed The Ecological Approach to Visual Perception , 1989 .

[64]  Anne R. Isaac,et al.  Mental practice: Does it work in the field? , 1992 .

[65]  Akamatsu Shigeru,et al.  Investigating the Relation between Imagery and Perception: Evidence from Face Priming , 1997, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[66]  Alva Noë,et al.  Action in Perception , 2006, Representation and Mind.

[67]  André Dittmar,et al.  Relationship Between Visual and Kinesthetic Imagery, Field Dependence-Independence, and Complex Motor Skills , 2004 .

[68]  A. Foerster Perception Action And Consciousness Sensorimotor Dynamics And Two Visual Systems , 2016 .

[69]  R. Gordon An investigation into some of the factors that favour the formation of stereotyped images. , 1949, The British journal of psychology. General section.

[70]  Rainer Goebel,et al.  Dynamic Premotor-to-Parietal Interactions during Spatial Imagery , 2008, The Journal of Neuroscience.

[71]  Gian Luca Romani,et al.  Mental imagery generation in different modalities activates sensory-motor areas , 2009, Cognitive Processing.

[72]  R. Malach,et al.  Negative BOLD Differentiates Visual Imagery and Perception , 2005, Neuron.

[73]  A. Paivio Mental Representations: A Dual Coding Approach , 1986 .

[74]  Nigel J. T. Thomas Are theories of imagery theories of imagination?: An active perception approach to conscious mental content , 1999 .

[75]  Massimiliano Palmiero,et al.  Domain-Specificity of Creativity: A Study on the Relationship Between Visual Creativity and Visual Mental Imagery , 2015, Front. Psychol..

[76]  Samuel T. Moulton,et al.  Imagining predictions: mental imagery as mental emulation , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[77]  S M Kosslyn,et al.  Visual images preserve metric spatial information: evidence from studies of image scanning. , 1978, Journal of experimental psychology. Human perception and performance.

[78]  A Reeves,et al.  How visual imagery interferes with vision. , 1992, Psychological review.

[79]  M J Farah,et al.  Perceptual interference and facilitation with auditory imagery , 1983, Perception & psychophysics.

[80]  Kazuo Matsuoka,et al.  Effects of Auditory Imagery on the Detection of a Pure Tone in White Noise: Experimental Evidence of the Auditory Perky Effect , 1992, Perceptual and motor skills.

[81]  Catherine Plaisant,et al.  Non-visual exploration of geographic maps: Does sonification help? , 2010, Disability and rehabilitation. Assistive technology.

[82]  S. Hishitani,et al.  What is Vividness of Imagery? Characteristics of Vivid Visual Imagery , 1992, Perceptual and motor skills.

[83]  Olesya Blazhenkova Vividness of Object and Spatial Imagery , 2016, Perceptual and motor skills.

[84]  Rudolf Stark,et al.  The embodied nature of motor imagery: the influence of posture and perspective , 2009, Experimental Brain Research.

[85]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[86]  K M Heilman,et al.  Remote memory and neglect syndrome , 1987, Neurology.

[87]  Pawel Gladziejewski,et al.  Predictive coding and representationalism , 2016, Synthese.

[88]  M. Diamond,et al.  Primary Motor and Sensory Cortex Activation during Motor Performance and Motor Imagery: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[89]  Jan Frederik Sima The Nature of Mental Images - An Integrative Computational Theory , 2011, CogSci.

[90]  L. Barsalou Grounded cognition. , 2008, Annual review of psychology.

[91]  Robert J. Zatorre,et al.  Neuronal Correlates of Perception, Imagery, and Memory for Familiar Tunes , 2012, Journal of Cognitive Neuroscience.

[92]  Nigel J. T. Thomas The Multidimensional Spectrum of Imagination: Images, Dreams, Hallucinations, and Active, Imaginative Perception , 2014 .

[93]  J. O'Regan,et al.  A New Imagery Debate: Enactive and Sensorimotor Accounts , 2016 .

[94]  P Bartolomeo,et al.  The relationship between visuospatial and representational neglect , 1994, Neurology.

[95]  R. Stark,et al.  Activation of the Parieto-Premotor Network Is Associated with Vivid Motor Imagery—A Parametric fMRI Study , 2011, PloS one.

[96]  Bernhard E. Riecke,et al.  Embodied mental rotation: a special link between egocentric transformation and the bodily self , 2014, Front. Psychol..

[97]  Stephen M. Kosslyn,et al.  Inspecting visual mental images: Can people “see” implicit properties as easily in imagery and perception? , 2008, Memory & cognition.

[98]  J. Waller,et al.  Mind in Life: Biology, Phenomenology, and the Sciences of Mind , 2009 .

[99]  Y. Miyashita,et al.  Neuronal tuning to learned complex forms in vision. , 1994, Neuroreport.

[100]  Rick Grush,et al.  The emulation theory of representation: Motor control, imagery, and perception , 2004, Behavioral and Brain Sciences.

[101]  C. Delon-Martin,et al.  Odor mental imagery in non-experts in odors: a paradox? , 2013, Front. Hum. Neurosci..

[102]  M. J. Intons-Peterson,et al.  The role of pitch in auditory imagery. , 1992 .

[103]  Mark A. McDaniel,et al.  Memory for odors and odor names : Modalities of elaboration and imagery , 1990 .

[104]  Massimiliano Palmiero,et al.  Visualizer cognitive style enhances visual creativity , 2016, Neuroscience Letters.

[105]  F. Garbarini,et al.  At the root of embodied cognition: Cognitive science meets neurophysiology , 2004, Brain and Cognition.

[106]  Armando Tartaro,et al.  Intermodal sensory image generation: An fMRI analysis , 2004 .

[107]  P. Montague,et al.  Vividness of mental imagery: Individual variability can be measured objectively , 2007, Vision Research.

[108]  Vittorio Gallese,et al.  Motor abstraction: a neuroscientific account of how action goals and intentions are mapped and understood , 2009, Psychological research.

[109]  Maria Kozhevnikov,et al.  Visual-object ability: A new dimension of non-verbal intelligence , 2010, Cognition.

[110]  Andrew Faulkner,et al.  Vividness of Visual Imagery and Incidental Recall of Verbal Cues, When Phenomenological Availability Reflects Long-Term Memory Accessibility , 2013, Front. Psychology.

[111]  A. Clark Being There: Putting Brain, Body, and World Together Again , 1996 .

[112]  M. Petrides,et al.  Functional neuroimaging of odor imagery , 2005, NeuroImage.

[113]  Yanling Pi,et al.  Motor experience with a sport-specific implement affects motor imagery , 2018, PeerJ.

[114]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[115]  D. Voyer,et al.  Motor expertise and performance in spatial tasks: A meta-analysis. , 2017, Human movement science.

[116]  A. D’Ausilio,et al.  An fMRI investigation on image generation in different sensory modalities: the influence of vividness. , 2009, Acta psychologica.

[117]  Tian Feng,et al.  Selective Effects of Sport Expertise on the Stages of Mental Rotation Tasks With Object-Based and Egocentric Transformations , 2017, Advances in cognitive psychology.

[118]  J. Kalaska,et al.  Common codes for situated interaction , 2001 .

[119]  L. Hardy,et al.  Use of different imagery perspectives on the learning and performance of different motor skills. , 1995, British journal of psychology.

[120]  P. Jansen,et al.  The role of rotational hand movements and general motor ability in children’s mental rotation performance , 2015, Front. Psychol..

[121]  P. Sheehan,et al.  A shortened form of Betts' questionnaire upon mental imagery. , 1967, Journal of clinical psychology.

[122]  P. Pantano,et al.  Unilateral neglect restricted to visual imagery , 1993, Nature.

[123]  G. Romani,et al.  Commonalities between Visual Imagery and Imagery in Other Modalities; an Investigation by Means of fMRI , 2004 .

[124]  Giuseppe Iaria,et al.  Neglecting the Left Side of a City Square but Not the Left Side of Its Clock: Prevalence and Characteristics of Representational Neglect , 2013, PloS one.

[125]  Massimiliano Palmiero,et al.  Mental imagery skills predict the ability in performing environmental directional judgements , 2017, Experimental Brain Research.

[126]  F. Galton I.—STATISTICS OF MENTAL IMAGERY , 1880 .

[127]  Dahlia W. Zaidel,et al.  Creativity, brain, and art: biological and neurological considerations , 2014, Front. Hum. Neurosci..

[128]  Senichiro Kikuchi,et al.  Cerebral activation focusing on strong tasting food: a functional magnetic resonance imaging study , 2005, Neuroreport.

[129]  Fraser Milton,et al.  The neural correlates of visual imagery vividness – An fMRI study and literature review , 2017, Cortex.

[130]  Noriaki Hattori,et al.  Functional Imaging of Gustatory Perception and Imagery: Btop-downq Processing of Gustatory Signals , 2004 .

[131]  Martin Weichold,et al.  Evolving enactivism: basic minds meet content , 2018, Philosophical Psychology.

[132]  G. Curcio,et al.  Functional Role of Internal and External Visual Imagery: Preliminary Evidences from Pilates , 2018, Neural plasticity.

[133]  S. Kosslyn,et al.  Motor processes in mental rotation , 1998, Cognition.

[134]  D. F. Marks,et al.  Visual imagery differences in the recall of pictures. , 1973, British journal of psychology.

[135]  S. Kosslyn,et al.  Two types of image generation: Evidence from PET , 2005, Cognitive, affective & behavioral neuroscience.

[136]  Massimiliano Palmiero,et al.  How fMRI Technology Contributes to the Advancement of Research in Mental Imagery: A Review , 2011 .

[137]  S. Swinnen,et al.  Kinesthetic, but not visual, motor imagery modulates corticomotor excitability , 2005, Experimental Brain Research.

[138]  Richard Dewhurst,et al.  Eye movements during scene recollection have a functional role, but they are not reinstatements of those produced during encoding. , 2012, Journal of experimental psychology. Human perception and performance.

[139]  George Herbert Betts,et al.  The Distribution And Functions Of Mental Imagery , 1909 .

[140]  A. Halpern,et al.  Mental scanning in auditory imagery for songs. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[141]  Berit Brogaard,et al.  Unconscious Imagination and the Mental Imagery Debate , 2017, Front. Psychol..

[142]  Roger Johansson,et al.  Eye Movements During Mental Imagery are Not Reenactments of Perception , 2010 .

[143]  S. Gallagher How the body shapes the mind , 2005 .

[144]  Alice F. Healy,et al.  Expertise: defined, described, explained , 2014, Front. Psychol..

[145]  Reshanne R. Reeder Individual differences shape the content of visual representations , 2017, Vision Research.

[146]  Marina Basu The Embodied Mind: Cognitive Science and Human Experience , 2004 .

[147]  C. Delon-Martin,et al.  Experience induces functional reorganization in brain regions involved in odor imagery in perfumers , 2012, Human brain mapping.

[148]  D. Sagi,et al.  Common mechanisms of visual imagery and perception. , 1995, Science.

[149]  M. Hallett,et al.  Functional properties of brain areas associated with motor execution and imagery. , 2003, Journal of neurophysiology.

[150]  S. Kosslyn,et al.  The case for mental imagery , 2006 .

[151]  Sergio Della Sala,et al.  Lives without imagery – Congenital aphantasia , 2015, Cortex.

[152]  Keith R Laws Category-Specific Naming and Modality-Specific Imagery , 2002, Brain and Cognition.

[153]  V. Schöpf,et al.  The inability to self-evaluate smell performance. How the vividness of mental images outweighs awareness of olfactory performance , 2015, Front. Psychol..

[154]  D. F. Marks,et al.  Individual differences in mental imagery experience: developmental changes and specialization. , 1994, British journal of psychology.

[155]  M. Bassolino,et al.  PSYCHOLOGICAL SCIENCE Research Article Extended Multisensory Space in Blind Cane Users , 2022 .

[156]  Jennifer M. Shephard,et al.  Spatial versus object visualizers: A new characterization of visual cognitive style , 2005, Memory & cognition.

[157]  C. Pernet,et al.  Low and high imagers activate networks differentially in mental rotation , 2011, Neuropsychologia.

[158]  M. Petrides,et al.  The Mind's Nose , 2004, Psychological science.

[159]  Noam Sobel,et al.  Hedonic-specific activity in piriform cortex during odor imagery mimics that during odor perception. , 2007, Journal of neurophysiology.

[160]  Y. Rossetti,et al.  Prism adaptation improves representational neglect , 2001, Neuropsychologia.

[161]  Nigel J. T. Thomas,et al.  Visual Imagery and Consciousness , 2009 .

[162]  Emiliano Ricciardi,et al.  Peripersonal space representation develops independently from visual experience , 2017, Scientific Reports.

[163]  Michael Spittle,et al.  Imagery in Sport , 2005, Sport & Exercise Psychology Review.

[164]  A. Kappers,et al.  Differences between Early-Blind, Late-Blind, and Blindfolded-Sighted People in Haptic Spatial-Configuration Learning and Resulting Memory Traces , 2007, Perception.

[165]  D. Sagi,et al.  From the National Institutes of Health. , 1993, Journal of the American Medical Association (JAMA).

[166]  Marcel A J van Gerven,et al.  Vividness of Visual Imagery Depends on the Neural Overlap with Perception in Visual Areas , 2017, The Journal of Neuroscience.

[167]  Yann Coello,et al.  Motor representations and the perception of space: perceptual judgments of the boundary of action space , 2010 .

[168]  S. Kosslyn,et al.  Visual mental imagery and visual perception: Structural equivalence revealed by scanning processes , 2008, Memory & cognition.

[169]  H. Nakata,et al.  Motor imagery beyond the motor repertoire: Activity in the primary visual cortex during kinesthetic motor imagery of difficult whole body movements , 2016, Neuroscience.

[170]  M. Bensafi,et al.  Olfactomotor activity during imagery mimics that during perception , 2003, Nature Neuroscience.

[171]  G. Iaria,et al.  Mental imagery skills and topographical orientation in humans: A correlation study , 2008, Behavioural Brain Research.

[172]  R. Stevenson,et al.  Olfactory Dreams: Phenomenology, Relationship to Volitional Imagery and Odor Identification , 2004 .

[173]  Valentina Quaresima,et al.  The Key of the Maze: The role of mental imagery and cognitive flexibility in navigational planning , 2017, Neuroscience Letters.

[174]  Jeffrey M. Zacks,et al.  Neuroimaging Studies of Mental Rotation: A Meta-analysis and Review , 2008, Journal of Cognitive Neuroscience.

[175]  A. Baddeley,et al.  Working memory and the vividness of imagery. , 2000, Journal of experimental psychology. General.