The heterogeneity of mental representation: Ending the imagery debate

The possible ways that information can be represented mentally have been discussed often over the past thousand years. However, this issue could not be addressed rigorously until late in the 20th century. Initial empirical findings spurred a debate about the heterogeneity of mental representation: Is all information stored in propositional, language-like, symbolic internal representations, or can humans use at least two different types of representations (and possibly many more)? Here, in historical context, we describe recent evidence that humans do not always rely on propositional internal representations but, instead, can also rely on at least one other format: depictive representation. We propose that the debate should now move on to characterizing all of the different forms of human mental representation.

[1]  S. R. Cajal Textura del Sistema Nervioso del Hombre y de los Vertebrados, 1899–1904 , 2019 .

[2]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[3]  S. Kosslyn Scanning visual images:Some structural implications , 1973 .

[4]  Zenon W. Pylyshyn,et al.  What the Mind’s Eye Tells the Mind’s Brain: A Critique of Mental Imagery , 1973 .

[5]  Stephen M. Kosslyn,et al.  Image and mind , 1982 .

[6]  R. Weale Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[7]  G. Blasdel,et al.  Voltage-sensitive dyes reveal a modular organization in monkey striate cortex , 1986, Nature.

[8]  A. Paivio Dual coding theory: Retrospect and current status. , 1991 .

[9]  V. Mountcastle The columnar organization of the neocortex. , 1997, Brain : a journal of neurology.

[10]  S. Kosslyn,et al.  The role of area 17 in visual imagery: convergent evidence from PET and rTMS. , 1999, Science.

[11]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[12]  S. Kosslyn,et al.  Neural foundations of imagery , 2001, Nature Reviews Neuroscience.

[13]  D. Chklovskii,et al.  Maps in the brain: what can we learn from them? , 2004, Annual review of neuroscience.

[14]  S. Kosslyn,et al.  Visual mental imagery induces retinotopically organized activation of early visual areas. , 2005, Cerebral cortex.

[15]  Sooyoung Chung,et al.  Highly ordered arrangement of single neurons in orientation pinwheels , 2006, Nature.

[16]  D. Schacter,et al.  Remembering the past to imagine the future: the prospective brain , 2007, Nature Reviews Neuroscience.

[17]  Frank Tong,et al.  The Functional Impact of Mental Imagery on Conscious Perception , 2008, Current Biology.

[18]  L. Barsalou Grounded cognition. , 2008, Annual review of psychology.

[19]  J. Duncan,et al.  Top-Down Activation of Shape-Specific Population Codes in Visual Cortex during Mental Imagery , 2009, The Journal of Neuroscience.

[20]  Edward F. Ester,et al.  PSYCHOLOGICAL SCIENCE Research Article Stimulus-Specific Delay Activity in Human Primary Visual Cortex , 2022 .

[21]  Samuel T. Moulton,et al.  Imagining predictions: mental imagery as mental emulation , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[22]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[23]  Lera Boroditsky,et al.  Visual motion aftereffect from understanding motion language , 2010, Proceedings of the National Academy of Sciences.

[24]  Elinor Amit,et al.  You See, the Ends Don’t Justify the Means , 2012, Psychological science.

[25]  I. Toni,et al.  Shared Representations for Working Memory and Mental Imagery in Early Visual Cortex , 2013, Current Biology.

[26]  Y Kamitani,et al.  Neural Decoding of Visual Imagery During Sleep , 2013, Science.

[27]  Floris P. de Lange,et al.  Prior Expectations Evoke Stimulus Templates in the Primary Visual Cortex , 2014, Journal of Cognitive Neuroscience.

[28]  Joel Pearson,et al.  Phantom perception: voluntary and involuntary nonretinal vision , 2015, Trends in Cognitive Sciences.

[29]  Jack L. Gallant,et al.  A voxel-wise encoding model for early visual areas decodes mental images of remembered scenes , 2015, NeuroImage.

[30]  Anne Kuefer,et al.  The Case For Mental Imagery , 2016 .