On the demystification of mental imagery

Abstract What might a theory of mental imagery look like, and how might one begin formulating such a theory? These are the central questions addressed in the present paper. The first section outlines the general research direction taken here and provides an overview of the empirical foundations of our theory of image representation and processing. Four issues are considered in succession, and the relevant results of experiments are presented and discussed. The second section begins with a discussion of the proper form for a cognitive theory, and the distinction between a theory and a model is developed. Following this, the present theory and computer simulation model are introduced. This theory specifies the nature of the internal representations (data structures) and the processes that operate on them when one generates, inspects, or transforms mental images. In the third, concluding, section we consider three very different kinds of objections to the present research program, one hinging on the possibility of experimental artifacts in the data, and the others turning on metatheoretical commitments about the form of a cognitive theory. Finally, we discuss how one ought best to evaluate theories and models of the sort developed here.

[1]  F. Galton.  Inquiries into Human Faculty and Its Development , 1883 .

[2]  S. Fiske,et al.  The Handbook of Social Psychology , 1935 .

[3]  G. Ryle,et al.  心的概念 = The concept of mind , 1962 .

[4]  A. Roe.  A study of imagery in research scientists. , 1951, Journal of personality.

[5]  James Strachey,et al.  The Interpretation of Dreams. , 1954 .

[6]  S. Arieti,et al.  Interpretation of Schizophrenia , 1955 .

[7]  S. Asch.  Studies of independence and conformity: I. A minority of one against a unanimous majority. , 1956 .

[8]  Seuss.  The Cat in the Hat Comes Back , 1958 .

[9]  G. Miller,et al.  Plans and the structure of behavior , 1960 .

[10]  I. Hunter.  An exceptional talent for calculative thinking. , 1962, British journal of psychology.

[11]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[12]  M. Orne.  On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. , 1962 .

[13]  P. Sheehan,et al.  THE EFFECT OF DEMAND CHARACTERISTICS ON THE FIGURAL AFTER-EFFECT WITH REAL AND IMAGED INDUCING FIGURES. , 1965, The American journal of psychology.

[14]  D. N. Spinelli,et al.  CENTRIFUGAL OPTIC NERVE RESPONSES EVOKED BY AUDITORY AND SOMATIC STIMULATION. , 1965, Experimental neurology.

[15]  D. N. Spinelli,et al.  Afferent and efferent activity in single units of the cat's optic nerve. , 1966, Experimental neurology.

[16]  F. Yates.  The Art of Memory , 1969 .

[17]  J. Gibson.  The Senses Considered As Perceptual Systems , 1967 .

[18]  P. Sheehan,et al.  A shortened form of Betts' questionnaire upon mental imagery. , 1967, Journal of clinical psychology.

[19]  D. N. Spinelli,et al.  Changes in visual recovery functions and unit activity produced by frontal and temporal cortex stimulation. , 1967, Electroencephalography and clinical neurophysiology.

[20]  L. Brooks.  The Suppression of Visualization by Reading , 1967, The Quarterly journal of experimental psychology.

[21]  J. Fodor.  Psychological Explanation; An Introduction to the Philosophy of Psychology , 1968 .

[22]  L. Brooks.  Spatial and verbal components of the act of recall. , 1968 .

[23]  N. Goodman.  Languages of Art , 1968 .

[24]  F. Attneave.  Triangles as ambiguous figures. , 1968, The American journal of psychology.

[25]  Janellen Huttenlocher,et al.  Constructing spatial images: A strategy in reasoning. , 1968 .

[26]  R. Rosenthal,et al.  Artifact in behavioral research , 1969 .

[27]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[28]  John J. L. Morton,et al.  Interaction of information in word recognition. , 1969 .

[29]  Herbert H. Clark,et al.  Linguistic processes in deductive reasoning. , 1969 .

[30]  K. Pribram.  The neurophysiology of remembering. , 1969, Scientific American.

[31]  R. Haber.  How we remember what we see. , 1970, Scientific American.

[32]  S. J. Segal,et al.  Influence of imaged pictures and sounds on detection of visual and auditory signals. , 1970, Journal of experimental psychology.

[33]  Edward E. Smith,et al.  Representations and retrieval processes in short-term memory: Recognition and recall of faces , 1970 .

[34]  G. Bower.  Analysis of a mnemonic device , 1970 .

[35]  Mary Hesse,et al.  Models and analogies in science , 1970 .

[36]  B. Bridgeman.  Metacontrast and lateral inhibition. , 1971, Psychological review.

[37]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[38]  A. Hannay,et al.  Mental Images: A Defence. , 1973 .

[39]  G. Ingersoll,et al.  A factor analysis of imagery tests , 1971 .

[40]  R. Sekuler,et al.  Speed of size scaling in human vision , 1972 .

[41]  D M Green,et al.  A neural timing theory for response times and the psychophysics of intensity. , 1972, Psychological review.

[42]  R. J. Weber,et al.  Is visual image sequencing under verbal control? , 1972, Journal of experimental psychology.

[43]  Peter W. Sheehan,et al.  The function and nature of imagery , 1972 .

[44]  R. Shepard,et al.  A chronometric study of mental paper folding , 1972 .

[45]  Carol Conrad.  Cognitive Economy in Semantic Memory. , 1972 .

[46]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[47]  S. Kosslyn.  Scanning visual images:Some structural implications , 1973 .

[48]  D. Meyer,et al.  Attention and Performance XIV , 1973 .

[49]  G. Bower,et al.  Human Associative Memory , 1973 .

[50]  J. D. Willis.  The art of memory as it dependeth upon places and ideas , 1973 .

[51]  Hilary Putnam,et al.  Reductionism and the nature of psychology , 1973 .

[52]  Zenon W. Pylyshyn,et al.  What the Mind’s Eye Tells the Mind’s Brain: A Critique of Mental Imagery , 1973 .

[53]  Irvin Rock,et al.  Orientation and form , 1974 .

[54]  G. Bower,et al.  Cognition in learning and memory , 1974 .

[55]  Arthur M Farley,et al.  VIPS: A Visual Imagery and Perception System; the Result of a Protocol Analysis. Volume I , 1974 .

[56]  Stephen K. Reed,et al.  Structural descriptions and the limitations of visual images* , 1974, Memory & cognition.

[57]  W. Chase,et al.  Visual information processing. , 1974 .

[58]  Lance J. Rips,et al.  Structure and process in semantic memory: A featural model for semantic decisions. , 1974 .

[59]  R. J. Weber,et al.  Visual imagery for words: the Hebb test. , 1974, Journal of experimental psychology.

[60]  W. Kintsch.  The representation of meaning in memory , 1974 .

[61]  Stephen Michael Kosslyn,et al.  Information representation in visual images , 1975, Cognitive Psychology.

[62]  G. Lea.  Chronometric Analysis of the Method of Loci. , 1975 .

[63]  C. Bundesen,et al.  Visual transformation of size. , 1975, Journal of experimental psychology. Human perception and performance.

[64]  L. Cooper.  Mental rotation of random two-dimensional shapes , 1975, Cognitive Psychology.

[65]  John Jonides,et al.  Imagery instructions improve memory in blind subjects , 1975 .

[66]  R. Shepard,et al.  Mental transformations in the identification of left and right hands. , 1975, Journal of experimental psychology. Human perception and performance.

[67]  A. Paivio.  Perceptual comparisons through the mind’s eye , 1975, Memory & cognition.

[68]  S. Kosslyn.  Using Imagery to Retrieve Semantic Information: A Developmental Study. , 1976 .

[69]  L. Cooper,et al.  Mental transformations and visual comparison processes: effects of complexity and similarity. , 1976, Journal of experimental psychology. Human perception and performance.

[70]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[71]  R. Shepard,et al.  Perceptual illusion of rotation of three-dimensional objects. , 1976, Science.

[72]  Patrick Henry Winston,et al.  The psychology of computer vision , 1976, Pattern Recognit..

[73]  John R. Anderson.  Language, Memory, and Thought , 1976 .

[74]  M. S. Mayzner,et al.  Cognition And Reality , 1976 .

[75]  S M Kosslyn,et al.  Can imagery be distinguished from other forms of internal representation? Evidence from studies of information retrieval times , 1976, Memory & cognition.

[76]  G. S. Marmor,et al.  Mental rotation by the blind: does mental rotation depend on visual imagery? , 1976, Journal of experimental psychology. Human perception and performance.

[77]  Marty J. Schmidt,et al.  Orientation-Specific Color Aftereffects Following Imagination. , 1977 .

[78]  Stephen M. Kosslyn,et al.  A Simulation of Visual Imagery , 1977, Cogn. Sci..

[79]  F. Hayes-Roth.  Critique of Turvey's "Contrasting orientations to the theory of visual information processing. , 1977, Psychology Review.

[80]  S. Kosslyn,et al.  Imagery, propositions, and the form of internal representations , 1977, Cognitive Psychology.

[81]  S. Kosslyn,et al.  Category and Continuum in Mental Comparisons. , 1977 .

[82]  Marvin Minsky,et al.  Plain Talk about Neurodevelopmental Epistemology , 1977, IJCAI.

[83]  S M Kosslyn,et al.  On the pictorial properties of visual images: effects of image size on memory for words. , 1977, Canadian journal of psychology.

[84]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[85]  S. Kosslyn.  Measuring the visual angle of the mind's eye , 1978, Cognitive Psychology.

[86]  Earl Hunt,et al.  Individual Differences in the Verification of Sentence-Picture Relationships , 1978 .

[87]  S M Kosslyn,et al.  Visual images preserve metric spatial information: evidence from studies of image scanning. , 1978, Journal of experimental psychology. Human perception and performance.

[88]  A. Friedman.  Memorial Comparisons without the "Mind's Eye" , 1978 .

[89]  Bruce Bridgeman,et al.  Distributed sensory coding applied to simulations of iconic storage and metacontrast , 1978 .

[90]  J. Keenan.  Psychological Issues Concerning Implication: Comments on "Psychology of Pragmatic Implication: Information Processing Between the Lines" by Harris and Monaco. , 1978 .

[91]  John R. Anderson.  Arguments concerning representations for mental imagery. , 1978 .

[92]  J R Beech,et al.  Visualization of Compound Scenes , 1978, Perception.

[93]  R. Ashton,et al.  Imagery ability and the identification of hands: a chronometric analysis. , 1978, Acta psychologica.

[94]  R. Wilton.  Explaining Imaginal Inference by Operations in a Propositional Format , 1978, Perception.

[95]  R. Shepard,et al.  Functional representations common to visual perception and imagination. , 1978, Journal of experimental psychology. Human perception and performance.

[96]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[97]  Allen R. Hanson,et al.  Computer Vision Systems , 1978 .

[98]  Ulric Neisser,et al.  Anticipations, images, and introspection , 1978, Cognition.

[99]  C. Bundesen,et al.  Size scaling in visual pattern recognition. , 1978, Journal of experimental psychology. Human perception and performance.

[100]  R. Siegler.  Children's Thinking : What Develops? , 1978 .

[101]  R. Shepard.  The mental image. , 1978 .

[102]  Lois Carolyn Boggess,et al.  Computational Interpretation of English Spatial Prepositions , 1979 .

[103]  Wassily Kandinsky,et al.  Point and Line to Plane , 1979 .

[104]  P. A. Kolers,et al.  Images, symbols, and skills. , 1979, Canadian journal of psychology.

[105]  E. Rosch,et al.  Cognition and Categorization , 1980 .

[106]  L. Stark,et al.  The trajectories of saccadic eye movements. , 1979, Scientific American.

[107]  Robert E. Moore,et al.  Memory for images of concealed objects: A reexamination of Neisser and Kerr. , 1979 .

[108]  Zenon W. Pylyshyn,et al.  Validating computational models: A critique of Anderson's indeterminacy of representation claim. , 1979 .

[109]  G. Shulman,et al.  Moving attention through visual space. , 1979, Journal of experimental psychology. Human perception and performance.

[110]  Z. Pylyshyn,et al.  The rate of “mental rotation” of images: A test of a holistic analogue hypothesis , 1979, Memory & cognition.

[111]  J. Reznick,et al.  Mental travel: some reservations. , 1979, Journal of experimental psychology. Human perception and performance.

[112]  Geoffrey E. Hinton.  Some Demonstrations of the Effects of Structural Descriptions in Mental Imagery , 1979, Cogn. Sci..

[113]  John R. Anderson,et al.  Further arguments concerning representations for mental imagery: A response to Hayes-Roth and Pylyshyn. , 1979 .

[114]  Frederick Hayes-Roth,et al.  Distinguishing theories of representation: A critique of Anderson's "Arguments concerning mental imagery." , 1979 .

[115]  R. Finke,et al.  The functional equivalence of mental images and errors of movement , 1979, Cognitive Psychology.

[116]  Z. Pylyshyn.  Computation and cognition: issues in the foundations of cognitive science , 1980, Behavioral and Brain Sciences.

[117]  C. L. Richman,et al.  Confirmed reservations: mental travel. , 1980, Journal of experimental psychology. Human perception and performance.

[118]  S. Pinker.  Mental imagery and the third dimension. , 1980, Journal of experimental psychology. General.

[119]  S. Kosslyn,et al.  Mental imagery acuity in the peripheral visual field. , 1980, Journal of experimental psychology. Human perception and performance.

[120]  J. Fodor.  Methodological solipsism considered as a research strategy in cognitive psychology , 1980, Behavioral and Brain Sciences.

[121]  S. Pinker,et al.  Emergent two-dimensional patterns in images rotated in depth. , 1980, Journal of experimental psychology. Human perception and performance.