The impending demise of the icon: A critique of the concept of iconic storage in visual information processing

Abstract Without disputing the experimental evidence that subjects have available most of the content of brief displays for a fraction of a second, or that visual stimuli Persist after their physical termination for a similar time, I argue that this evidence is irrelevant to perception. Specifically, the notion of an icon as a brief storage of information persisting after stimulus termination cannot possibly be useful in any typical visual information-processing task except reading in a lightning storm. Since the visual world that provides the stimuli for perception is continuous and not chopped up by tachistoscopes, and since our eyes and heads are rarely motionless, no realistic circumstances exist in which having a frozen iconic storage of information could be helpful. Rather, the presence of such an icon interferes with perception. This paper examines instances of normal perception, and then reviews experimental evidence on temporal integration, saccadic suppression, masking, and the photoreceptor basis of visual persistence, to further demonstrate that a storage of excitation cannot be a useful device for storing information. Finally, I note that little would have to be changed in our theories of visual perception or information processing if we simply forgot all about the icon and iconic memory as an early stage of processing.

[1]  W. James,et al.  The Principles of Psychology. , 1983 .

[2]  Stillso n The Psychology of Vision , 1932 .

[3]  H. K. Hartline,et al.  THE RESPONSE OF SINGLE OPTIC NERVE FIBERS OF THE VERTEBRATE EYE TO ILLUMINATION OF THE RETINA , 1938 .

[4]  R T SAUCER,et al.  The nature of perceptual processes. , 1953, Science.

[5]  R T SAUCER,et al.  Processes of motion perception. , 1954, Science.

[6]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[7]  D. Broadbent Perception and communication , 1958 .

[8]  A. J. Seyler,et al.  Measurements of Temporal Adaptation to Spatial Detail Vision , 1959, Nature.

[9]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[10]  J. Brown Evidence for a selective process during perception of tachistoscopically presented stimuli. , 1960, Journal of experimental psychology.

[11]  E. Averbach,et al.  Short-term memory in vision , 1961 .

[12]  P. Latour Visual threshold during eye movements , 1962 .

[13]  Bela Julesz,et al.  Lower Limits of Auditory Periodicity Analysis , 1963 .

[14]  G. Sperling A Model for Visual Memory Tasks1 , 1963, Human factors.

[15]  Edward C. Carterette,et al.  Effect of False Information on Responses in a Signal‐Detection Task , 1963 .

[16]  R. Conrad,et al.  Acoustic confusions in immediate memory. , 1964 .

[17]  B JULESZ,et al.  Binocular Depth Perception without Familiarity Cues , 1964, Science.

[18]  Mitsuo Ikeda,et al.  Temporal Summation of Positive and Negative Flashes in the Visual System , 1965 .

[19]  D. Kahneman Time-intensity reciprocity under various conditions of adaptation and backward masking. , 1966, Journal of experimental psychology.

[20]  Robert B. Ash,et al.  Information Theory , 2020, The SAGE International Encyclopedia of Mass Media and Society.

[21]  J. Gibson The Senses Considered As Perceptual Systems , 1967 .

[22]  C W Eriksen,et al.  Some temporal characteristics of visual pattern perception. , 1967, Journal of experimental psychology.

[23]  D J Mewhort,et al.  Familiarity of letter sequences, response uncertainty, and the tachistoscopic recognition experiment. , 1967, Canadian journal of psychology.

[24]  G. Sperling,et al.  Successive approximations to a model for short term memory. , 1967, Acta psychologica.

[25]  R. H. Day,et al.  Studies in perception , 1968 .

[26]  J. Gibson,et al.  The change from visible to invisible: , 1969 .

[27]  George A. Kaplan,et al.  Kinetic disruption of optical texture: The perception of depth at an edge , 1969 .

[28]  D. J. K. Mewhort,et al.  On the transfer from iconic to short-term memory , 1969 .

[29]  R. Haber Information-processing approaches to visual perception , 1969 .

[30]  R. Haber,et al.  Direct Measures of Short-Term Visual Storage , 1969, The Quarterly journal of experimental psychology.

[31]  Saul Sternberg,et al.  The discovery of processing stages: Extensions of Donders' method , 1969 .

[32]  R. Efron,et al.  Effect of stimulus duration on perceptual onset and offset latencies , 1970 .

[33]  Donald A. Norman,et al.  Models Of Human Memory , 1970 .

[34]  David E. Rumelhart,et al.  A multicomponent theory of the perception of briefly exposed visual displays , 1970 .

[35]  R. Haber,et al.  Direct estimates of the apparent duration of a flash. , 1970 .

[36]  R Efron,et al.  The minimum duration of a perception. , 1970, Neuropsychologia.

[37]  A. Mack An investigation of the relationship between eye and retinal image movement in the perception of movement , 1970 .

[38]  R. Haber,et al.  Contemporary theory and research in visual perception , 1970 .

[39]  Dick Ao,et al.  Visual processing and the use of redundant information in tachistoscopic recognition. , 1970 .

[40]  Dick Ao,et al.  On the problem of selection in short-term visual (iconic) memory. , 1971 .

[41]  D. H. Kelly Theory of flicker and transient responses. II. Counterphase gratings. , 1971, Journal of the Optical Society of America.

[42]  David N. Lee,et al.  Binocular stereopsis without spatial disparity , 1971 .

[43]  D H Holding,et al.  The Amount Seen in Brief Exposures , 1971, The Quarterly journal of experimental psychology.

[44]  Michael T. Turvey,et al.  An auditory analogue of the sperling partial report procedure: Evidence for brief auditory storage , 1972 .

[45]  Dick Ao,et al.  Parellel and serial processing in tachistoscopic recognition: two mechanisms. , 1972 .

[46]  Dennis H. Holding,et al.  Brief visual memory for English and Arabic letters , 1972 .

[47]  M. Turvey On peripheral and central processes in vision: inferences from an information-processing analysis of masking with patterned stimuli. , 1973, Psychological review.

[48]  R. Haber,et al.  The psychology of visual perception , 1973 .

[49]  G. Johansson Visual perception of biological motion and a model for its analysis , 1973 .

[50]  B. Butler,et al.  Components of the familiarity effect in tachistoscopic recognition. , 1973, Journal of experimental psychology.

[51]  Lester A. Lefton,et al.  Metacontrast: A review. , 1973 .

[52]  A. O. Dick,et al.  Effect of eye movements on backward masking and perceived location , 1973 .

[53]  Robert Sekuler,et al.  Handbook of Sensory Physiology, Vol. 7/4, Visual Psychophysics , 1973 .

[54]  Bela Julesz,et al.  Short-Term Memory for Stroboscopic Movement Perception , 1973 .

[55]  C. Tyler Temporal characteristics in apparent movement: omega movement vs. phi movement. , 1973, The Quarterly journal of experimental psychology.

[56]  B. Amblard,et al.  Backward and forward masking in the perception of cutaneous stimuli , 1973 .

[57]  J Ross,et al.  Short-term memory in stereopsis. , 1974, Vision research.

[58]  V Di Lollo,et al.  Backward masking and interference with the processing of brief visual displays. , 1974, Journal of experimental psychology.

[59]  L A Lefton,et al.  Information extraction from different retinal locations. , 1974, Journal of experimental psychology.

[60]  O. Braddick A short-range process in apparent motion. , 1974, Vision research.

[61]  W. A. Phillips On the distinction between sensory storage and short-term visual memory , 1974 .

[62]  A. Hodgkin,et al.  Changes in time scale and sensitivity in turtle photoreceptors , 1974, The Journal of physiology.

[63]  B. Butler,et al.  The limits of selective attention in tachistoscopic recognition. , 1974, Canadian journal of psychology.

[64]  J H Hogben,et al.  Perceptual integration and perceptual segregation of brief visual stimuli. , 1974, Vision research.

[65]  Ralph Norman Haber,et al.  Chapter 16 – INFORMATION PROCESSING , 1974 .

[66]  F Metelli,et al.  The perception of transparency. , 1974, Scientific American.

[67]  J. Pola,et al.  Visual persistence: effects of flash luminance, duration and energy. , 1974, Vision research.

[68]  G. Johansson Visual motion perception. , 1975, Scientific American.

[69]  Bruno G. Breitmeyer,et al.  Simple reaction time as a measure of the temporal response properties of transient and sustained channels , 1975, Vision Research.

[70]  L. Stark,et al.  Dynamic overshoot in saccadic eye movements is caused by neurological control signal reversals , 1975, Experimental Neurology.

[71]  R. Klatzky Human Memory: Structures And Processes , 1975 .

[72]  Lawrence Stark,et al.  Overlapping saccades and glissades are produced by fatigue in the saccadic eye movement system , 1975, Experimental Neurology.

[73]  D H Holding,et al.  Sensory storage reconsidered , 1975, Memory & cognition.

[74]  M Coltheart,et al.  Iconic memory: A reply to Professor Holding , 1975, Memory & cognition.

[75]  B. Sakitt,et al.  Locus of short-term visual storage , 1975, Science.

[76]  P Tynan,et al.  Moving visual phantoms: a new contour completion effect. , 1975, Science.

[77]  Brian E. Butler,et al.  Selective Attention and Target Search with Brief Visual Displays , 1975 .

[78]  U. Neisser,et al.  Selective looking: Attending to visually specified events , 1975, Cognitive Psychology.

[79]  Bruce Bridgeman,et al.  Failure to detect displacement of the visual world during saccadic eye movements , 1975, Vision Research.

[80]  D. Massaro Experimental psychology and information processing , 1975 .

[81]  W. Wolf,et al.  Perceptual latencies to sinusoidal gratings , 1976, Vision Research.

[82]  Myron L. Braunstein,et al.  5 – Slant Perception , 1976 .

[83]  D. Mackay Perceptual conflict between visual motion and change of location , 1976, Vision Research.

[84]  Bela Julesz,et al.  Short-term memory for symmetry , 1976, Vision Research.

[85]  D E Erwin,et al.  Further evidence for two components in visual persistence. , 1976, Journal of experimental psychology. Human perception and performance.

[86]  G Johansson,et al.  Spatio-temporal differentiation and integration in visual motion perception , 1976, Psychological research.

[87]  C. W. White Visual masking during pursuit eye movements. , 1976, Journal of experimental psychology. Human perception and performance.

[88]  Harry Singer,et al.  Theoretical models and processes of reading , 1976 .

[89]  M. S. Mayzner,et al.  Cognition And Reality , 1976 .

[90]  P. E. Hallett,et al.  Saccadic eye movements to flashed targets , 1976, Vision Research.

[91]  D Marr,et al.  Early processing of visual information. , 1976, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[92]  M. Ritter Evidence for visual persistence during saccadic eye movements , 1976, Psychological research.

[93]  J. Senders,et al.  Eye Movements and Psychological Processes , 1976 .

[94]  M. Braunstein Depth perception through motion , 1976 .

[95]  B G Breitmeyer,et al.  Implications of sustained and transient channels for theories of visual pattern masking, saccadic suppression, and information processing. , 1976, Psychological review.

[96]  A. Vassilev,et al.  Perception time and spatial frequency , 1976, Vision Research.

[97]  C F Michaels,et al.  Motion information in iconic memory. , 1976, Acta psychologica.

[98]  C W Eriksen,et al.  Do noise masks terminate target processing? , 1977, Memory & cognition.

[99]  V. Lollo,et al.  Temporal characteristics of iconic memory , 1977, Nature.

[100]  D. B. Bender,et al.  Contributions of the corpus callosum and the anterior commissure to visual activation of inferior temporal neurons , 1977, Brain Research.

[101]  M. Morgan Differential visual persistence between the two eyes: a model for the Fertsch-Pulfrich effect. , 1977, Journal of experimental psychology. Human perception and performance.

[102]  W. Maguire,et al.  Spatial frequency and the mediation of short-term visual storage , 1977, Science.

[103]  M. P. Friedman,et al.  HANDBOOK OF PERCEPTION , 1977 .

[104]  Michael T. Turvey,et al.  Contrasting orientations to the theory of visual information processing. , 1977 .

[105]  P Lennie,et al.  Convergence of rod and cone signals in the cat's retina , 1977, The Journal of physiology.

[106]  William P. Banks,et al.  Color information in iconic memory. , 1977, Psychological review.

[107]  G. McConkie,et al.  Eye movements and integrating information across fixations. , 1978, Journal of experimental psychology. Human perception and performance.

[108]  D. Robinson,et al.  Parietal association cortex in the primate: sensory mechanisms and behavioral modulations. , 1978, Journal of neurophysiology.

[109]  S. Zeki,et al.  The cortical projections of foveal striate cortex in the rhesus monkey. , 1978, The Journal of physiology.

[110]  D J Mewhort,et al.  Processing spatial information and the selective-masking effect , 1978, Perception & psychophysics.

[111]  F. Campbell,et al.  Saccadic omission: Why we do not see a grey-out during a saccadic eye movement , 1978, Vision Research.

[112]  D W Kline,et al.  Examination of stimulus persistence as the basis for superior visual identification performance among older adults. , 1978, Journal of gerontology.

[113]  F. W. Campbell,et al.  Grey-out elimination: The roles of spatial waveform, frequency and phase , 1978, Vision Research.

[114]  W. Wolf,et al.  How presaccadic gratings modify postsaccadic modulation transfer function , 1978, Vision Research.

[115]  R. Haber Twenty years of haunting eidetic imagery: where's the ghost? , 1979, Behavioral and Brain Sciences.

[116]  Edward H. Adelson,et al.  Visual persistence without the rods , 1979 .

[117]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[118]  L. Nilsson Perspectives on memory research , 1979 .

[119]  G L Shulman,et al.  Two definitions of persistence in visual perception , 1979, Perception & psychophysics.

[120]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[121]  W. Lovegrove,et al.  The Effect of Spatial Frequency and Contrast on Visual Persistence , 1979, Perception.

[122]  Paul A. Kolers,et al.  Processing of visible language , 1979 .

[123]  S. Coren,et al.  In Sensation and perception , 1979 .

[124]  M T Turvey,et al.  Central sources of visual masking: Indexing structures supporting seeing at a single, brief glance , 1979, Psychological research.

[125]  Robert W. Hammon,et al.  Component analysis of the foveal local electroretinogram elicited with sinusoidal flicker , 1979, Vision Research.

[126]  G. McConkie,et al.  Is visual information integrated across successive fixations in reading? , 1979, Perception & psychophysics.

[127]  Dominic W. Massaro,et al.  Reading and Listening (Tutorial Paper) , 1979 .

[128]  D. Massaro,et al.  Selective perception without confounding contributions of decision and memory , 1979, Perception & psychophysics.

[129]  Gerald M. Long,et al.  Commenton Hawkins and Shulman’s Type I and Type II visual persistence , 1979 .

[130]  M. Coltheart,et al.  Iconic memory and visible persistence , 1980, Perception & psychophysics.

[131]  B. Breitmeyer Unmasking visual masking: a look at the "why" behind the veil of the "how". , 1980, Psychological review.

[132]  E. Hearst The First Century of Experimental Psychology , 1980 .

[133]  Thomas Schulz,et al.  Iconic memory — an artifact of perceptual reconstruction processes? , 1980 .

[134]  D. Sparks,et al.  Dissociation of visual and saccade-related responses in superior colliculus neurons. , 1980, Journal of neurophysiology.

[135]  B. Bridgeman Temporal response characteristics of cells in monkey striate cortex measured with metacontrast masking and brightness discrimination , 1980, Brain Research.

[136]  W. Lovegrove,et al.  The effect of stimulus duration on the persistence of gratings , 1980, Perception & psychophysics.

[137]  H. Collewijn,et al.  Binocular retinal image motion during active head rotation , 1980, Vision Research.

[138]  D. Badcock,et al.  Specific reading disability: differences in contrast sensitivity as a function of spatial frequency. , 1980, Science.

[139]  V. Lollo Temporal integration in visual memory. , 1980 .

[140]  B. Butler,et al.  Selective attention and stimulus localization in visual perception. , 1980, Canadian journal of psychology.

[141]  Charles Samuel Harris,et al.  Visual coding and adaptability , 1980 .

[142]  B. Butler,et al.  The category effect in visual search: identification versus localization factors. , 1980, Canadian journal of psychology.

[143]  Gerald M. Long,et al.  Iconic memory: a review and critique of the study of short-term visual storage. , 1980, Psychological bulletin.

[144]  P. Merikle,et al.  Selection from visual persistence by perceptual groups and category membership. , 1980, Journal of experimental psychology. General.

[145]  R. Wurtz,et al.  Vision during saccadic eye movements. I. Visual interactions in striate cortex. , 1980, Journal of neurophysiology.

[146]  W. Wolf,et al.  Interaction of pre- and postsaccadic patterns having the same coordinates in space , 1980, Vision Research.

[147]  G. McConkie,et al.  Integrating information across eye movements , 1980, Cognitive Psychology.

[148]  J Jonides,et al.  The psychophysics of iconic storage. , 1980, Journal of experimental psychology. Human perception and performance.

[149]  P. C. Dodwell,et al.  New horizons in psychology 2 , 1980 .

[150]  G. S. Wasserman,et al.  Visual masking: mechanisms and theories. , 1980, Psychological bulletin.

[151]  H Naylor,et al.  Reading disability and lateral asymmetry: an information-processing analysis. , 1980, Psychological bulletin.

[152]  H. Sakata,et al.  Spatial properties of visual fixation neurons in posterior parietal association cortex of the monkey. , 1980, Journal of neurophysiology.

[153]  Robert K. Moore,et al.  Eyeblinks and visual suppression. , 1980, Science.

[154]  W P Banks,et al.  Normal iconic memory for stimuli invisible to the rods , 1980, Perception & psychophysics.

[155]  W. Lovegrove,et al.  Reading disability: Spatial frequency specific deficits in visual information store , 1980, Neuropsychologia.

[156]  R. Blake,et al.  Threshold and afterimage duration (A) , 1981 .

[157]  William Lovegrove,et al.  Two components to visible persistence: Effects of orientation and contrast , 1981, Vision Research.

[158]  J. Wilson,et al.  Visual persistence at both onset and offset of stimulation , 1981, Perception & psychophysics.

[159]  D. Robinson,et al.  Behavioral enhancement of visual responses in monkey cerebral cortex. I. Modulation in posterior parietal cortex related to selective visual attention. , 1981, Journal of neurophysiology.

[160]  Jamie I. D. Campbell,et al.  Identification, localization, and “iconic memory”: An evaluation of the bar-probe task , 1981, Memory & cognition.

[161]  J. Fodor,et al.  How direct is visual perception?: Some reflections on Gibson's “ecological approach” , 1981, Cognition.

[162]  B. Butler,et al.  Identification and localization in tachistoscopic recognition: the effects of data- and resource-limitations. , 1981, Canadian journal of psychology.

[163]  Vincent Di Lollo,et al.  Duration of visible persistence in relation to range of spatial frequencies. , 1981, Journal of experimental psychology. Human perception and performance.

[164]  J T Todd,et al.  Visual information about moving objects. , 1981, Journal of experimental psychology. Human perception and performance.

[165]  M. Goldberg,et al.  Behavioral enhancement of visual responses in monkey cerebral cortex. II. Modulation in frontal eye fields specifically related to saccades. , 1981, Journal of neurophysiology.

[166]  B. Julesz Textons, the elements of texture perception, and their interactions , 1981, Nature.

[167]  Gerald S. Wasserman,et al.  The photoreceptor sensory code for perceived duration during visual masking , 1981 .

[168]  Gerald M. Long,et al.  Differences between flicker and non-flicker persistence tasks: The effects of luminance and the number of cycles in a grating target , 1981, Vision Research.

[169]  David N. Lee,et al.  Plummeting gannets: a paradigm of ecological optics , 1981, Nature.

[170]  Arthur Wingfield,et al.  The psychology of human memory , 1981 .

[171]  J. H. Bertera,et al.  Masking of foveal and parafoveal vision during eye fixations in reading. , 1981, Journal of experimental psychology. Human perception and performance.

[172]  David R. Badcock,et al.  The Effects of Contrast, Stimulus Duration, and Spatial Frequency on Visible Persistence in Normal and Specifically Disabled Readers. , 1981 .

[173]  Gerald M. Long,et al.  Latency for the perceived offset of brief target gratings , 1981, Vision Research.

[174]  G M Long,et al.  Rod persistence on a partial-report task with scotopic and photopic backgrounds. , 1982, The American journal of psychology.

[175]  J. May,et al.  Meridional Differences in Temporal Resolution , 1982, Perception.

[176]  David E. Irwin,et al.  Integrating visual information from successive fixations. , 1982, Science.

[177]  W. Lovegrove,et al.  Iconic memory: Fallacies persist (?) , 1982, Perception & psychophysics.

[178]  D. F. Fisher,et al.  Eye movements : cognition and visual perception , 1982 .

[179]  P. R. Mccarthy,et al.  Target energy effects on Type 1 and Type 2 visual persistence , 1982 .

[180]  B. Julesz,et al.  The existence and role of retinotopic and spatiotopic forms of visual persistence. , 1982, Acta psychologica.

[181]  H. Wagner Flow-field variables trigger landing in flies , 1982, Nature.

[182]  G M Long,et al.  The case for peripheral persistence: effects of target and background luminance on a partial-report task. , 1982, Journal of experimental psychology. Human perception and performance.

[183]  Azriel Rosenfeld,et al.  Human and Machine Vision , 1983 .

[184]  B. Julesz,et al.  Human factors and behavioral science: Textons, the fundamental elements in preattentive vision and perception of textures , 1983, The Bell System Technical Journal.

[185]  K. Rayner,et al.  Eye Movements in Reading: Perceptual and Language Processes , 1985 .

[186]  G. E. MacKinnon,et al.  Reading Research Advances in Theory and Practice , 1985 .