The role of gist in scene recognition

Studies of change blindness suggest that we bring only a few attended features of a scene, plus a gist, from one visual fixation to the next. We examine the role of gist by substituting an original image with a second image in which a substitution of one object changes the gist, compared with a third image in which a substitution of that object does not change the gist. Small perceptual changes that affect gist were more rapidly detected than perceptual changes that do not affect gist. When the images were scrambled to remove meaning, this difference disappeared for seven of the nine sets, indicating that gist and not image features dominated the result. In a final experiment a natural image was masked with an 8x8 checker pattern, and progressively substituted by squares of a new natural image of the same gist. Spatial jitter prevented fixation on the same square for the sequence of 12 changes. Observers detected a change in an average of 2.1 out of 7 sequences, indicating strong change blindness for images of the same gist but completely different local features. We conclude that gist is automatically encoded, separately from specific features.

[1]  T. A. Ryan,et al.  Speed of perception as a function of mode of representation. , 1956, The American journal of psychology.

[2]  M. Pickering,et al.  Eye guidance in reading and scene perception , 1998 .

[3]  D. E. Irwin,et al.  Integration and accumulation of information across saccadic eye movements. , 1996 .

[4]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[5]  A. Friedman Framing pictures: the role of knowledge in automatized encoding and memory for gist. , 1979, Journal of experimental psychology. General.

[6]  James L. McClelland,et al.  Information integration in perception and communication , 1996 .

[7]  K. Rayner Eye movements and visual cognition : scene perception and reading , 1992 .

[8]  Bruce Bridgeman,et al.  Perceptual conditions necessary to induce change blindness , 2003 .

[9]  Carrick C. Williams,et al.  To see and remember: Visually specific information is retained in memory from previously attended objects in natural scenes , 2001, Psychonomic bulletin & review.

[10]  D. E. Irwin,et al.  Eye Movements And Visual Cognitive Suppression , 2003 .

[11]  D. Simons,et al.  Change Blindness in the Absence of a Visual Disruption , 2000, Perception.

[12]  D. Simons,et al.  CHAPTER 13 – Change Blindness , 2005 .

[13]  H. Intraub Rapid conceptual identification of sequentially presented pictures. , 1981 .

[14]  W. Brewer,et al.  Role of schemata in memory for places , 1981, Cognitive Psychology.

[15]  David E. Irwin Information integration across saccadic eye movements , 1991, Cognitive Psychology.

[16]  Iain D Gilchrist,et al.  Refixation frequency and memory mechanisms in visual search , 2000, Current Biology.

[17]  G. Brelstaff,et al.  Is the Richness of Our Visual World an Illusion? Transsaccadic Memory for Complex Scenes , 1995, Perception.

[18]  Christopher B. Currie,et al.  Visual stability across saccades while viewing complex pictures. , 1995, Journal of experimental psychology. Human perception and performance.

[19]  J Stoeckert,et al.  Picture memory: recognizing added and deleted details. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[20]  B. Bridgeman,et al.  Failure to integrate visual information from successive fixations , 1983 .

[21]  Gregory J Zelinsky,et al.  Detecting changes between real-world objects using spatiochromatic filters , 2003, Psychonomic bulletin & review.

[22]  Stephen R. Mitroff,et al.  Changes are not localized before they are explicitly detected , 2002 .

[23]  J. Henderson,et al.  Accurate visual memory for previously attended objects in natural scenes , 2002 .

[24]  S. Palmer Hierarchical structure in perceptual representation , 1977, Cognitive Psychology.

[25]  M. Potter,et al.  Recognition memory for a rapid sequence of pictures. , 1969, Journal of experimental psychology.

[26]  David E. Irwin,et al.  Integrating visual information from successive fixations. , 1982, Science.

[27]  D. E. Irwin Integrating Information Across Saccadic Eye Movements , 1996 .

[28]  I. Biederman Perceiving Real-World Scenes , 1972, Science.

[29]  G. Ritchey,et al.  Long-Term Memory for Pictures , 2005 .

[30]  J. Enns,et al.  Object Substitution: A New Form of Masking in Unattended Visual Locations , 1997 .

[31]  D. Simons,et al.  Detecting Changes in Novel, Complex Three-dimensional Objects , 2000 .

[32]  Andrew Hollingworth,et al.  Eye Movements During Scene Viewing: An Overview , 1998 .

[33]  Bonnie L. Angelone,et al.  Memory for centrally attended changing objects in an incidental real-world change detection paradigm. , 2002, British journal of psychology.

[34]  J. Wolfe Visual memory: What do you know about what you saw? , 1998, Current Biology.

[35]  Kevin J. Hawley,et al.  Perceptual inhibition of expected inputs: The key that opens closed minds , 1994, Psychonomic bulletin & review.

[36]  D. E. Irwin,et al.  Eye movements and the integration of visual memory and visual perception , 2005, Perception & psychophysics.

[37]  Ronald A. Rensink Seeing, sensing, and scrutinizing , 2000, Vision Research.

[38]  D. Simons,et al.  Failure to detect changes to people during a real-world interaction , 1998 .

[39]  R. Shepard Recognition memory for words, sentences, and pictures , 1967 .

[40]  Ronald A. Rensink,et al.  Change-blindness as a result of ‘mudsplashes’ , 1999, Nature.

[41]  Ronald A. Rensink,et al.  Change blindness: past, present, and future , 2005, Trends in Cognitive Sciences.

[42]  Mark W. Becker,et al.  Volatile visual representations: Failing to detect changes in recently processed information , 2002, Psychonomic bulletin & review.

[43]  J. O'Regan,et al.  Solving the "real" mysteries of visual perception: the world as an outside memory. , 1992, Canadian journal of psychology.

[44]  D. Simons In Sight, Out of Mind: When Object Representations Fail , 1996 .

[45]  H. Intraub,et al.  Wide-angle memories of close-up scenes. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[46]  Ian M Thornton,et al.  Explicit mechanisms do not account for implicit localization and identification of change: An empirical reply to Mitroff et al. (2002). , 2002, Journal of experimental psychology. Human perception and performance.

[47]  R. Nickerson,et al.  Long-term memory for a common object , 1979, Cognitive Psychology.

[48]  Bruce Bridgeman,et al.  Failure to detect displacement of the visual world during saccadic eye movements , 1975, Vision Research.

[49]  J. Henderson,et al.  Semantic Informativeness Mediates the Detection of Changes in Natural Scenes , 2000 .

[50]  Andrew Hollingworth,et al.  Sustained change blindness to incremental scene rotation: A dissociation between explicit change detection and visual memory , 2004, Perception & psychophysics.

[51]  A. Hollingworth Visual memory for natural scenes: Evidence from change detection and visual search , 2006 .

[52]  Ronald A. Rensink Visual Search for Change: A Probe into the Nature of Attentional Processing , 2000 .

[53]  Xandra van Montfort What makes a difference: A method to determine whether a change in an image affects the perceived gist , 2007 .

[54]  R. Haber,et al.  Perception and memory for pictures: Single-trial learning of 2500 visual stimuli , 1970 .

[55]  W. Epstein,et al.  Priming Spatial Layout of Scenes , 1997 .

[56]  J. Grimes On the failure to detect changes in scenes across saccades. , 1996 .

[57]  Ronald A. Rensink Change detection. , 2002, Annual review of psychology.

[58]  I. Biederman,et al.  Scene perception: Detecting and judging objects undergoing relational violations , 1982, Cognitive Psychology.

[59]  A. Friedman Framing pictures: the role of knowledge in automatized encoding and memory for gist. , 1979, Journal of experimental psychology. General.

[60]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[61]  J. Henderson,et al.  The Role of Fixation Position in Detecting Scene Changes Across Saccades , 1999 .

[62]  G. H. Freeman,et al.  Note on an exact treatment of contingency, goodness of fit and other problems of significance. , 1951, Biometrika.

[63]  D. E. Irwin,et al.  Eye movements and scene perception: Memory for things observed , 2002, Perception & psychophysics.

[64]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[65]  D. Simons,et al.  Failure to detect changes to attended objects in motion pictures , 1997 .

[66]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[67]  L. Standing Learning 10000 pictures , 1973 .

[68]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[69]  Ronald A. Rensink,et al.  On the Failure to Detect Changes in Scenes Across Brief Interruptions , 2000 .

[70]  H Intraub,et al.  Looking at pictures but remembering scenes. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[71]  John M. Henderson,et al.  Transsaccadic Memory and Integration During Real-World Object Perception , 1997 .

[72]  Alexander Pollatsek,et al.  What Is Integrated Across Fixations , 1992 .

[73]  Ronald A. Rensink,et al.  Picture Changes During Blinks: Looking Without Seeing and Seeing Without Looking , 2000 .