Representation and perception of scenic layout

This paper presents a cognitive approach to on-line spatial perception within scenes. A theoretical framework is developed, based on the idea that experience with a scene can activate a complex representation of layout that facilitates subsequent processing of spatial relations within the scene. The representations integrate significant, relevant scenic information and are substantial in amount or extent. The representations are active across short periods of time and across changes in the retinal position of the image. These claims were supported in a series of experiments in which pictures of scenes (primes) facilitated subsequent spatial relations processing within the scenes. The prime-induced representations integrated object identity and layout, were broad in scope, involved both foreground and background information, and were effective across changes in image position.

[1]  E. Rosch,et al.  Cognition and Categorization , 1980 .

[2]  Heinrich H Bülthoff,et al.  Image-based object recognition in man, monkey and machine , 1998, Cognition.

[3]  J. Wolfe,et al.  Postattentive vision. , 2000, Journal of experimental psychology. Human perception and performance.

[4]  Thomas Sanocki Interaction of scale and time during object recognition , 2001 .

[5]  Barbara Tversky,et al.  11 Mental models of spatial relations and transformations from language , 1999 .

[6]  D. Meyer,et al.  Attention and Performance XIV , 1973 .

[7]  Kavitha Srinivas,et al.  Contrast and illumination effects on explicit and implicit measures of memory. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[8]  Deborah J. Aks,et al.  Visual search for direction of shading is influenced by apparent depth , 1992, Perception & psychophysics.

[9]  S. Palmer Hierarchical structure in perceptual representation , 1977, Cognitive Psychology.

[10]  E. Crook,et al.  Word Recognition , 2010 .

[11]  J. Jonides,et al.  On the Cost and Benefit of Cost and Benefit , 1984 .

[12]  V. S. Ramachandran,et al.  Perception of shape from shading , 1988, Nature.

[13]  J. Henderson,et al.  Object identification is isolated from scene semantic constraint: evidence from object type and token discrimination. , 1999, Acta psychologica.

[14]  T. McNamara,et al.  Multiple views of spatial memory , 1997 .

[15]  H. Intraub,et al.  Wide-angle memories of close-up scenes. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[16]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[17]  Timothy P. McNamara,et al.  Systems of Spatial Reference in Human Memory , 2001, Cognitive Psychology.

[18]  T. McNamara Mental representations of spatial relations , 1986, Cognitive Psychology.

[19]  W. E. Collins,et al.  Integrating pictorial information across eye movements. , 1984, Journal of experimental psychology. General.

[20]  Vincent Di Lollo,et al.  Temporal integration in visual memory. , 1980, Journal of experimental psychology. General.

[21]  Elizabeth S. Spelke,et al.  Sources of Flexibility in Human Cognition: Dual-Task Studies of Space and Language , 1999, Cognitive Psychology.

[22]  Ronald A. Rensink Visual Search for Change: A Probe into the Nature of Attentional Processing , 2000 .

[23]  Donald A. Norman,et al.  Explorations in Cognition , 1975 .

[24]  V. Bruce,et al.  Effects of lighting on the perception of facial surfaces. , 1996, Journal of experimental psychology. Human perception and performance.

[25]  L. Boroditsky Does Language Shape Thought?: Mandarin and English Speakers' Conceptions of Time , 2001, Cognitive Psychology.

[26]  Andrew Hollingworth,et al.  Eye Movements During Scene Viewing: An Overview , 1998 .

[27]  V. Bruce,et al.  Effects of lighting on the perception of facial surfaces. , 1996, Journal of experimental psychology. Human perception and performance.

[28]  G C Oden,et al.  A fuzzy logical model of letter identification. , 1979, Journal of experimental psychology. Human perception and performance.

[29]  I. Biederman,et al.  Dynamic binding in a neural network for shape recognition. , 1992, Psychological review.

[30]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[31]  D. E. Irwin Integrating Information Across Saccadic Eye Movements , 1996 .

[32]  David E. Irwin,et al.  The role of physical and conceptual properties in preserving object continuity. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[33]  I. Biederman Perceiving Real-World Scenes , 1972, Science.

[34]  Evelyne Corcos,et al.  Visual Processes in Reading and Reading Disabilities , 1993 .

[35]  J E Cutting,et al.  Wayfinding, displacements, and mental maps: velocity fields are not typically used to determine one's aimpoint. , 1995, Journal of experimental psychology. Human perception and performance.

[36]  H Pashler,et al.  Familiarity and visual change detection , 1988, Perception & psychophysics.

[37]  R. Efron,et al.  Effect of stimulus duration on perceptual onset and offset latencies , 1970 .

[38]  J. Stiles-Davis,et al.  Spatial cognition : brain bases and development , 1988 .

[39]  J. Grimes On the failure to detect changes in scenes across saccades. , 1996 .

[40]  K. Cheng A purely geometric module in the rat's spatial representation , 1986, Cognition.

[41]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[42]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[43]  C. Habel,et al.  Mental Models in Discourse Processing and Reasoning , 1999 .

[44]  Ma Conway,et al.  Handbook of perception and cognition , 1996 .

[45]  M. Chun,et al.  Organization of visual short-term memory. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[46]  J. Pani Descriptions of Orientation in Physical Reasoning , 1997 .

[47]  Gordon D. Logan,et al.  Please Scroll down for Article Visual Cognition Selection for Cognition: Cognitive Constraints on Visual Spatial Attention Selection for Cognition: Cognitive Constraints on Visual Spatial Attention , 2022 .

[48]  A Treisman,et al.  Feature analysis in early vision: evidence from search asymmetries. , 1988, Psychological review.

[49]  K. Rayner,et al.  The effect of background information on object identification , 2017 .

[50]  Lynn A. Cooper,et al.  Imagery and Visual—Spatial Representations , 1996 .

[51]  Z. Pylyshyn Is vision continuous with cognition? The case for cognitive impenetrability of visual perception. , 1999, The Behavioral and brain sciences.

[52]  John K. Tsotsos Analyzing vision at the complexity level , 1990, Behavioral and Brain Sciences.

[53]  G. Stone,et al.  Perception Is a Two-Way Street: Feedforward and Feedback Phonology in Visual Word Recognition ☆ , 1997 .

[54]  R. Schvaneveldt,et al.  Facilitation in recognizing pairs of words: evidence of a dependence between retrieval operations. , 1971, Journal of experimental psychology.

[55]  O. Sabouraud [Space perception]. , 1978, Revue d'oto-neuro-ophtalmologie.

[56]  G. Miller,et al.  Language and Perception , 1976 .

[57]  W Prinzmetal,et al.  The role of redundancy in the object-line effect , 1984, Perception & psychophysics.

[58]  H. Intraub,et al.  Boundary extension: fundamental aspect of pictorial representation or encoding artifact? , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[59]  Melvyn A. Goodale,et al.  The cortical organization of visual perception and visuomotor control , 1995 .

[60]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[61]  S. Kosslyn Seeing and imagining in the cerebral hemispheres: a computational approach. , 1987, Psychological review.

[62]  Heinrich H Bülthoff,et al.  Why the visual recognition system might encode the effects of illumination , 1998, Vision Research.

[63]  Dominic W. Massaro,et al.  Visual Information Processing in Reading , 1993 .

[64]  G. Logan Linguistic and Conceptual Control of Visual Spatial Attention , 1995, Cognitive Psychology.

[65]  N Weisstein,et al.  Line segments are perceived better in a coherent context than alone: An object-line effect in visual perception , 1978, Memory & cognition.

[66]  G. Baylis,et al.  The figure has a shape, but the ground does not: evidence from a priming paradigm. , 2001, Journal of experimental psychology. Human perception and performance.

[67]  R W Schvaneveldt,et al.  An activation--verification model for letter and word recognition: the word-superiority effect. , 1982, Psychological review.

[68]  I. Biederman,et al.  Priming contour-deleted images: Evidence for intermediate representations in visual object recognition , 1991, Cognitive Psychology.

[69]  M. Lévesque Perception , 1986, The Yale Journal of Biology and Medicine.

[70]  U. Neisser Multiple systems: A new approach to cognitive theory , 1994 .

[71]  Thomas Sanocki,et al.  Constructing structural descriptions , 1999 .

[72]  Refractor Vision , 2000, The Lancet.

[73]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[74]  G. M. Reicher Perceptual recognition as a function of meaninfulness of stimulus material. , 1969, Journal of experimental psychology.

[75]  David E. Rumelhart,et al.  Toward an interactive model of reading. , 1994 .

[76]  D. Simons In Sight, Out of Mind: When Object Representations Fail , 1996 .

[77]  W. Epstein,et al.  Perception of space and motion , 1995 .

[78]  S. Palmer The Psychology of Perceptual Organization: A Transformational Approach , 1983 .

[79]  P. Cavanagh,et al.  Shape from shadows. , 1989, Journal of experimental psychology. Human perception and performance.

[80]  H. Intraub Illusory conjunctions of forms, objects, and scenes during rapid serial visual search. , 1989, Journal of Experimental Psychology. Learning, Memory and Cognition.

[81]  P. Lewicki,et al.  Nonconscious acquisition of information. , 1992, The American psychologist.

[82]  Z. Pylyshyn Some primitive mechanisms of spatial attention , 1994, Cognition.

[83]  J. Rueckl,et al.  Morphological priming, fragment completion, and connectionist networks , 1997 .

[84]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[85]  James E. Cutting,et al.  Chapter 3 – Perceiving Layout and Knowing Distances: The Integration, Relative Potency, and Contextual Use of Different Information about Depth* , 1995 .

[86]  B Tversky,et al.  Descriptions and depictions of environments , 1992, Memory & cognition.

[87]  J. Henderson,et al.  Does consistent scene context facilitate object perception? , 1998, Journal of experimental psychology. General.

[88]  Ronald A. Rensink,et al.  Early completion of occluded objects , 1998, Vision Research.

[89]  W. Epstein,et al.  Priming Spatial Layout of Scenes , 1997 .

[90]  John M. Henderson,et al.  The Influence of Enantiomorphic Transformation on Transsaccadic Object Integration , 1999 .

[91]  M. Potter Short-term conceptual memory for pictures. , 1976, Journal of experimental psychology. Human learning and memory.

[92]  D. Simons Change blindness and visual memory , 2000 .

[93]  W. A. Phillips On the distinction between sensory storage and short-term visual memory , 1974 .

[94]  Barbara Tversky,et al.  Searching Imagined Environments , 1990 .

[95]  T. Sanocki,et al.  Effects of early common features on form perception , 1991, Perception & psychophysics.

[96]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[97]  M. Chun,et al.  Memory deficits for implicit contextual information in amnesic subjects with hippocampal damage , 1999, Nature Neuroscience.

[98]  Ronald A. Rensink,et al.  Preattentive recovery of three-dimensional orientation from line drawings. , 1991, Psychological review.

[99]  E. Marg A VISION OF THE BRAIN , 1994 .

[100]  James L. McClelland On the time relations of mental processes: An examination of systems of processes in cascade. , 1979 .

[101]  T. Sanocki Time course of object identification: evidence for a global-to-local contingency. , 1993, Journal of experimental psychology. Human perception and performance.

[102]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[103]  J. O'Regan,et al.  Solving the "real" mysteries of visual perception: the world as an outside memory. , 1992, Canadian journal of psychology.

[104]  A. Oliva,et al.  Coarse Blobs or Fine Edges? Evidence That Information Diagnosticity Changes the Perception of Complex Visual Stimuli , 1997, Cognitive Psychology.

[105]  V. Lollo Temporal integration in visual memory. , 1980 .

[106]  A. Samuel Lexical Activation Produces Potent Phonemic Percepts , 1997, Cognitive Psychology.

[107]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[108]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[109]  James L. McClelland,et al.  Structural factors in figure perception , 1979 .

[110]  M. Chun,et al.  Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention , 1998, Cognitive Psychology.

[111]  J. Henderson,et al.  Two representational systems in dynamic visual identification. , 1994, Journal of experimental psychology. General.