Object identification in context: the visual processing of natural scenes.

When we view a natural visual scene, we seem able to determine effortlessly the scene's semantic category, constituent objects, and spatial relations. How do we accomplish this visual-cognitive feat? The commonly held explanation is known as the schema hypothesis, according to which a visual scene is rapidly identified as a member of a semantic category, and predictions generated from the scene category are then used to aid subsequent object identification. In this paper I will first outline and offer a critique of the evidence that has been taken to support the schema hypothesis. I will then offer an alternative framework for understanding scene processing, which I will call the local-processing hypothesis. This hypothesis assumes a modular, informationally-encapsulated architecture, and explicitly includes the role of covert visual attention in scene processing.

[1]  N. Mackworth,et al.  The gaze selects informative details within pictures , 1967 .

[2]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[3]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[4]  G. M. Reicher.  Perceptual recognition as a function of meaninfulness of stimulus material. , 1969, Journal of experimental psychology.

[5]  D. D. Wheeler.  Processes in word recognition , 1970 .

[6]  B. Julesz.  Foundations of Cyclopean Perception , 1971 .

[7]  Myron L. Wolbarsht,et al.  Foundations of Cyclopean Perception.Bela Julesz , 1972 .

[8]  I. Biederman,et al.  Searching for objects in real-world scences. , 1973, Journal of experimental psychology.

[9]  J. Antes.  The time course of picture viewing. , 1974, Journal of experimental psychology.

[10]  I. Biederman,et al.  On the information extracted from a glance at a scene. , 1974, Journal of experimental psychology.

[11]  M. Potter.  Meaning in visual search. , 1975, Science.

[12]  M. Potter.  Short-term conceptual memory for pictures. , 1976, Journal of experimental psychology. Human learning and memory.

[13]  M. P. Friedman,et al.  HANDBOOK OF PERCEPTION , 1977 .

[14]  W. Kintsch,et al.  Memory and cognition , 1977 .

[15]  G. McConkie,et al.  Eye movements and integrating information across fixations. , 1978, Journal of experimental psychology. Human perception and performance.

[16]  Patrick Rabbitt,et al.  SORTING, CATEGORIZATION, AND VISUAL SEARCH , 1978 .

[17]  N. Mackworth,et al.  Cognitive determinants of fixation location during picture viewing. , 1978, Journal of experimental psychology. Human perception and performance.

[18]  D. Swinney.  Lexical access during sentence comprehension: (Re)consideration of context effects , 1979 .

[19]  Irving Biederman,et al.  Perceiving Real World Scenes: The Role of a Prior Glance , 1979 .

[20]  A. Friedman.  Framing pictures: the role of knowledge in automatized encoding and memory for gist. , 1979, Journal of experimental psychology. General.

[21]  H. Intraub.  The role of implicit naming in pictorial encoding. , 1979 .

[22]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[23]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[24]  W. Cooper,et al.  Sentence Processing: Psycholinguistic Studies Presented to Merrill Garrett. , 1980 .

[25]  H. Intraub,et al.  Presentation rate and the representation of briefly glimpsed pictures in memory. , 1980, Journal of experimental psychology. Human learning and memory.

[26]  B. Fischhoff,et al.  Journal of Experimental Psychology: Human Learning and Memory , 1980 .

[27]  H. Intraub.  Rapid conceptual identification of sequentially presented pictures. , 1981 .

[28]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[29]  D. F. Fisher,et al.  Eye movements : cognition and visual perception , 1982 .

[30]  K. Rayner,et al.  Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences , 1982, Cognitive Psychology.

[31]  T. Carr,et al.  Words, pictures, and priming: on semantic activation, conscious identification, and the automaticity of information processing. , 1982, Journal of experimental psychology. Human perception and performance.

[32]  I. Biederman,et al.  Scene perception: Detecting and judging objects undergoing relational violations , 1982, Cognitive Psychology.

[33]  Marie Bienkowski,et al.  Automatic access of the meanings of ambiguous words in context: Some limitations of knowledge-based processing , 1982, Cognitive Psychology.

[34]  R. Weale.  Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[35]  Richard L. Metzger,et al.  The nature of processing early in picture perception , 1983, Psychological research.

[36]  Janellen Huttenlocher,et al.  The source of relatedness effects on naming latency. , 1983 .

[37]  K. Rayner,et al.  Pronoun assignment and semantic integration during reading: eye movements and immediacy of processing , 1983 .

[38]  J. Fodor.  The Modularity of mind. An essay on faculty psychology , 1986 .

[39]  A. Marcel.  Conscious and unconscious perception: Experiments on visual masking and word recognition , 1983, Cognitive Psychology.

[40]  S. Pinker,et al.  Visual cognition : An introduction * , 1989 .

[41]  Junrrs F. Kri.  Recognizing Words, Pictures, and Concepts: A Comparison of Lexical, Object, and Reality Decisions , 1984 .

[42]  Mark S. Seidenberg,et al.  Pre- and postlexical loci of contextual effects on word recognition , 1984, Memory & cognition.

[43]  S. Ullman.  Visual routines , 1984, Cognition.

[44]  Albrecht W. Inhoff,et al.  Two stages of word processing during eye fixations in the reading of prose , 1984 .

[45]  R. Remington,et al.  Moving attention: Evidence for time-invariant shifts of visual selective attention , 1984, Perception & psychophysics.

[46]  Mark S. Seidenberg.  Constraining models of word recognition , 1985, Cognition.

[47]  W. Kintsch,et al.  Context effects in word identification , 1985 .

[48]  M. Lévesque.  Perception , 1986, The Yale Journal of Biology and Medicine.

[49]  C. Clifton,et al.  The independence of syntactic processing , 1986 .

[50]  Michael K. Tanenhaus,et al.  Context effects in lexical processing: A connectionist approach to modularity. , 1987 .

[51]  C. Connine.  Constraints on interactive processes in auditory word recognition: The role of sentence context , 1987 .

[52]  K. Rayner,et al.  Effects of Foveal Priming and Extrafoveal Preview on Object Identification , 1987 .

[53]  K. Rayner,et al.  Effects of foveal priming and extrafoveal preview on object identification. , 1987, Journal of experimental psychology. Human perception and performance.

[54]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[55]  Jay L. Garfield,et al.  Modularity in Knowledge Representation and Natural-Language Understanding , 1987 .

[56]  Irving Biederman,et al.  Object search in nonscene displays. , 1988 .

[57]  A. Treisman.  Features and Objects: The Fourteenth Bartlett Memorial Lecture , 1988, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[58]  Zenon W. Pylyshyn,et al.  Computational processes in human vision : an interdisciplinary perspective , 1988 .

[59]  Steven Pinker,et al.  On language and connectionism , 1988 .

[60]  S. Pinker,et al.  Connections and symbols , 1988 .

[61]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: part 1.: an account of basic findings , 1988 .

[62]  M. Masson,et al.  The interaction of sentence context and perceptual analysis in word identification , 1988, Memory & cognition.

[63]  K. Rayner,et al.  Covert visual attention and extrafoveal information use during object identification , 1989, Perception & psychophysics.

[64]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[65]  G. Murphy,et al.  Categorizing objects in isolation and in scenes: what a superordinate is good for. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[66]  J. Henderson,et al.  Semantic facilitation of lexical access during sentence processing. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[67]  How to built a connectionist idiot (savant) , 1990, Cognition.

[68]  P. de Graef,et al.  Perceptual effects of scene context on object identification , 1990, Psychological research.

[69]  J. Henderson,et al.  Effects of foveal processing difficulty on the perceptual span in reading: Implications for attention and eye movement control. , 1990 .

[70]  J. Henderson,et al.  Use of verb information in syntactic parsing: evidence from eye movements and word-by-word self-paced reading. , 1990, Journal of experimental psychology. Learning, memory, and cognition.

[71]  J. Henderson,et al.  Effects of foveal processing difficulty on the perceptual span in reading: implications for attention and eye movement control. , 1990, Journal of experimental psychology. Learning, memory, and cognition.

[72]  Irving Biederman,et al.  Higher-level vision , 1990 .

[73]  J. Hollerbach,et al.  Visual cognition and action , 1990 .

[74]  P. David Pearson.  Handbook of reading research. , 1990 .

[75]  An Exploration of the Effects of Scene Context on Object Identification , 1992 .

[76]  Peter De Graef,et al.  Scene-Context Effects and Models of Real-World Perception , 1992 .

[77]  J. Henderson.  Identifying objects across saccades: effects of extrafoveal preview and flanker object context. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[78]  K. Rayner.  Eye movements and visual cognition : scene perception and reading , 1992 .

[79]  Judith F. Kroll,et al.  Making a Scene: The Debate about Context Effects for Scenes and Sentences , 1992 .

[80]  J. Henderson.  Eye movement control during visual object processing: effects of initial fixation position and semantic constraint. , 1993, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.