A ‘complexity level’ analysis of immediate vision

This paper demonstrates how serious consideration of the deep complexity issues inherent in the design of a visual system can constrain the development of a theory of vision. We first show how the seemingly intractable problem of visual perception can be converted into a much simpler problem by the application of several physical and biological constraints. For this transformation, two guiding principles are used that are claimed to be critical in the development of any theory of perception. The first is that analysis at the ‘complexity level’ is necessary to ensure that the basic space and performance constraints observed in human vision are satisfied by a proposed system architecture. Second, the ‘maximum power/minimum cost principle’ ranks the many architectures that satisfy the complexity level and allows the choice of the best one. The best architecture chosen using this principle is completely compatible with the known architecture of the human visual system, and in addition, leads to several predictions. The analysis provides an argument for the computational necessity of attentive visual processes by exposing the computational limits of bottom-up early vision schemes. Further, this argues strongly for the validity of the computational approach to modeling the human visual system. Finally, a new explanation for the pop-out phenomenon so readily observed in visual search experiments, is proposed.

[1]  Geoffrey E. Hinton Shape Representation in Parallel Systems , 1981, IJCAI.

[2]  Geoffrey E. Hinton,et al.  Parallel visual computation , 1983, Nature.

[3]  Ken Nakayama,et al.  Serial and parallel processing of visual feature conjunctions , 1986, Nature.

[4]  W. H. Dobelle,et al.  The topography and variability of the primary visual cortex in man. , 1974, Journal of neurosurgery.

[5]  Leonard Uhr,et al.  Layered "Recognition Cone" Networks That Preprocess, Classify, and Describe , 1972, IEEE Transactions on Computers.

[6]  D. C. Essen,et al.  The topographic organization of rhesus monkey prestriate cortex. , 1978, The Journal of physiology.

[7]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[8]  John K. Tsotsos Knowledge organization and its role in representation and interpretation for time‐varying data: the ALVEN system , 1985, Comput. Intell..

[9]  John K. Tsotsos Connectionist computing and neural machinery: Examining the test of “timing” , 1986, Behavioral and Brain Sciences.

[10]  Anne Treisman,et al.  Preattentive processing in vision , 1985, Computer Vision Graphics and Image Processing.

[11]  John H. R. Maunsell,et al.  Hierarchical organization and functional streams in the visual cortex , 1983, Trends in Neurosciences.

[12]  Eugene C. Freuder,et al.  The Complexity of Some Polynomial Network Consistency Algorithms for Constraint Satisfaction Problems , 1985, Artif. Intell..

[13]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[14]  A. Cowey Cortical Maps and Visual Perception the Grindley Memorial Lecture* , 1979, The Quarterly journal of experimental psychology.

[15]  Jerome A. Feldman,et al.  Connectionist Models and Their Applications: Introduction , 1985 .

[16]  John K. Tsotsos Representational axes and temporal cooperative processes , 1987 .

[17]  John K. Tsotsos,et al.  A framework for visual motion understanding , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  S. Zucker Does connectionism suffice? , 1985, Behavioral and Brain Sciences.

[19]  Dana H. Ballard,et al.  Cortical connections and parallel processing: Structure and function , 1986, Behavioral and Brain Sciences.

[20]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[21]  S. Ullman Visual routines , 1984, Cognition.

[22]  James L. McClelland,et al.  PDP models and general issues in cognitive science , 1986 .

[23]  D. Whitteridge,et al.  The representation of the visual field on the cerebral cortex in monkeys , 1961, The Journal of physiology.

[24]  Christos H. Papadimitriou,et al.  The complexity of recognizing polyhedral scenes , 1985, 26th Annual Symposium on Foundations of Computer Science (sfcs 1985).

[25]  D. Hubel,et al.  Ferrier lecture - Functional architecture of macaque monkey visual cortex , 1977, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[26]  Whitman Richards,et al.  How to Play Twenty Questions with Nature and Win , 1982 .

[27]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.