Analyzing vision at the complexity level

Abstract The general problem of visual search can be shown to be computationally intractable in a formal, complexity-theoretic sense, yet visual search is extensively involved in everyday perception, and biological systems manage to perform it remarkably well. Complexity level analysis may resolve this contradiction. Visual search can be reshaped into tractability through approximations and by optimizing the resources devoted to visual processing. Architectural constraints can be derived using the minimum cost principle to rule out a large class of potential solutions. The evidence speaks strongly against bottom-up approaches to vision. In particular, the constraints suggest an attentional mechanism that exploits knowledge of the specific problem being solved. This analysis of visual search performance in terms of attentional influences on visual information processing and complexity satisfaction allows a large body of neurophysiological and psychological evidence to be tied together.

[1]  A. Church.  An Unsolvable Problem of Elementary Number Theory , 1936 .

[2]  A. Turing.  On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[3]  H. K. Hartline,et al.  THE RECEPTIVE FIELDS OF OPTIC NERVE FIBERS , 1940 .

[4]  S. W. Kuffler.  Discharge patterns and functional organization of mammalian retina. , 1953, Journal of neurophysiology.

[5]  Richard Bellman.  Some Applications of the Theory of Dynamic Programming - A Review , 1954, Oper. Res..

[6]  G. Békésy.  Current Status of Theories of Hearing , 1956 .

[7]  V. Mountcastle.  Modality and topographic properties of single neurons of cat's somatic sensory cortex. , 1957, Journal of neurophysiology.

[8]  H. Barlow,et al.  Change of organization in the receptive fields of the cat's retina during dark adaptation , 1957, The Journal of physiology.

[9]  G. Dantzig.  Discrete-Variable Extremum Problems , 1957 .

[10]  H. Harlow,et al.  The History and Philosophy of Knowledge of the Brain and its Functions , 1960, Neurology.

[11]  D. Whitteridge,et al.  The representation of the visual field on the cerebral cortex in monkeys , 1961, The Journal of physiology.

[12]  J. Gibson.  The Senses Considered As Perceptual Systems , 1967 .

[13]  Leonard Uhr,et al.  Layered "Recognition Cone" Networks That Preprocess, Classify, and Describe , 1972, IEEE Transactions on Computers.

[14]  W. H. Dobelle,et al.  The topography and variability of the primary visual cortex in man. , 1974, Journal of neurosurgery.

[15]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[16]  Aaron Sloman,et al.  Afterthoughts on Analogical Representations , 1975, TINLAP.

[17]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[18]  John Jonides,et al.  The benefit of categorization in visual search: Target location without identification , 1976 .

[19]  J. Jonides,et al.  The cost of categorization in visual search: Incomplete processing of targets and field items , 1976 .

[20]  D. Hubel,et al.  Ferrier lecture - Functional architecture of macaque monkey visual cortex , 1977, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[21]  S. Runeson.  On the possibility of "smart" perceptual mechanisms. , 1977, Scandinavian journal of psychology.

[22]  R. Wiley.  The Lek Mating System of the Sage Grouse , 1978 .

[23]  L. E. Krueger.  A Theory of Perceptual Matching , 1978 .

[24]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[25]  S. Zeki.  Uniformity and diversity of structure and function in rhesus monkey prestriate visual cortex. , 1978, The Journal of physiology.

[26]  Allen R. Hanson,et al.  Computer Vision Systems , 1978 .

[27]  Richard J. Lipton,et al.  Linear Programming is Log-Space Hard for P , 1979, Inf. Process. Lett..

[28]  J E Hoffman,et al.  A two-stage model of visual search , 1979, Perception & psychophysics.

[29]  Jonathan Stone,et al.  Hierarchical and parallel mechanisms in the organization of visual cortex , 1979, Brain Research Reviews.

[30]  E. Rosch,et al.  Cognition and Categorization , 1980 .

[31]  A. Cowey.  Cortical Maps and Visual Perception the Grindley Memorial Lecture* , 1979, The Quarterly journal of experimental psychology.

[32]  A. K. Chandra,et al.  Intrinsically Difficult Problems , 1979 .

[33]  J. Duncan.  The locus of interference in the perception of simultaneous stimuli. , 1980 .

[34]  Brian V. Funt,et al.  Problem-Solving with Diagrammatic Representations , 1980, Artif. Intell..

[35]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[36]  M. B. Pour-El,et al.  The wave equation with computable initial data such that its unique solution is not computable , 1981 .

[37]  Robert W. Proctor,et al.  A unified theory for matching-task phenomena. , 1981 .

[38]  J. E. Albano,et al.  Visuomotor deficits following ablation of monkey superior colliculus. , 1982, Journal of neurophysiology.

[39]  C. Eriksen,et al.  Response competition effects insame-different judgments , 1982, Perception & psychophysics.

[40]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[41]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[42]  L Chen,et al.  Topological structure in visual perception. , 1982, Science.

[43]  A. Treisman,et al.  Illusory conjunctions in the perception of objects , 1982, Cognitive Psychology.

[44]  S. Kosslyn.  Image and mind , 1982 .

[45]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[46]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[47]  M. B. Pour-El,et al.  Noncomputability in models of physical phenomena , 1982 .

[48]  A. Treisman.  Perceptual grouping and attention in visual search for features and for objects. , 1982, Journal of experimental psychology. Human perception and performance.

[49]  Andrew C. Sleigh,et al.  Physical and Biological Processing of Images , 1983 .

[50]  John H. R. Maunsell,et al.  Hierarchical organization and functional streams in the visual cortex , 1983, Trends in Neurosciences.

[51]  Steven W. Zucker,et al.  On the Foundations of Relaxation Labeling Processes , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  M. R. Houck,et al.  The role of attentional resources in automatic detection , 1983, Cognitive Psychology.

[53]  R. Proctor,et al.  Evidence that thesame-different disparity in letter matching is not attributable to response bias , 1983, Perception & psychophysics.

[54]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[55]  Geoffrey E. Hinton,et al.  Parallel visual computation , 1983, Nature.

[56]  Raja Parasuraman,et al.  Varieties of attention , 1984 .

[57]  L. E. Krueger,et al.  Further evidence for priming in perceptual matching: Temporal, not spatial, separation enhances the fast-same effect , 1984, Perception & psychophysics.

[58]  Jan J. Koenderink,et al.  Limits in perception , 1984 .

[59]  S. Ullman.  Visual routines , 1984, Cognition.

[60]  P. Tueting,et al.  Brain and information: event-related potentials. , 1984, Annals of the New York Academy of Sciences.

[61]  H. Egeth,et al.  Searching for conjunctively defined targets. , 1984, Journal of experimental psychology. Human perception and performance.

[62]  J. Fodor.  Précis of The Modularity of Mind , 1985, Behavioral and Brain Sciences.

[63]  V. Ramachandran,et al.  The Neurobiology of Perception , 1985, Perception.

[64]  R. Finke,et al.  Theories relating mental imagery to perception. , 1985, Psychological bulletin.

[65]  A. Treisman,et al.  Search asymmetry: a diagnostic for preattentive processing of separable features. , 1985, Journal of experimental psychology. General.

[66]  R. Gregory.  Premature Reductions and Mythical Productions , 1985, Perception.

[67]  M. Posner,et al.  Inhibition of return : Neural basis and function , 1985 .

[68]  L. E. Krueger,et al.  Same-different judgments under high speed stress: Missing-feature principle predominates in early processing , 1985, Perception & psychophysics.

[69]  Anne Treisman,et al.  Preattentive processing in vision , 1985, Computer Vision Graphics and Image Processing.

[70]  Jerome A. Feldman,et al.  Connectionist Models and Their Applications: Introduction , 1985 .

[71]  Eugene C. Freuder,et al.  The Complexity of Some Polynomial Network Consistency Algorithms for Constraint Satisfaction Problems , 1985, Artif. Intell..

[72]  Leslie G. Ungerleider,et al.  Contour, color and shape analysis beyond the striate cortex , 1985, Vision Research.

[73]  B Julesz,et al.  "Where" and "what" in vision. , 1985, Science.

[74]  M. Farah,et al.  Psychophysical evidence for a shared representational medium for mental images and percepts. , 1985, Journal of experimental psychology. General.

[75]  S. Zucker.  Does connectionism suffice? , 1985, Behavioral and Brain Sciences.

[76]  J M Rubin,et al.  Topological perception: Holes in an experiment , 1985, Perception & psychophysics.

[77]  J. Allman,et al.  Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. , 1985, Annual review of neuroscience.

[78]  D. Rose,et al.  Models of the visual cortex , 1985 .

[79]  J. Miller,et al.  Synaptic amplification by active membrane in dendritic spines , 1985, Brain Research.

[80]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.

[81]  Ken Nakayama,et al.  Serial and parallel processing of visual feature conjunctions , 1986, Nature.

[82]  J. Hopfield,et al.  Computing with neural circuits: a model. , 1986, Science.

[83]  W. Eric L. Grimson,et al.  The combinatorics of local constraints in model-based recognition and localization from sparse data , 1984, JACM.

[84]  Dana H. Ballard,et al.  Cortical connections and parallel processing: Structure and function , 1986, Behavioral and Brain Sciences.

[85]  R. Llinás,et al.  Oscillatory properties of guinea‐pig inferior olivary neurones and their pharmacological modulation: an in vitro study. , 1986, The Journal of physiology.

[86]  B. Dickinson,et al.  The complexity of analog computation , 1986 .

[87]  H. Barlow.  Why have multiple cortical areas? , 1986, Vision Research.

[88]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[89]  J. P. Cavanagh,et al.  Reconstructing the third dimension: Interactions between color, texture, motion, binocular disparity, and shape , 1987, Comput. Vis. Graph. Image Process..

[90]  B. C. Motter,et al.  Common and differential effects of attentive fixation on the excitability of parietal and prestriate (V4) cortical visual neurons in the macaque monkey , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[91]  John H. R. Maunsell,et al.  Visual processing in monkey extrastriate cortex. , 1987, Annual review of neuroscience.

[92]  G W Humphreys,et al.  Visual search for targets defined by combinations of color, shape, and size: An examination of the task constraints on feature and conjunction searches , 1987, Perception & psychophysics.

[93]  G. Shepherd,et al.  Logic operations are properties of computer-simulated interactions between excitable dendritic spines , 1987, Neuroscience.

[94]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987 .

[95]  H. Pashler,et al.  Detecting conjunctions of color and form: Reassessing the serial search hypothesis , 1987, Perception & psychophysics.

[96]  David G. Lowe,et al.  Three-Dimensional Object Recognition from Single Two-Dimensional Images , 1987, Artif. Intell..

[97]  D. Broadbent,et al.  From detection to identification: Response to multiple targets in rapid serial visual presentation , 1987, Perception & psychophysics.

[98]  John H. R. Maunsell,et al.  Topographic organization of the middle temporal visual area in the macaque monkey: Representational biases and the relationship to callosal connections and myeloarchitectonic boundaries , 1987, The Journal of comparative neurology.

[99]  C. Koch,et al.  The dynamics of free calcium in dendritic spines in response to repetitive synaptic input. , 1987, Science.

[100]  W. Freeman,et al.  How brains make chaos in order to make sense of the world , 1987, Behavioral and Brain Sciences.

[101]  R. Desimone,et al.  Behavioral neurophysiology: insights into seeing and grasping. , 1988, Science.

[102]  D. O. Hebb,et al.  The organization of behavior , 1988 .

[103]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[104]  Zenon W. Pylyshyn,et al.  Computational processes in human vision : an interdisciplinary perspective , 1988 .

[105]  Jon Driver,et al.  Visual search for a conjunction of movement and form is parallel , 1988, Nature.

[106]  A Treisman,et al.  Feature analysis in early vision: evidence from search asymmetries. , 1988, Psychological review.

[107]  H. Spitzer,et al.  Increased attention enhances both behavioral and neuronal performance. , 1988, Science.

[108]  Luc Steels.  Steps towards Common Sense , 1988, ECAI.

[109]  Z W Pylyshyn,et al.  Tracking multiple independent targets: evidence for a parallel tracking mechanism. , 1988, Spatial vision.

[110]  Zenon W. Pylyshyn,et al.  Computational processes in human vision , 1988 .

[111]  S. Ullman.  Aligning pictorial descriptions: An approach to object recognition , 1989, Cognition.

[112]  W. J. Nowack.  Neurobiology of Neocortex , 1989, Neurology.

[113]  Z. Pylyshyn.  The role of location indexes in spatial perception: A sketch of the FINST spatial-index model , 1989, Cognition.

[114]  Bian Zhaoqi,et al.  Can Early Stage Vision Detect Topology , 1989, IJCAI.

[115]  G. Edelman,et al.  Reentrant signaling among simulated neuronal groups leads to coherency in their oscillatory activity. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[116]  J. Kaas.  Why Does the Brain Have So Many Visual Areas? , 1989, Journal of Cognitive Neuroscience.

[117]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[118]  Susan L. Franzel,et al.  Guided search: an alternative to the feature integration model for visual search. , 1989, Journal of experimental psychology. Human perception and performance.

[119]  David J. Fleet,et al.  Hierarchical Construction of Orientation and Velocity Selective Filters , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[120]  G. W. Strong,et al.  A solution to the tag-assignment problem for neural networks , 1989, Behavioral and Brain Sciences.

[121]  Geoffrey E. Hinton.  Connectionist Learning Procedures , 1989, Artif. Intell..

[122]  L. E. Krueger.  Cognitive impenetrability of perception , 1989 .

[123]  W. Singer,et al.  Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[124]  P. Lennie,et al.  Contrast adaptation in striate cortex of macaque , 1989, Vision Research.

[125]  Bernard Meltzer,et al.  Analogical Representations of Naive Physics , 1989, Artif. Intell..

[126]  T. Troscianko,et al.  AI and the eye , 1990 .

[127]  J. Searle,et al.  Is the brain's mind a computer program? , 1990, Scientific American.

[128]  C. A. Burbeck,et al.  Spatial-filter selection in large-scale spatial-interval discrimination , 1990, Vision Research.

[129]  M. Arbib,et al.  Vision, brain, and cooperative computation , 1990 .

[130]  Ralph M. Siegel,et al.  Non-linear dynamical system theory and primary visual cortical processing , 1990 .

[131]  A. Treisman,et al.  Conjunction search revisited , 1990 .

[132]  Jeremy M Wolfe,et al.  Modeling the role of parallel processing in visual search , 1990, Cognitive Psychology.

[133]  HERBERT A. SIMON,et al.  The Architecture of Complexity , 1991 .

[134]  Stuart C. Shapiro,et al.  Encyclopedia of artificial intelligence, vols. 1 and 2 (2nd ed.) , 1992 .