Towards a Theory of Motion Understanding in Man and Machine

The design of a system that understands visual motion, whether biological or machine, must adhere to certain constraints. These constraints include the types and numbers of available processors, how those processors are arranged, the nature of the task, as well as the characteristics of the input itself. This chapter examines some of these constraints, and in two parts, presents a framework for research in this area. The first part, Section 11.2, involves time complexity arguments demonstrating that the common attack to this problem, namely, an approach that is spatially parallel (as least conceptually), with temporal considerations strictly subsequent to the spatial ones, cannot possibly succeed. The essence of this claim is not a new one, and was motivated by similar comments by Neisser (1967), among others. What Neisser and others did not do, however, is provide a framework that is plausible. Expanding on the time complexity argument, we show that in addition to spatial parallelism, the basic system elements include hierarchical organization through abstraction of both prototypical visual knowledge as well as early representations of the input, and the separation of input measurements into logical feature maps.

[1]  THE OPTICAL SOCIETY OF AMERICA , 1923 .

[2]  L. Brillouin,et al.  Science and information theory , 1956 .

[3]  D. Sholl.  The organization of the cerebral cortex , 1957 .

[4]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[5]  G. Sperling.  A Model for Visual Memory Tasks1 , 1963, Human factors.

[6]  J. Fraser.  The voices of time , 1966 .

[7]  S. Anstis,et al.  Phi movement as a subtraction process. , 1970, Vision research.

[8]  B. Julesz.  Foundations of Cyclopean Perception , 1971 .

[9]  C. Gross.  Visual Functions of Inferotemporal Cortex , 1973 .

[10]  M. Potter.  Meaning in visual search. , 1975, Science.

[11]  M. Sanders.  Handbook of Sensory Physiology , 1975 .

[12]  P. O. Bishop,et al.  Direction selectivity of simple striate cells: properties and mechanism. , 1975, Journal of neurophysiology.

[13]  J. Limb,et al.  Estimating the Velocity of Moving Images in Television Signals , 1975 .

[14]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[15]  Allen R. Hanson,et al.  Computer Vision Systems , 1978 .

[16]  W. K. Estes,et al.  PERCEPTUAL PROCESSING IN LETTER RECOGNITION AND READING , 1978 .

[17]  Jonathan Stone,et al.  Hierarchical and parallel mechanisms in the organization of visual cortex , 1979, Brain Research Reviews.

[18]  A. Cowey.  Cortical Maps and Visual Perception the Grindley Memorial Lecture* , 1979, The Quarterly journal of experimental psychology.

[19]  S. Ullman.  The Interpretation of Visual Motion , 1979 .

[20]  Brian J. Murphy,et al.  Summation and discrimination of gratings moving in opposite directions , 1980, Vision Research.

[21]  William B. Thompson,et al.  TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE , 2009 .

[22]  M J Morgan,et al.  Analogue models of motion perception. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[23]  S Marcelja,et al.  Mathematical description of the responses of simple cortical cells. , 1980, Journal of the Optical Society of America.

[24]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[25]  T. Poggio,et al.  Visual hyperacuity: spatiotemporal interpolation in human vision , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[26]  P. J. Burt,et al.  Fast Filter Transforms for Image Processing , 1981 .

[27]  William R. Uttal,et al.  A taxonomy of visual processes , 1981 .

[28]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[29]  P. Burt.  Fast filter transform for image processing , 1981 .

[30]  S. McKee.  A local mechanism for differential velocity detection , 1981, Vision Research.

[31]  J. Robson,et al.  Discrimination at threshold: Labelled detectors in human vision , 1981, Vision Research.

[32]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[33]  A. Treisman,et al.  Illusory conjunctions in the perception of objects , 1982, Cognitive Psychology.

[34]  Hans-Hellmut Nagel,et al.  Volumetric model and 3D trajectory of a moving car derived from monocular TV frame sequences of a street scene , 1981, Comput. Graph. Image Process..

[35]  D. Slepian.  Some comments on Fourier analysis, uncertainty and modeling , 1983 .

[36]  John H. R. Maunsell,et al.  Hierarchical organization and functional streams in the visual cortex , 1983, Trends in Neurosciences.

[37]  Daniel A. Pollen,et al.  Visual cortical neurons as localized spatial frequency filters , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[38]  John Daugman,et al.  Six formal properties of two-dimensional anisotropie visual filters: Structural principles and frequency/orientation selectivity , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[39]  Hans-Hellmut Nagel,et al.  Displacement vectors derived from second-order intensity variations in image sequences , 1983, Comput. Vis. Graph. Image Process..

[40]  T. Poggio,et al.  The analysis of stereopsis. , 1984, Annual review of neuroscience.

[41]  Peter Thompson,et al.  The coding of velocity of movement in the human visual system , 1984, Vision Research.

[42]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[43]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[44]  Charles G. Gross,et al.  Pattern recognition mechanisms , 1985 .

[45]  Ken Nakayama,et al.  Biological image motion processing: A review , 1985, Vision Research.

[46]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[47]  David J. Fleet,et al.  Spatiotemporal inseparability in early vision: centre‐surround models and velocity selectivity , 1985 .

[48]  David J. Fleet,et al.  Hierarchical Construction of Orientation and Velocity Selective Filters , 1989, IEEE Trans. Pattern Anal. Mach. Intell..