Modeling observer and object motion perception

When a person moves about the world, images of the surrounding scene move across his or her retinas, providing a rich source of information about the environment. The motion of the images arises from numerous sources. The observer’s own locomotion causes the images of all stationary items to move in a pattern. This pattern of image velocities on the retina is known as optic flow or retinal flow. This pattern can be a fairly simple, radial pattern (Figure 1a) if the observer moves in a straight line, or more complex (Figure 1b) if the observer moves on a curved path. In addition, the observer may make eye or head movements that also affect the flow field. Finally, objects in the world may themselves be moving, creating additional complexity in the scene (Figure 1c). Somehow the brain is able to process this motion information adeptly to ascertain the direction of motion of the observer as well as the position and direction of motion of moving objects in the scene. This ability allows soccer players to follow a moving ball while maneuvering past other running players, and drivers on busy roads to avoid moving cars and pedestrians while driving straight or negotiating turns.

[1]  Markus Lappe,et al.  An illusory transformation in a model of optic flow processing , 1995, Vision Research.

[2]  William B. Thompson,et al.  Detecting moving objects , 1989, International Journal of Computer Vision.

[3]  J. Perrone,et al.  A model of self-motion estimation within primate extrastriate visual cortex , 1994, Vision Research.

[4]  T J Sejnowski,et al.  A Model for Encoding Multiple Object Motions and Self-Motion in Area MST of Primate Visual Cortex , 1998, The Journal of Neuroscience.

[5]  Constance S. Royden,et al.  Mathematical analysis of motion-opponent mechanisms used in the determination of heading and depth. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  K. Tanaka,et al.  Analysis of motion of the visual field by direction, expansion/contraction, and rotation cells clustered in the dorsal part of the medial superior temporal area of the macaque monkey. , 1989, Journal of neurophysiology.

[7]  Constance S. Royden,et al.  Computing heading in the presence of moving objects: a model that uses motion-opponent operators , 2002, Vision Research.

[8]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Eli Brenner,et al.  Judging an object's velocity when its distance changes due to ego-motion , 1993, Vision Research.

[10]  Constance S. Royden,et al.  Human heading judgments in the presence of moving objects , 1996, Perception & psychophysics.

[11]  R. Wurtz,et al.  Response of monkey MST neurons to optic flow stimuli with shifted centers of motion , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  M. Graziano,et al.  Tuning of MST neurons to spiral motions , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  W H Warren,et al.  Perceiving Heading in the Presence of Moving Objects , 1995, Perception.

[14]  Victor A. F. Lamme The neurophysiology of figure-ground segregation in primary visual cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[15]  Constance S. Royden,et al.  Visual search asymmetries in motion and optic flow fields , 2001, Perception & psychophysics.

[16]  G. Orban,et al.  Shape and Spatial Distribution of Receptive Fields and Antagonistic Motion Surrounds in the Middle Temporal Area (V5) of the Macaque , 1995, The European journal of neuroscience.

[17]  A. V. van den Berg,et al.  Heading detection using motion templates and eye velocity gain fields , 1998, Vision Research.

[18]  Ellen C. Hildreth,et al.  Recovering heading for visually-guided navigation , 1992, Vision Research.

[19]  James A. Crowell,et al.  Ideal observer for heading judgments , 1996, Vision Research.

[20]  Paul A. Braren,et al.  How We Avoid Collisions With Stationary and Moving Obstacles , 2004 .

[21]  Alessandro Verri,et al.  Identifying multiple motions from optical flow , 1992, ECCV.

[22]  K. Hoffmann,et al.  Motion processing for saccadic eye movements during the visually induced sensation of ego-motion in humans , 1997, Vision Research.

[23]  Ennio Mingolla,et al.  Global induced motion and visual stability in an optic flow illusion , 1997, Vision Research.

[24]  Constance S. Royden,et al.  Differential effects of shared attention on perception of heading and 3-D object motion , 1999, Perception & psychophysics.

[25]  J. Gibson The perception of the visual world , 1951 .

[26]  J Allman,et al.  Direction- and Velocity-Specific Responses from beyond the Classical Receptive Field in the Middle Temporal Visual Area (MT) , 1985, Perception.

[27]  G. Orban,et al.  Spatial heterogeneity of inhibitory surrounds in the middle temporal visual area. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[28]  D. Pelli,et al.  The information capacity of visual attention , 1992, Vision Research.

[29]  Allan D. Jepson,et al.  Subspace methods for recovering rigid motion I: Algorithm and implementation , 2004, International Journal of Computer Vision.

[30]  Constance S. Royden,et al.  A model using MT-like motion-opponent operators explains an illusory transformation in the optic flow field , 2003, Vision Research.

[31]  D C Van Essen,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. , 1983, Journal of neurophysiology.

[32]  J. H. Rieger,et al.  Human visual navigation in the presence of 3-D rotations , 1985, Biological Cybernetics.

[33]  R. Wurtz,et al.  Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli. , 1991, Journal of neurophysiology.

[34]  Eli Brenner,et al.  The Special Role of Distant Structures in Perceived Object Velocity , 1996, Vision Research.

[35]  Keiji Tanaka,et al.  Integration of direction signals of image motion in the superior temporal sulcus of the macaque monkey , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[36]  Nicholas G. Hatsopoulos,et al.  Visual navigation with a neural network , 1991, Neural Networks.

[37]  Markus Lappe,et al.  A Neural Network for the Processing of Optic Flow from Ego-Motion in Man and Higher Mammals , 1993, Neural Computation.

[38]  D J Hannon,et al.  Eye movements and optical flow. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[39]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[40]  J A Perrone,et al.  Model for the computation of self-motion in biological systems. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[41]  Stephen Grossberg,et al.  A Self-Organizing Neural Network Architecture for Navigation Using Optic Flow , 1998, Neural Computation.

[42]  J H Rieger,et al.  Processing differential image motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[43]  Daniel J. Hannon,et al.  Direction of self-motion is perceived from optical flow , 1988, Nature.

[44]  David J. Heeger,et al.  Egomotion And The Stabilized World , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[45]  M. Banks,et al.  Perceiving heading with different retinal regions and types of optic flow , 1993, Perception & psychophysics.

[46]  R. Wurtz,et al.  An illusory transformation of optic flow fields , 1993, Vision Research.

[47]  T. Brandt,et al.  Object-motion detection affected by concurrent self-motion perception: Psychophysics of a new phenomenon , 1986, Behavioural Brain Research.

[48]  A. V. D. Berg,et al.  Robustness of perception of heading from optic flow , 1992, Vision Research.

[49]  Paul A. Braren,et al.  Wayfinding on foot from information in retinal, not optical, flow. , 1992, Journal of experimental psychology. General.