Detection of moving objects using motion- and stereo-tuned operators.

A person moving through the world must be able to identify moving objects in order to interact with them and successfully navigate. While image motion alone is sufficient to identify moving objects under many conditions, there may be some ambiguity as to whether an object is stationary or moving, depending on the object's angle of motion and distance from the observer. Adding a measure of depth from stereo cues can eliminate this ambiguity. Here we show that a model using operators tuned to image motion and stereo disparity can accurately locate moving objects and distinguish between stationary and moving objects in a scene through which an observer is moving.

[1]  Daniel J. Hannon,et al.  Direction of self-motion is perceived from optical flow , 1988, Nature.

[2]  Nicholas G. Hatsopoulos,et al.  Visual navigation with a neural network , 1991, Neural Networks.

[3]  R. Wurtz,et al.  Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli. , 1991, Journal of neurophysiology.

[4]  Constance S. Royden,et al.  Detecting moving objects in an optic flow field using direction- and speed-tuned operators , 2014, Vision Research.

[5]  R. Wurtz,et al.  Response to motion in extrastriate area MSTl: center-surround interactions. , 1998, Journal of neurophysiology.

[6]  R. Andersen,et al.  Center–Surround Antagonism Based on Disparity in Primate Area MT , 1998, The Journal of Neuroscience.

[7]  Bart Krekelberg,et al.  Interactions between Speed and Contrast Tuning in the Middle Temporal Area: Implications for the Neural Code for Speed , 2006, The Journal of Neuroscience.

[8]  R. Wurtz,et al.  Response of monkey MST neurons to optic flow stimuli with shifted centers of motion , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Gregory C DeAngelis,et al.  Coding of horizontal disparity and velocity by MT neurons in the alert macaque. , 2003, Journal of neurophysiology.

[10]  James A. Crowell,et al.  The perception of heading during eye movements , 1992, Nature.

[11]  J H Rieger,et al.  Processing differential image motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[12]  Ning Qian,et al.  Computing Stereo Disparity and Motion with Known Binocular Cell Properties , 1994, Neural Computation.

[13]  John H. R. Maunsell,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity. , 1983, Journal of neurophysiology.

[14]  M. Lappe,et al.  Interaction of stereo vision and optic flow processing revealed by an illusory stimulus , 1998, Vision Research.

[15]  D J Hannon,et al.  Eye movements and optical flow. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[16]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[17]  Nicholas J. Priebe,et al.  Estimating Target Speed from the Population Response in Visual Area MT , 2004, The Journal of Neuroscience.

[18]  Constance S. Royden,et al.  Analysis of misperceived observer motion during simulated eye rotations , 1994, Vision Research.

[19]  Li Li,et al.  Path perception during rotation: influence of instructions, depth range, and dot density , 2004, Vision Research.

[20]  Constance S. Royden,et al.  Modeling observer and object motion perception , 2004 .

[21]  Keiji Tanaka,et al.  Integration of direction signals of image motion in the superior temporal sulcus of the macaque monkey , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  S. Rushton,et al.  The pop out of scene-relative object movement against retinal motion due to self-movement , 2007, Cognition.

[23]  S. Rushton,et al.  Perception of scene-relative object movement: Optic flow parsing and the contribution of monocular depth cues , 2009, Vision Research.

[24]  J. Perrone,et al.  A model of self-motion estimation within primate extrastriate visual cortex , 1994, Vision Research.

[25]  D C Van Essen,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. , 1983, Journal of neurophysiology.

[26]  G. Orban,et al.  Shape and Spatial Distribution of Receptive Fields and Antagonistic Motion Surrounds in the Middle Temporal Area (V5) of the Macaque , 1995, The European journal of neuroscience.

[27]  Constance S. Royden,et al.  Factors affecting curved versus straight path heading perception , 2006, Perception & psychophysics.

[28]  G C DeAngelis,et al.  The physiology of stereopsis. , 2001, Annual review of neuroscience.

[29]  R. Wurtz,et al.  Response to motion in extrastriate area MSTl: disparity sensitivity. , 1999, Journal of neurophysiology.

[30]  J Allman,et al.  Direction- and Velocity-Specific Responses from beyond the Classical Receptive Field in the Middle Temporal Visual Area (MT) , 1985, Perception.

[31]  Christopher C. Pack,et al.  Contrast dependence of suppressive influences in cortical area MT of alert macaque. , 2005, Journal of neurophysiology.

[32]  B Rogers,et al.  Motion Parallax as an Independent Cue for Depth Perception , 1979, Perception.

[33]  K. Tanaka,et al.  Analysis of motion of the visual field by direction, expansion/contraction, and rotation cells clustered in the dorsal part of the medial superior temporal area of the macaque monkey. , 1989, Journal of neurophysiology.

[34]  James A. Crowell,et al.  Estimating heading during eye movements , 1994, Vision Research.

[35]  Richard J. A. van Wezel,et al.  An illusory transformation of optic flow fields without local motion interactions , 2004, Vision Research.

[36]  D. J. Felleman,et al.  Receptive-field properties of neurons in middle temporal visual area (MT) of owl monkeys. , 1984, Journal of neurophysiology.

[37]  Constance S. Royden,et al.  A model using MT-like motion-opponent operators explains an illusory transformation in the optic flow field , 2003, Vision Research.

[38]  Constance S. Royden,et al.  Computing heading in the presence of moving objects: a model that uses motion-opponent operators , 2002, Vision Research.

[39]  Constance S. Royden,et al.  Human heading judgments in the presence of moving objects , 1996, Perception & psychophysics.

[40]  William B. Thompson,et al.  Detecting moving objects , 1989, International Journal of Computer Vision.

[41]  Constance S. Royden,et al.  Use of speed cues in the detection of moving objects by moving observers , 2012, Vision Research.

[42]  G. Orban,et al.  Spatial heterogeneity of inhibitory surrounds in the middle temporal visual area. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[43]  Constance S. Royden,et al.  Mathematical analysis of motion-opponent mechanisms used in the determination of heading and depth. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[44]  R. Hetherington.  The Perception of the Visual World , 1952 .