Modeling heading and path perception from optic flow in the case of independently moving objects

Humans are usually accurate when estimating heading or path from optic flow, even in the presence of independently moving objects (IMOs) in an otherwise rigid scene. To invoke significant biases in perceived heading, IMOs have to be large and obscure the focus of expansion (FOE) in the image plane, which is the point of approach. For the estimation of path during curvilinear self-motion no significant biases were found in the presence of IMOs. What makes humans robust in their estimation of heading or path using optic flow? We derive analytical models of optic flow for linear and curvilinear self-motion using geometric scene models. Heading biases of a linear least squares method, which builds upon these analytical models, are large, larger than those reported for humans. This motivated us to study segmentation cues that are available from optic flow. We derive models of accretion/deletion, expansion/contraction, acceleration/deceleration, local spatial curvature, and local temporal curvature, to be used as cues to segment an IMO from the background. Integrating these segmentation cues into our method of estimating heading or path now explains human psychophysical data and extends, as well as unifies, previous investigations. Our analysis suggests that various cues available from optic flow help to segment IMOs and, thus, make humans' heading and path perception robust in the presence of such IMOs.

[1]  Heiko Neumann,et al.  Active Gaze Control Improves Optic Flow-Based Segmentation and Steering , 2012, PloS one.

[2]  N. Logothetis,et al.  Natural vision reveals regional specialization to local motion and to contrast-invariant, global flow in the human brain. , 2008, Cerebral cortex.

[3]  Florentin Wörgötter,et al.  A cortical architecture on parallel hardware for motion processing in real time. , 2010, Journal of vision.

[4]  D J Hannon,et al.  Eye movements and optical flow. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[5]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[6]  S. Zeki,et al.  The processing of kinetic contours in the brain. , 2003, Cerebral cortex.

[7]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[8]  Oliver W. Layton,et al.  A motion pooling model of visually guided navigation explains human behavior in the presence of independently moving objects. , 2012, Journal of vision.

[9]  I. Kenyon,et al.  Classical Mechanics (3rd edn) , 1985 .

[10]  Yong Gu,et al.  Visual Neurons in the Pigeon Brain Encode the Acceleration of Stimulus Motion , 2004, The Journal of Neuroscience.

[11]  Brett R Fajen,et al.  Visual Guidance of Intercepting a Moving Target on Foot , 2004, Perception.

[12]  James A. Crowell,et al.  Estimating heading during eye movements , 1994, Vision Research.

[13]  D. Angelaki,et al.  Two-dimensional spatiotemporal coding of linear acceleration in vestibular nuclei neurons , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  Brett R Fajen,et al.  Behavioral dynamics of steering, obstacle avoidance, and route selection. , 2003, Journal of experimental psychology. Human perception and performance.

[15]  R. Wurtz,et al.  Response to motion in extrastriate area MSTl: center-surround interactions. , 1998, Journal of neurophysiology.

[16]  J. W. Humberston Classical mechanics , 1980, Nature.

[17]  A. Verri,et al.  First-order analysis of optical flow in monkey brain. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[18]  O. Braddick Segmentation versus integration in visual motion processing , 1993, Trends in Neurosciences.

[19]  Paul A. Braren,et al.  How We Avoid Collisions With Stationary and Moving Obstacles , 2004 .

[20]  Heiko Neumann,et al.  A review and evaluation of methods estimating ego-motion , 2012, Comput. Vis. Image Underst..

[21]  Horst Bischof,et al.  A Duality Based Approach for Realtime TV-L1 Optical Flow , 2007, DAGM-Symposium.

[22]  Simon K Rushton,et al.  Does optic flow parsing depend on prior estimation of heading? , 2012, Journal of vision.

[23]  A. W. Blackwell,et al.  Perception of circular heading from optical flow. , 1991, Journal of experimental psychology. Human perception and performance.

[24]  R. Hetherington The Perception of the Visual World , 1952 .

[25]  W. Warren,et al.  The role of central and peripheral vision in perceiving the direction of self-motion , 1992, Perception & psychophysics.

[26]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[27]  B. Fajen,et al.  Perceiving curvilinear heading in the presence of moving objects. , 2002, Journal of experimental psychology. Human perception and performance.

[28]  Timothy Barnes,et al.  Representation of motion onset and offset in an augmented Barlow-Levick model of motion detection , 2012, Journal of Computational Neuroscience.

[29]  Nam-Gyoon Kim,et al.  Heading Perception and Moving Objects , 2000, Biologically Motivated Computer Vision.

[30]  Li Li,et al.  Perception of heading during rotation: sufficiency of dense motion parallax and reference objects , 2000, Vision Research.

[31]  Berthold K. P. Horn,et al.  Passive navigation , 1982, Computer Vision Graphics and Image Processing.

[32]  Ellen C. Hildreth,et al.  Recovering Heading for Visually Guided Navigation in the Presence of Self-Moving Objects , 1992 .

[33]  J. Gibson,et al.  Parallax and perspective during aircraft landings. , 1955, The American journal of psychology.

[34]  Li Li,et al.  Perceiving path from optic flow. , 2011, Journal of vision.

[35]  James A. Crowell,et al.  The perception of heading during eye movements , 1992, Nature.

[36]  Heiko Neumann,et al.  Segmentation of Independently Moving Objects Using a Maximum-Likelihood Principle , 2005, Autonome Mobile Systeme.

[37]  J H Rieger,et al.  Processing differential image motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[38]  S. Rushton,et al.  Optic Flow Processing for the Assessment of Object Movement during Ego Movement , 2009, Current Biology.

[39]  S. Rushton,et al.  Perception of scene-relative object movement: Optic flow parsing and the contribution of monocular depth cues , 2009, Vision Research.

[40]  Stephen Grossberg,et al.  A neural model of visually guided steering, obstacle avoidance, and route selection. , 2009, Journal of experimental psychology. Human perception and performance.

[41]  Constance S. Royden,et al.  Computing heading in the presence of moving objects: a model that uses motion-opponent operators , 2002, Vision Research.

[42]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Constance S. Royden,et al.  Human heading judgments in the presence of moving objects , 1996, Perception & psychophysics.

[44]  Marc M. Van Hulle,et al.  Segmenting Independently Moving Objects from Egomotion Flow Fields , 2004 .

[45]  Li Li,et al.  Path perception during rotation: influence of instructions, depth range, and dot density , 2004, Vision Research.

[46]  Guy A Orban,et al.  Higher order visual processing in macaque extrastriate cortex. , 2008, Physiological reviews.

[47]  J. J. Koenderink,et al.  Visibility of movement gradients , 1982, Biological Cybernetics.

[48]  Jan J. Koenderink,et al.  Local structure of movement parallax of the plane , 1976 .

[49]  W H Warren,et al.  Perceiving Heading in the Presence of Moving Objects , 1995, Perception.

[50]  W. James MacLean,et al.  Recovery of Egomotion and Segmentation of Independent Object Motion Using the EM Algorithm , 1994, BMVC.

[51]  Brett R. Fajen,et al.  Behavioral Dynamics of Visually Guided Locomotion , 2008 .

[52]  Stephen Grossberg,et al.  A neural model of how the brain computes heading from optic flow in realistic scenes , 2009, Cognitive Psychology.

[53]  M. Banks,et al.  Perceiving heading with different retinal regions and types of optic flow , 1993, Perception & psychophysics.