A model of human heading judgement in forward motion

We developed a new computational model of human heading judgement from retinal flow. The model uses two assumptions: a large number of sampling points in the flow field and a symmetric sampling region around the origin. The algorithm estimates self-rotation parameters by calculating statistics whose expectations correspond to the rotation parameters. After the rotational components are removed from the retinal flow, the heading direction is recovered from the flow field. Performance of the model was compared with human data in three psychophysical experiments. In the first experiment, we generated stimuli which simulated self-motion toward the ground, a cloud or a frontoparallel plane and found that the simulation results of the model were consistent with human performance. In the second and third experiment, we measured the slope of the perceived versus simulated heading function when a perturbation velocity weighted according to the distance relative to the fixation distance was added to the vertical velocity component under the cloud condition. It was found that as the magnitude of the perturbation was increased, the slope of the function increased. The characteristics observed in the experiments can be explained well by the proposed model.

[1]  J. Perrone,et al.  Human Heading Estimation During Visually Simulated Curvilinear Motion , 1997, Vision Research.

[2]  J. Perrone,et al.  A model of self-motion estimation within primate extrastriate visual cortex , 1994, Vision Research.

[3]  Ellen C. Hildreth,et al.  Recovering heading for visually-guided navigation , 1992, Vision Research.

[4]  Pietro Perona,et al.  Reducing "Structure From Motion": A General Framework for Dynamic Vision Part 1: Modeling , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  J H Rieger,et al.  Processing differential image motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[6]  M. Banks,et al.  Perceiving heading with different retinal regions and types of optic flow , 1993, Perception & psychophysics.

[7]  Markus Lappe,et al.  A Neural Network for the Processing of Optic Flow from Ego-Motion in Man and Higher Mammals , 1993, Neural Computation.

[8]  J A Perrone,et al.  Model for the computation of self-motion in biological systems. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[9]  Paul A. Braren,et al.  Wayfinding on foot from information in retinal, not optical, flow. , 1992, Journal of experimental psychology. General.

[10]  Constance S. Royden,et al.  Mathematical analysis of motion-opponent mechanisms used in the determination of heading and depth. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  A. V. van den Berg,et al.  Heading detection using motion templates and eye velocity gain fields , 1998, Vision Research.

[12]  A. V. van den Berg.  Perception of heading , 1993, Nature.

[13]  James A. Crowell,et al.  Estimating heading during real and simulated eye movements , 1996, Vision Research.

[14]  JAMES A. CROWELL,et al.  Testing the Perrone and Stone (1994) Model of Heading Estimation , 1997, Vision Research.

[15]  T J Sejnowski,et al.  A Model for Encoding Multiple Object Motions and Self-Motion in Area MST of Primate Visual Cortex , 1998, The Journal of Neuroscience.

[16]  D J Hannon,et al.  Eye movements and optical flow. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[17]  A. Remole.  PERCEPTION WITH AN EYE FOR MOTION , 1987 .

[18]  Markus Lappe,et al.  Heading detection from optic flow , 1994, Nature.

[19]  Daniel J. Hannon,et al.  Direction of self-motion is perceived from optical flow , 1988, Nature.

[20]  Allan D. Jepson,et al.  Visual Perception of Three-Dimensional Motion , 1990, Neural Computation.

[21]  W. Warren,et al.  Perception of translational heading from optical flow. , 1988, Journal of experimental psychology. Human perception and performance.

[22]  J E Cutting,et al.  Heading and path information from retinal flow in naturalistic environments , 1997, Perception & psychophysics.

[23]  D. Regan,et al.  Visual processing of looming and time to contact throughout the visual field , 1995, Vision Research.

[24]  D Regan,et al.  Accuracy of estimating time to collision using binocular and monocular information , 1998, Vision Research.

[25]  Eli Brenner,et al.  Humans combine the optic flow with static depth cues for robust perception of heading , 1994, Vision Research.

[26]  W H Warren,et al.  Perceiving Heading in the Presence of Moving Objects , 1995, Perception.

[27]  James A. Crowell,et al.  The perception of heading during eye movements , 1992, Nature.

[28]  A. V. van den Berg,et al.  Judgements of Heading , 1996, Vision Research.

[29]  Mandyam V. Srinivasan,et al.  Image interpolation technique for measurement of egomotion in 6 degrees of freedom , 1997 .

[30]  Carlo Tomasi,et al.  Direction of heading from image deformations , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Constance S. Royden,et al.  Analysis of misperceived observer motion during simulated eye rotations , 1994, Vision Research.

[32]  D. Regan,et al.  Monocular discrimination of the direction of motion in depth , 1994, Vision Research.

[33]  J E Cutting,et al.  Wayfinding, displacements, and mental maps: velocity fields are not typically used to determine one's aimpoint. , 1995, Journal of experimental psychology. Human perception and performance.

[34]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[35]  Daniel Raviv,et al.  A Unified Approach to Camera Fixation and Vision-Based Road Following , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[36]  A. V. van den Berg,et al.  Why two eyes are better than one for judgements of heading , 1994, Nature.

[37]  Keiji Tanaka,et al.  Integration of direction signals of image motion in the superior temporal sulcus of the macaque monkey , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[38]  M. Ali Taalebinezhaad,et al.  Direct recovery of motion and shape in the general case by fixation , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[39]  M. Graziano,et al.  Tuning of MST neurons to spiral motions , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[40]  W. Warren,et al.  The role of central and peripheral vision in perceiving the direction of self-motion , 1992, Perception & psychophysics.

[41]  Vision Research , 1961, Nature.

[42]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Nicholas G. Hatsopoulos,et al.  Visual navigation with a neural network , 1991, Neural Networks.

[44]  James A. Crowell,et al.  Estimating heading during eye movements , 1994, Vision Research.

[45]  Berthold K. P. Horn,et al.  Passive navigation , 1982, Comput. Vis. Graph. Image Process..

[46]  Zhengyou Zhang.  Motion and structure from two perspective views: from essential parameters to Euclidean motion through the fundamental matrix , 1997 .

[47]  Narendra Ahuja,et al.  Motion and Structure From Two Perspective Views: Algorithms, Error Analysis, and Error Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..