Heading detection using motion templates and eye velocity gain fields

Eye or head rotation would influence perceived heading direction if it were coded by cells tuned only to retinal flow patterns that correspond to linear self-movement. We propose a model for heading detection based on motion templates that are also Gaussian-tuned to the amount of rotational flow. Such retinal flow templates allow explicit use of extra-retinal signals to create templates tuned to head-centric flow as seen by the stationary eye. Our model predicts an intermediate layer of 'eye velocity gain fields' in which 'rate-coded' eye velocity is multiplied with responses of templates sensitive to specific retinal flow patterns. By combination of the activities of one retinal flow template and many units with an eye velocity gain field, a new type of unit appears: its preferred retinal flow changes dynamically in accordance with the eye rotation velocity. This unit's activity becomes thereby approximately invariant to the amount of eye rotation. The units with eye velocity gain fields from the motion-analogue of the units with eye position gain fields found in area 7a, which according to our general approach, are needed to transform position from retino-centric to head-centric coordinates. The rotation-tuned templates can also provide rate-coded visual estimates of eye rotation to allow a pure visual compensation for rotational flow. Our model is consistent with psychophysical data that indicate a role for extra-retinal as well as visual rotation signals in the correct perception of heading.

[1]  Markus Lappe,et al.  A Neural Network for the Processing of Optic Flow from Ego-Motion in Man and Higher Mammals , 1993, Neural Computation.

[2]  Markus Lappe,et al.  An illusory transformation in a model of optic flow processing , 1995, Vision Research.

[3]  M. Goldberg,et al.  Ventral intraparietal area of the macaque: anatomic location and visual response properties. , 1993, Journal of neurophysiology.

[4]  D J Hannon,et al.  Eye movements and optical flow. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[5]  A. V. D. Berg,et al.  Perception of heading , 1993, Nature.

[6]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[7]  A. Verri,et al.  First-order analysis of optical flow in monkey brain. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[8]  R A Andersen,et al.  The response of area MT and V1 neurons to transparent motion , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  R. Andersen Visual and eye movement functions of the posterior parietal cortex. , 1989, Annual review of neuroscience.

[10]  R. Andersen,et al.  Mechanisms of Heading Perception in Primate Visual Cortex , 1996, Science.

[11]  K. Hoffmann,et al.  Optic Flow Processing in Monkey STS: A Theoretical and Experimental Approach , 1996, The Journal of Neuroscience.

[12]  R. Wurtz,et al.  Response of monkey MST neurons to optic flow stimuli with shifted centers of motion , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  A. V. van den Berg,et al.  Why two eyes are better than one for judgements of heading , 1994, Nature.

[14]  J Duysens,et al.  Neurons in the ventral intraparietal area of awake macaque monkey closely resemble neurons in the dorsal part of the medial superior temporal area in their responses to optic flow patterns. , 1996, Journal of neurophysiology.

[15]  R. Wurtz,et al.  Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli. , 1991, Journal of neurophysiology.

[16]  A. V. van den Berg,et al.  Optic Flow and the Kinematics of Eye Movements , 1996 .

[17]  M. Graziano,et al.  Tuning of MST neurons to spiral motions , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  L. Fogassi,et al.  Eye position effects on visual, memory, and saccade-related activity in areas LIP and 7a of macaque , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  R. Andersen,et al.  The role of the posterior parietal cortex in coordinate transformations for visual-motor integration. , 1988, Canadian journal of physiology and pharmacology.

[20]  A. V. van den Berg,et al.  Judgements of Heading , 1996, Vision Research.

[21]  Daniel J. Hannon,et al.  Direction of self-motion is perceived from optical flow , 1988, Nature.

[22]  J. Perrone,et al.  A model of self-motion estimation within primate extrastriate visual cortex , 1994, Vision Research.

[23]  D Regan,et al.  How do we avoid confounding the direction we are looking and the direction we are moving? , 1982, Science.

[24]  A V van den Berg Optic flow and the kinematics of eye movements , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[25]  P. Thier,et al.  Responses of Visual‐Tracking Neurons from Cortical Area MST‐I to Visual, Eye and Head Motion , 1992, The European journal of neuroscience.

[26]  G. Edelman,et al.  Signal and sense : local and global order in perceptual maps , 1990 .

[27]  Eli Brenner,et al.  Humans combine the optic flow with static depth cues for robust perception of heading , 1994, Vision Research.

[28]  A. V. D. Berg,et al.  Robustness of perception of heading from optic flow , 1992, Vision Research.

[29]  James A. Crowell,et al.  Estimating heading during eye movements , 1994, Vision Research.

[30]  K. Tanaka,et al.  Underlying mechanisms of the response specificity of expansion/contraction and rotation cells in the dorsal part of the medial superior temporal area of the macaque monkey. , 1989, Journal of neurophysiology.

[31]  F. Bremmer,et al.  Spatial invariance of visual receptive fields in parietal cortex neurons , 1997, Nature.

[32]  J. Dichgans,et al.  Three-dimensional properties of human pursuit eye movements , 1992, Vision Research.

[33]  J HeegerDavid,et al.  Subspace methods for recovering rigid motion I , 1992 .

[34]  J. Koenderink,et al.  Exterospecific component of the motion parallax field. , 1981, Journal of the Optical Society of America.

[35]  J A Perrone,et al.  Model for the computation of self-motion in biological systems. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[36]  James A. Crowell,et al.  The perception of heading during eye movements , 1992, Nature.

[37]  R. M. Siegel,et al.  Encoding of spatial location by posterior parietal neurons. , 1985, Science.

[38]  S. Squatrito,et al.  Gaze field properties of eye position neurones in areas MST and 7a of the macaque monkey , 1996, Visual Neuroscience.

[39]  J H Rieger,et al.  Processing differential image motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[40]  R. Hetherington The Perception of the Visual World , 1952 .

[41]  A. V. van den Berg Robustness of perception of heading from optic flow. , 1992, Vision research.

[42]  K. Tanaka,et al.  Analysis of motion of the visual field by direction, expansion/contraction, and rotation cells clustered in the dorsal part of the medial superior temporal area of the macaque monkey. , 1989, Journal of neurophysiology.