An Analysis of the Motion Signal Distributions Emerging from Locomotion through a Natural Environment

Some 50 years have passed since Gibson drew attention to the characteristic field of velocity vectors generated on the retina when an observer is moving through the three-dimensional world. Many theoretical, psychophysical, and physiological studies have demonstrated the use of such optic flow-fields for a number of navigational tasks under laboratory conditions, but little is known about the actual flowfield structure under natural operating conditions. To study the motion information available to the visual system in the real world, we moved a panoramic imaging device outdoors on accurately defined paths and simulated a biologically inspired motion detector network to analyse the distribution of motion signals. We found that motion signals are sparsely distributed in space and that local directions can be ambiguous and noisy. Spatial or temporal integration would be required to retrieve reliable information on the local motion vectors. Nevertheless, a surprisingly simple algorithm can retrieve rather accurately the direction of heading from sparse and noisy motion signal maps without the need for such pooling. Our approach thus may help to assess the role of specific environmental and computational constraints in natural optic flow processing.

[1]  R. Hetherington The Perception of the Visual World , 1952 .

[2]  Holger G. Krapp,et al.  Wide-Field, Motion-Sensitive Neurons and Optimal Matched Filters for Optic Flow , 1998 .

[3]  Holger G. Krapp,et al.  Extracting Egomotion from Optic Flow: Limits of Accuracy and Neural Matched Filters , 2001 .

[4]  Martin Egelhaaf,et al.  Neural Mechanisms of Visual Course Control in Insects , 1989 .

[5]  Alexander Borst,et al.  Principles of visual motion detection , 1989, Trends in Neurosciences.

[6]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[7]  S. McKee,et al.  Simultaneous encoding of direction at a local and global scale , 1998, Perception & psychophysics.

[8]  Raimond Matthias Wüst,et al.  Extracting egomotion parameters from optic flow: principal limits for animals and machines , 1997 .

[9]  S. Laughlin,et al.  Spatio-temporal properties of motion detectors matched to low image velocities in hovering insects , 1997, Vision Research.

[10]  Hans-Ortwin Nalbach Multisensory control of eyestalk orientation in decapod crustaceans : an ecological approach , 1990 .

[11]  A. Verri,et al.  Computational aspects of motion perception in natural and artificial vision systems. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[12]  J A Perrone,et al.  Model for the computation of self-motion in biological systems. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[13]  V. M. Generalized Gradient Schemes for the Measurement of Two-Dimensional Image Motion , .

[14]  M. Srinivasan,et al.  Reflective surfaces for panoramic imaging. , 1997, Applied optics.

[15]  W. Reichardt,et al.  A two dimensional field theory for motion computation , 1988, Biological Cybernetics.

[16]  J. Zeil,et al.  Towards an Ecology of Motion Vision , 2001 .

[17]  G. Nalbach,et al.  Distribution of optokinetic sensitivity over the eye of crabs: its relation to habitat and possible role in flow-field analysis , 2004, Journal of Comparative Physiology A.

[18]  R. Hardie,et al.  Facets of Vision , 1989, Springer Berlin Heidelberg.

[19]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[20]  Wilson S. Geisler,et al.  Motion streaks provide a spatial code for motion direction , 1999, Nature.

[21]  J. Zanker,et al.  Motion vision : computational, neural, and ecological constraints , 2001 .

[22]  W. Reichardt,et al.  Properties of individual movement detectors as derived from behavioural experiments on the visual system of the fly , 1988, Biological Cybernetics.

[23]  A. Verri,et al.  First-order analysis of optical flow in monkey brain. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[24]  D J Heeger,et al.  Model for the extraction of image flow. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[25]  C. Koch,et al.  The analysis of visual motion: from computational theory to neuronal mechanisms. , 1986, Annual review of neuroscience.

[26]  B. J. Frost,et al.  The processing of object and self-motion in the tectofugal and accessory optic pathways of birds , 1990, Vision Research.

[27]  K. Nakayama,et al.  The aperture problem—II. Spatial integration of velocity information along contours , 1988, Vision Research.

[28]  R. Hengstenberg,et al.  Estimation of self-motion by optic flow processing in single visual interneurons , 1996, Nature.

[29]  E. Hildreth The computation of the velocity field , 1984, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[30]  Johannes M. Zanker,et al.  Combining Local Motion Signals: A Computational Study of Segmentation and Transparency , 2001 .

[31]  Peter W. McOwan,et al.  Robust velocity computation from a biologically motivated model of motion perception , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[32]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[33]  J. Koenderink,et al.  Facts on optic flow , 1987, Biological Cybernetics.

[34]  Johannes M. Zanker,et al.  A glimpse into crabworld , 1997, Vision Research.

[35]  Holger G. Krapp,et al.  Wide-field, motion-sensitive neurons and matched filters for optic flow fields , 2000, Biological Cybernetics.

[36]  J M Zanker,et al.  Mechanisms of human motion perception: combining evidence from evoked potentials, behavioural performance and computational modelling , 2000, The European journal of neuroscience.

[37]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[38]  Werner Reichardt,et al.  Evaluation of optical motion information by movement detectors , 1987, Journal of Comparative Physiology A.

[39]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.