A Parallel Noise-Robust Algorithm to Recover Depth Information from Radial Flow Fields

A parallel algorithm operating on the units (neurons) of an artificial retina is proposed to recover depth information in a visual scene from radial flow fields induced by ego motion along a given axis. The system consists of up to 600 radii with fewer than 65 radially arranged neurons on each radius. Neurons are connected only to their nearest neighbors, and they are excited as soon as a sufficiently strong gray-level change occurs. The time difference of two subsequently activated neurons is then used by the last-excited neuron to compute the depth information. All algorithmic calculations remain strictly local, and information is exchanged only between adjacent active neurons (except for the final read-out). This, in principle, permits parallel implementation. Furthermore, it is demonstrated that the calculation of the object coordinates requires only a single multiplication with a constant, which is dependent on only the retinal position of the active neuron. The initial restriction to local operations makes the algorithm very noise sensitive. In order to solve this problem, a prediction mechanism is introduced. After an object coordinate has been determined, the active neuron computes the time when the next neuronal excitation should take place. This estimated time is transferred to the respective next neuron, which will wait for this excitation only within a certain time window. If the excitation fails to arrive within this window, the previously computed object coordinate is regarded as noisy and discarded. We will show that this predictive mechanism relies also on only a (second) single multiplication with another neuron-dependent constant. Thus, computational complexity remains low, and noisy depth coordinates are efficiently eliminated. Thus, the algorithm is very fast and operates in real time on 128128 images even in a serial implementation on a relatively slow computer. The algorithm is tested on scenes of growing complexity, and a detailed error analysis is provided showing that the depth error remains very low in most cases. A comparison to standard flow-field analysis shows that our algorithm outperforms the older method by far. The analysis of the algorithm also shows that it is generally applicable despite its restrictions, because it is fast and accurate enough such that a complete depth percept can be composed from radial flow field segments. Finally, we suggest how to generalize the algorithm, waiving the restriction of radial flow.

[1]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[2]  S. Ullman The interpretation of structure from motion , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[3]  Eric L. Schwartz,et al.  Computational anatomy and functional architecture of striate cortex: A spatial mapping approach to perceptual coding , 1980, Vision Research.

[4]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[5]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[6]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[7]  T. Poggio,et al.  The analysis of stereopsis. , 1984, Annual review of neuroscience.

[8]  J. Koenderink Optic flow , 1986, Vision Research.

[9]  H. Wagner Flight Performance and Visual Control of Flight of the Free-Flying Housefly (Musca Domestica L.) I. Organization of the Flight Motor , 1986 .

[10]  H. Wagner Flight performance and visual control of flight of the free-flying housefly (Musca domestica L.) II. Pursuit of targets , 1986 .

[11]  C. Koch,et al.  The analysis of visual motion: from computational theory to neuronal mechanisms. , 1986, Annual review of neuroscience.

[12]  S. Ullman,et al.  Rigidity and Smoothness of Motion , 1987 .

[13]  P. Green,et al.  HEAD-BOBBING DURING WALKING, RUNNING AND FLYING: RELATIVE MOTION PERCEPTION IN THE PIGEON , 1988 .

[14]  Tomaso Poggio,et al.  Cooperative computation of stereo disparity , 1988 .

[15]  T. Poggio,et al.  A parallel algorithm for real-time computation of optical flow , 1989, Nature.

[16]  S. J. Phillips,et al.  Head orientation in pigeons: postural, locomotor and visual determinants. , 1989, Brain, behavior and evolution.

[17]  A. Verri,et al.  Analysis of differential and matching methods for optical flow , 1989, [1989] Proceedings. Workshop on Visual Motion.

[18]  Yiannis Aloimonos,et al.  Obstacle Avoidance Using Flow Field Divergence , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Allan D. Jepson,et al.  Visual Perception of Three-Dimensional Motion , 1990, Neural Computation.

[20]  David J. Fleet,et al.  Phase-based disparity measurement , 1991, CVGIP Image Underst..

[21]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[22]  R. Wurtz,et al.  Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli. , 1991, Journal of neurophysiology.

[23]  R. Douglas,et al.  A silicon neuron , 1991, Nature.

[24]  P. Green,et al.  Head orientation in pigeons during landing flight , 1992, Vision Research.

[25]  N. Franceschini,et al.  From insect vision to robot vision , 1992 .

[26]  Giulio Sandini,et al.  On the Advantages of Polar and Log-Polar Mapping for Direct Estimation of Time-To-Impact from Optical Flow , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Nicola Ancona,et al.  Optical flow from 1-D correlation: Application to a simple time-to-crash detector , 1993, 1993 (4th) International Conference on Computer Vision.

[28]  H. P. Zeigier,et al.  Vision, brain, and behavior in birds. , 1994 .

[29]  M. Graziano,et al.  Tuning of MST neurons to spiral motions , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[30]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[31]  David J. Fleet,et al.  On optical flow , 1995 .

[32]  R. Wurtz,et al.  Response of monkey MST neurons to optic flow stimuli with shifted centers of motion , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  Ruye Wang A network model for the optic flow computation of the MST neurons , 1996, Neural Networks.

[34]  K. Hoffmann,et al.  Optic Flow Processing in Monkey STS: A Theoretical and Experimental Approach , 1996, The Journal of Neuroscience.

[35]  Nicolas Franceschini,et al.  Engineering Applications of Small Brains , 1997 .

[36]  N. Qian Binocular Disparity and the Perception of Depth , 1997, Neuron.

[37]  A Fast and Robust Cluster Update Algorithm for Image Segmentation in Spin-Lattice Models Without AnnealingVisual Latencies Revisited , 1998, Neural Computation.