An efficient neuromorphic analog network for motion estimation

Optical flow estimation is a critical mechanism for autonomous mobile robots as it provides a range of useful information. As real-time processing is mandatory in this case, an efficient solution is the use of specific very large scale integration (VLSI) analog circuits. This paper presents a simple and regular architecture based on analog circuits, which implements the entire processing line from photoreceptor to accurate and reliable optical flow estimation. The algorithm we propose, is an energy-based method using a novel wideband velocity-tuned filter which proves to be an efficient alternative to the well-known Gabor filters. Our approach shows that a high level of accuracy can be obtained from a small number of loosely tuned filters. It exhibits similar or improved performance to that of other existing algorithms, but with a much lower complexity.

[1]  Andrew B. Watson,et al.  A look at motion in the frequency domain , 1983 .

[2]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[3]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[4]  Carver A. Mead,et al.  An Integrated Analog Optical Motion Sensor , 1986 .

[5]  D J Heeger,et al.  Model for the extraction of image flow. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[6]  Misha Mahowald,et al.  A silicon model of early visual processing , 1993, Neural Networks.

[7]  Jin Luo,et al.  Computing motion using analog and binary resistive networks , 1988, Computer.

[8]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[9]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[10]  David J. Fleet,et al.  Performance of optical flow techniques , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Joseph J. Atick,et al.  What Does the Retina Know about Natural Scenes? , 1992, Neural Computation.

[12]  T. Delbruck Silicon retina with correlation-based, velocity-tuned pixels , 1993 .

[13]  Leon O. Chua,et al.  Design of linear cellular neural networks for motion sensitive filtering , 1993 .

[14]  Tobi Delbrück,et al.  Silicon retina with correlation-based, velocity-tuned pixels , 1993, IEEE Trans. Neural Networks.

[15]  Christine Choppy,et al.  Recent Trends in Data Type Specification , 1993, Lecture Notes in Computer Science.

[16]  Jeanny Hérault,et al.  Realistic Simulation Tool for Early Visual Processing Including Space, Time and Colour Data , 1993, IWANN.

[17]  Jeanny Hérault A model of colour processing in the retina of vertebrates: From photoreceptors to colour opposition and colour constancy phenomena , 1996, Neurocomputing.

[18]  Jj Org Kramer Compact Integrated Motion Sensor with Three-pixel Interaction , 1996 .

[19]  Giacomo Indiveri,et al.  Analog VLSI architectures for motion processing: from fundamental limits to system applications , 1996, Proc. IEEE.

[20]  Rahul Sarpeshkar,et al.  A Low-Power Wide-Linear-Range Transconductance Amplifier , 1997 .

[21]  Christof Koch,et al.  Analog CMOS velocity sensors , 1997, Electronic Imaging.

[22]  G. Sicard,et al.  Analog vision chip for sensing edges, contrasts and motion , 1997, Proceedings of 1997 IEEE International Symposium on Circuits and Systems. Circuits and Systems in the Information Age ISCAS '97.

[23]  Jeanny Hérault,et al.  From retinal circuits to motion processing: a neuromorphic approach to velocity estimation , 1997, ESANN.

[24]  Christof Koch,et al.  Real-Time Analog VLSI Sensors for 2-D Direction of Motion , 1997, ICANN.

[25]  Leon O. Chua,et al.  Estimating optical flow with cellular neural networks , 1998 .

[26]  Bertram E. Shi,et al.  Gabor-type filtering in space and time with cellular neural networks , 1998 .

[27]  Denis Pellerin,et al.  Spatiotemporal energy-based method for velocity estimation , 1998, Signal Process..

[28]  Christof Koch,et al.  Compact real-time 2D gradient-based analog VLSI motion sensor , 1998, Other Conferences.