Robust Bioinspired Architecture for Optical-Flow Computation

Motion estimation from image sequences, called optical flow, has been deeply analyzed by the scientific community. Despite the number of different models and algorithms, none of them covers all problems associated with real-world processing. This paper presents a novel customizable architecture of a neuromorphic robust optical flow (multichannel gradient model) based on reconfigurable hardware with the properties of the cortical motion pathway, thus obtaining a useful framework for building future complex bioinspired real-time systems with high computational complexity. The presented architecture is customizable and adaptable, while emulating several neuromorphic properties, such as the use of several information channels of small bit width, which is the nature of the brain. This paper includes the resource usage and performance data, as well as a comparison with other systems. This hardware platform has many application fields in difficult environments due to its bioinspired nature and robustness properties, and it can be used as starting point in more complex systems.

[1]  R. F. Hess,et al.  Temporal properties of human visual filters: number, shapes and spatial covariation , 1992, Vision Research.

[2]  Peter W. McOwan,et al.  A Multi-Differential Neuromorphic Approach to Motion Detection , 1999, Int. J. Neural Syst..

[3]  Javier Díaz,et al.  FPGA-based real-time optical-flow system , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[5]  A. Johnston,et al.  A unified account of three apparent motion illusions , 1995, Vision Research.

[6]  G. Orban,et al.  Speed and direction selectivity of macaque middle temporal neurons. , 1993, Journal of neurophysiology.

[7]  R. Hess,et al.  Temporal frequency filters in the human peripheral visual field , 1992, Vision Research.

[8]  Christof Koch,et al.  An analog VLSI velocity sensor using the gradient method , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[9]  Brendan McCane,et al.  Recovering Motion Fields: An Evaluation of Eight Optical Flow Algorithms , 1998, BMVC.

[10]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[11]  P. McOwan,et al.  A computational model of the analysis of some first-order and second-order motion patterns by simple and complex cells , 1992, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[12]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  P. McLeod,et al.  Preserved and Impaired Detection of Structure From Motion by a 'Motion-blind" Patient , 1996 .

[14]  J. Koenderink,et al.  Representation of local geometry in the visual system , 1987, Biological Cybernetics.

[15]  Alan A. Stocker,et al.  Analog integrated 2-D optical flow sensor with programmable pixels , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[16]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[17]  G. Botella,et al.  Pre-processor for bioinspired optical flow models: a customizable hardware implementation , 2006, MELECON 2006 - 2006 IEEE Mediterranean Electrotechnical Conference.

[18]  A. Stocker.  Analog Integrated 2-D Optical Flow Sensor , 2006 .

[19]  Heung-Kyu Lee,et al.  Block-matching algorithm based on an adaptive reduction of the search area for motion estimation , 2000, Real Time Imaging.

[20]  David J. Fleet,et al.  On optical flow , 1995 .

[21]  Peter W. McOwan,et al.  Robust velocity computation from a biologically motivated model of motion perception , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[22]  Unai Bidarte,et al.  Optical Flow Estimator Using VHDL for Implementation in FPGA , .

[23]  W. Newsome,et al.  Motion selectivity in macaque visual cortex. I. Mechanisms of direction and speed selectivity in extrastriate area MT. , 1986, Journal of neurophysiology.

[24]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[25]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.

[26]  Unai Bidarte,et al.  Hardware implementation of optical flow constraint equation using FPGAs , 2005, Comput. Vis. Image Underst..

[27]  Dah-Jye Lee,et al.  FPGA-Based Embedded Motion Estimation Sensor , 2008, Int. J. Reconfigurable Comput..

[28]  Peter William McOwan,et al.  Humans deceived by predatory stealth strategy camouflaging motion , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[29]  A. Johnston,et al.  Perceived motion of contrast-modulated gratings: Predictions of the multi-channel gradient model and the role of full-wave rectification , 1995, Vision Research.

[30]  P.C. Arribas.  Real time hardware vision system applications: optical flow and time to contact detector units , 2004, Proceedings of the Fifth IEEE International Caracas Conference on Devices, Circuits and Systems, 2004..

[31]  Rama Chellappa,et al.  Accuracy vs. Efficiency Trade-offs in Optical Flow Algorithms , 1996, ECCV.

[32]  Dah-Jye Lee,et al.  A Fast and Accurate Tensor-based Optical Flow Algorithm Implemented in FPGA , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[33]  P. W. McOwan,et al.  Biological computation of image motion from flows over boundaries , 2003, Journal of Physiology-Paris.

[34]  Eduardo Ros,et al.  Real-time Architecture for Robust Motion Estimation under Varying Illumination Conditions , 2007, J. Univers. Comput. Sci..

[35]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[36]  Brendan McCane,et al.  On Benchmarking Optical Flow , 2001, Comput. Vis. Image Underst..