Bio-inspired motion detection in an FPGA-based smart camera module

Flying insects, despite their relatively coarse vision and tiny nervous system, are capable of carrying out elegant and fast aerial manoeuvres. Studies of the fly visual system have shown that this is accomplished by the integration of signals from a large number of elementary motion detectors (EMDs) in just a few global flow detector cells. We developed an FPGA-based smart camera module with more than 10,000 single EMDs, which is closely modelled after insect motion-detection circuits with respect to overall architecture, resolution and inter-receptor spacing. Input to the EMD array is provided by a CMOS camera with a high frame rate. Designed as an adaptable solution for different engineering applications and as a testbed for biological models, the EMD detector type and parameters such as the EMD time constants, the motion-detection directions and the angle between correlated receptors are reconfigurable online. This allows a flexible and simultaneous detection of complex motion fields such as translation, rotation and looming, such that various tasks, e.g., obstacle avoidance, height/distance control or speed regulation can be performed by the same compact device.

[1]  Colin D. Simpson,et al.  Industrial Electronics , 1936, Nature.

[2]  Martin Buss,et al.  An FPGA implementation of insect-inspired motion detector for high-speed vision systems , 2008, 2008 IEEE International Conference on Robotics and Automation.

[3]  F. Aubepart,et al.  FPGA implementation of elementary motion detectors for the visual guidance of micro-air-vehicles , 2004, 2004 IEEE International Symposium on Industrial Electronics.

[4]  A S French,et al.  Nonlinear models of the first synapse in the light-adapted fly retina. , 1995, Journal of neurophysiology.

[5]  H E M.  Journal of Neurophysiology , 1938, Nature.

[6]  V. Wigglesworth.  Annual Review of Entomology , 1960, Nature.

[7]  Vision Research , 1961, Nature.

[8]  C Cooper,et al.  Introduction. Philosophical Transactions of the Royal Society of London Series B-Biological Sciences , 1997 .

[9]  泰義 横小路,et al.  IEEE International Conference on Robotics and Automation , 1992 .

[10]  B. Hassenstein,et al.  Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus , 1956 .

[11]  Johannes M. Zanker,et al.  An Analysis of the Motion Signal Distributions Emerging from Locomotion through a Natural Environment , 2002, Biologically Motivated Computer Vision.

[12]  M. Land.  Visual acuity in insects. , 1997, Annual review of entomology.

[13]  J. H. Hateren,et al.  Information theoretical evaluation of parametric models of gain control in blowfly photoreceptor cells , 2001, Vision Research.

[14]  Christof Koch,et al.  An analog vlsi motion sensor based on the fly visual system , 2000 .

[15]  Reid R. Harrison,et al.  A biologically inspired analog IC for visual collision detection , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[16]  N. Franceschini,et al.  From insect vision to robot vision , 1992 .

[17]  M Egelhaaf,et al.  On the Computations Analyzing Natural Optic Flow: Quantitative Model Analysis of the Blowfly Motion Vision Pathway , 2005, The Journal of Neuroscience.

[18]  Alexander Borst,et al.  Mechanisms of dendritic integration underlying gain control in fly motion-sensitive interneurons , 1995, Journal of Computational Neuroscience.

[19]  Stéphane Viollet,et al.  Bio-inspired optical flow circuits for the visual guidance of micro air vehicles , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[20]  A. Borst,et al.  Adaptation of response transients in fly motion vision. II: Model studies , 2003, Vision Research.

[21]  Proceedings of the 2003 International Symposium on Circuits and Systems, ISCAS 2003, Bangkok, Thailand, May 25-28, 2003 , 2003 .

[22]  K. N. Leibovic,et al.  Information Processing in the Visual Systems of Arthropods , 1974 .

[23]  K. Kirschfeld.  The visual system of Musca: Studies on optics, structure and function , 1972 .

[24]  Bertram E. Shi,et al.  IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS — I : REGULAR PAPERS , VOL . ? ? , NO . ? ? , ? ? ? ? , 2007 .

[25]  A. Borst,et al.  Transient and steady-state response properties of movement detectors , 1989 .

[26]  R. A Harris,et al.  Afterimages in fly motion vision , 2002, Vision Research.

[27]  Robert A. Harris,et al.  Adaptation and the temporal delay filter of fly motion detectors , 1999, Vision Research.