Event-Based Eccentric Motion Detection Exploiting Time Difference Encoding

Attentional selectivity tends to follow events considered as interesting stimuli. Indeed, the motion of visual stimuli present in the environment attract our attention and allow us to react and interact with our surroundings. Extracting relevant motion information from the environment presents a challenge with regards to the high information content of the visual input. In this work we propose a novel integration between an eccentric down-sampling of the visual field, taking inspiration from the varying size of receptive fields (RFs) in the mammalian retina, and the Spiking Elementary Motion Detector (sEMD) model. We characterize the system functionality with simulated data and real world data collected with bio-inspired event driven cameras, successfully implementing motion detection along the four cardinal directions and diagonally.

[1]  Michael B. Reiser,et al.  The Emergence of Directional Selectivity in the Visual Motion Pathway of Drosophila , 2017, Neuron.

[2]  J. Kulikowski,et al.  Contribution of two movement detecting mechanisms to central and peripheral vision , 1983, Vision Research.

[3]  John Lazzaro,et al.  A Delay-Line Based Motion Detection Chip , 1990, NIPS.

[4]  P Cavanagh,et al.  Attention-based motion perception. , 1992, Science.

[5]  Christina J. Howard,et al.  Unexpected changes in direction of motion attract attention. , 2010, Attention, perception & psychophysics.

[6]  A. Borst,et al.  Common circuit design in fly and mammalian motion vision , 2015, Nature Neuroscience.

[7]  H. Barlow,et al.  The mechanism of directionally selective units in rabbit's retina. , 1965, The Journal of physiology.

[8]  B. Hassenstein,et al.  Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus , 1956 .

[9]  Yiannis Aloimonos,et al.  Obstacle Avoidance Using Flow Field Divergence , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Steve B. Furber,et al.  The SpiNNaker Project , 2014, Proceedings of the IEEE.

[11]  Davide Scaramuzza,et al.  A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[12]  Tobias Brosch,et al.  On event-based optical flow detection , 2015, Front. Neurosci..

[13]  D. Baylor,et al.  Mosaic arrangement of ganglion cell receptive fields in rabbit retina. , 1997, Journal of neurophysiology.

[14]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[15]  Alexander Gelbukh,et al.  Human-Inspired Computing and Its Applications , 2014, Lecture Notes in Computer Science.

[16]  Ryad Benosman,et al.  Bioinspired event-driven collision avoidance algorithm based on optic flow , 2015, 2015 International Conference on Event-based Control, Communication, and Signal Processing (EBCCSP).

[17]  Eero P. Simoncelli,et al.  Metamers of the ventral stream , 2011, Nature Neuroscience.

[18]  Davide Scaramuzza,et al.  Focus Is All You Need: Loss Functions for Event-Based Vision , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Yiannis Aloimonos,et al.  Event-Based Moving Object Detection and Tracking , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Shawn E. Christ,et al.  Motion onset captures attention: A rejoinder to Franconeri and Simons (2005) , 2006, Perception & psychophysics.

[21]  M. Holderied,et al.  Bat echolocation calls: adaptation and convergent evolution , 2007, Proceedings of the Royal Society B: Biological Sciences.

[22]  R. Abrams,et al.  The onset of receding motion captures attention: Comment on Franconeri and Simons (2003) , 2005, Perception & psychophysics.

[23]  Giulio Sandini,et al.  Space-variant vision for an active camera mount , 1995, Defense, Security, and Sensing.

[24]  M. A. MacIver,et al.  Sensory acquisition in active sensing systems , 2006, Journal of Comparative Physiology A.

[25]  Daniel Matolin,et al.  A QVGA 143 dB Dynamic Range Frame-Free PWM Image Sensor With Lossless Pixel-Level Video Compression and Time-Domain CDS , 2011, IEEE Journal of Solid-State Circuits.

[26]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[27]  H. Wässle,et al.  The mosaic of nerve cells in the mammalian retina , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[28]  R. Abrams,et al.  Motion Onset Captures Attention , 2003, Psychological science.

[29]  Ryad Benosman,et al.  Spiking Optical Flow for Event-Based Sensors Using IBM's TrueNorth Neurosynaptic System , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[30]  Wolf Zinke,et al.  Speed change detection in foveal and peripheral vision , 2012, Vision Research.

[31]  J. Maunsell,et al.  The role of attention in visual processing. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[32]  Alexandre Bernardino,et al.  Binocular tracking: integrating perception and control , 1999, IEEE Trans. Robotics Autom..

[33]  Ennio Mingolla,et al.  Modeling a space-variant cortical representation for apparent motion. , 2013, Journal of vision.

[34]  Hong Yang,et al.  DART: Distribution Aware Retinal Transform for Event-Based Cameras , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Martin Egelhaaf,et al.  Spiking Elementary Motion Detector in Neuromorphic Systems , 2018, Neural Computation.

[36]  Jj Org Kramer.  Compact Integrated Motion Sensor with Three-pixel Interaction , 1996 .

[37]  T. Delbruck,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 1 , 2022 .

[38]  G. Rubin,et al.  A directional tuning map of Drosophila elementary motion detectors , 2013, Nature.

[39]  Massimiliano Giulioni,et al.  Event-Based Computation of Motion Flow on a Neuromorphic Analog Neural Platform , 2016, Front. Neurosci..

[40]  S. Dumoulin,et al.  The Relationship between Cortical Magnification Factor and Population Receptive Field Size in Human Visual Cortex: Constancies in Cortical Architecture , 2011, The Journal of Neuroscience.

[41]  A. Borst,et al.  Fly motion vision. , 2010, Annual review of neuroscience.

[42]  Daniel Gutierrez-Galan,et al.  Neuromorphic Sensory Integration for Combining Sound Source Localization and Collision Avoidance , 2019, 2019 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[43]  Chiara Bartolozzi,et al.  Asynchronous frameless event-based optical flow , 2012, Neural Networks.

[44]  Alexander Borst,et al.  Optogenetic and Pharmacologic Dissection of Feedforward Inhibition in Drosophila Motion Vision , 2014, The Journal of Neuroscience.

[45]  Chiara Bartolozzi,et al.  Event-Based Visual Flow , 2014, IEEE Transactions on Neural Networks and Learning Systems.