Less Data Same Information for Event-Based Sensors: A Bioinspired Filtering and Data Reduction Algorithm

Sensors provide data which need to be processed after acquisition to remove noise and extract relevant information. When the sensor is a network node and acquired data are to be transmitted to other nodes (e.g., through Ethernet), the amount of generated data from multiple nodes can overload the communication channel. The reduction of generated data implies the possibility of lower hardware requirements and less power consumption for the hardware devices. This work proposes a filtering algorithm (LDSI—Less Data Same Information) which reduces the generated data from event-based sensors without loss of relevant information. It is a bioinspired filter, i.e., event data are processed using a structure resembling biological neuronal information processing. The filter is fully configurable, from a “transparent mode” to a very restrictive mode. Based on an analysis of configuration parameters, three main configurations are given: weak, medium and restrictive. Using data from a DVS event camera, results for a similarity detection algorithm show that event data can be reduced up to 30% while maintaining the same similarity index when compared to unfiltered data. Data reduction can reach 85% with a penalty of 15% in similarity index compared to the original data. An object tracking algorithm was also used to compare results of the proposed filter with other existing filter. The LDSI filter provides less error (4.86 ± 1.87) when compared to the background activity filter (5.01 ± 1.93). The algorithm was tested under a PC using pre-recorded datasets, and its FPGA implementation was also carried out. A Xilinx Virtex6 FPGA received data from a 128 × 128 DVS camera, applied the LDSI algorithm, created a AER dataflow and sent the data to the PC for data analysis and visualization. The FPGA could run at 177 MHz clock speed with a low resource usage (671 LUT and 40 Block RAM for the whole system), showing real time operation capabilities and very low resource usage. The results show that, using an adequate filter parameter tuning, the relevant information from the scene is kept while fewer events are generated (i.e., fewer generated data).

[1]  HyungTae Kim,et al.  Color mixing and random search for optimal illumination in machine vision , 2013, Proceedings of the 2013 IEEE/SICE International Symposium on System Integration.

[2]  Bernabé Linares-Barranco,et al.  An Event-Driven Multi-Kernel Convolution Processor Module for Event-Driven Vision Sensors , 2012, IEEE Journal of Solid-State Circuits.

[3]  Bernabe Linares-Barranco,et al.  Comparison between Frame-Constrained Fix-Pixel-Value and Frame-Free Spiking-Dynamic-Pixel ConvNets for Visual Processing , 2012, Front. Neurosci..

[4]  Andre van Schaik,et al.  Asynchronous Binaural Spatial Audition Sensor With 2$\,\times\,$64$\,\times\,$4 Channel Output , 2014, IEEE Transactions on Biomedical Circuits and Systems.

[5]  Martin P. Nawrot,et al.  Neuromorphic Sensors, Olfaction , 2014, Encyclopedia of Computational Neuroscience.

[6]  Tatiana Baidyk,et al.  Robust vision system to illumination changes in a color-dependent task , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[7]  Tobi Delbruck,et al.  Robotic goalie with 3 ms reaction time at 4% CPU load using event-based dynamic vision sensor , 2013, Front. Neurosci..

[8]  Wen-Kuan Lin,et al.  LED strobe lighting for machine vision inspection , 2013, 2013 International Symposium on Next-Generation Electronics.

[9]  Steve B. Furber,et al.  Live demonstration: Ethernet communication linking two large-scale neuromorphic systems , 2013, 2013 European Conference on Circuit Theory and Design (ECCTD).

[10]  Angel Jiménez-Fernandez,et al.  Neuro-inspired system for real-time vision sensor tilt correction , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[11]  Massimo A. Sivilotti,et al.  Wiring considerations in analog VLSI systems, with application to field-programmable networks , 1992 .

[12]  Fernando Pardo,et al.  Selective Change Driven Vision Sensor With Continuous-Time Logarithmic Photoreceptor and Winner-Take-All Circuit for Pixel Selection , 2015, IEEE Journal of Solid-State Circuits.

[13]  Dawn M. Tilbury,et al.  The Emergence of Industrial Control Networks for Manufacturing Control, Diagnostics, and Safety Data , 2007, Proceedings of the IEEE.

[14]  Tobi Delbrück,et al.  Asynchronous Binaural Spatial Audition Sensor With 2 × 64 × 4 Channel Output , 2014, IEEE Trans. Biomed. Circuits Syst..

[15]  Tobi Delbruck,et al.  A 240×180 10mW 12us latency sparse-output vision sensor for mobile applications , 2013, 2013 Symposium on VLSI Circuits.

[16]  Jean-Dominique Decotignie,et al.  Ethernet-Based Real-Time and Industrial Communications , 2005, Proceedings of the IEEE.

[17]  Garrick Orchard,et al.  A Noise Filtering Algorithm for Event-Based Asynchronous Change Detection Image Sensors on TrueNorth and Its Implementation on TrueNorth , 2018, Front. Neurosci..

[18]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[19]  Tobi Delbrück,et al.  Human vs. computer slot car racing using an event and frame-based DAVIS vision sensor , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[20]  Fariborz Baghaei Naeini,et al.  A Novel Event-Based Incipient Slip Detection Using Dynamic Active-Pixel Vision Sensor (DAVIS) , 2018, Sensors.

[21]  Tobi Delbrück,et al.  Using FPGA for visuo-motor control with a silicon retina and a humanoid robot , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[22]  Adam Osseiran,et al.  An Investigation into Spike-Based Neuromorphic Approaches for Artificial Olfactory Systems , 2017, Sensors.

[23]  Angel Jiménez-Fernandez,et al.  AER spike-processing filter simulator: Implementation of an AER simulator based on cellular automata , 2011, Proceedings of the International Conference on Signal Processing and Multimedia Applications.

[24]  Bernabé Linares-Barranco,et al.  Event-driven sensing and processing for high-speed robotic vision , 2014, 2014 IEEE Biomedical Circuits and Systems Conference (BioCAS) Proceedings.

[25]  Bernabé Linares-Barranco,et al.  Feedforward Categorization on AER Motion Events Using Cortex-Like Features in a Spiking Neural Network , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[27]  Arianna Menciassi,et al.  Neuromorphic Vibrotactile Stimulation of Fingertips for Encoding Object Stiffness in Telepresence Sensory Substitution and Augmentation Applications , 2018, Sensors.

[28]  Tobi Delbruck,et al.  A 240 × 180 130 dB 3 µs Latency Global Shutter Spatiotemporal Vision Sensor , 2014, IEEE Journal of Solid-State Circuits.

[29]  Jim D. Garside,et al.  Overview of the SpiNNaker System Architecture , 2013, IEEE Transactions on Computers.

[30]  Bernabé Linares-Barranco,et al.  An arbitrary kernel convolution AER-transceiver chip for real-time image filtering , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[31]  Antonio Rios-Navarro,et al.  Real-time motor rotation frequency detection with event-based visual and spike-based auditory AER sensory integration for FPGA , 2015, 2015 International Conference on Event-based Control, Communication, and Signal Processing (EBCCSP).

[32]  Juan Barrios-Aviles,et al.  Event-based encoding from digital magnetic compass and ultrasonic distance sensor for navigation in mobile systems , 2016, 2016 IEEE 14th International Conference on Industrial Informatics (INDIN).

[33]  Giacomo Indiveri,et al.  A serial communication infrastructure for multi-chip address event systems , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[34]  Kwabena Boahen,et al.  Point-to-point connectivity between neuromorphic chips using address events , 2000 .