A Noise Filter for Dynamic Vision Sensors based on Global Space and Time Information

Neuromorphic event-based dynamic vision sensors (DVS) have much faster sampling rates and a higher dynamic range than frame-based imagers. However, they are sensitive to background activity (BA) events which are unwanted. we propose a new criterion with little computation overhead for defining real events and BA events by utilizing the global space and time information rather than the local information by Gaussian convolution, which can be also used as a filter. We denote the filter as GF. We demonstrate GF on three datasets, each recorded by a different DVS with different output size. The experimental results show that our filter produces the clearest frames compared with baseline filters and run fast.

[1]  Shoushun Chen,et al.  Live demonstration: A 768 × 640 pixels 200Meps dynamic vision sensor , 2017, 2017 IEEE International Symposium on Circuits and Systems (ISCAS).

[2]  C. Mead,et al.  Neuromorphic Robot Vision with Mixed Analog- Digital Architecture , 2005 .

[3]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[4]  Yang Feng,et al.  Event Density Based Denoising Method for Dynamic Vision Sensor , 2020, Applied Sciences.

[5]  Tobi Delbrück,et al.  Live demonstration: Convolutional neural network driven by dynamic vision sensor playing RoShamBo , 2017, 2017 IEEE International Symposium on Circuits and Systems (ISCAS).

[6]  Tobias Delbrück,et al.  Frame-free dynamic digital vision , 2008 .

[7]  Tobi Delbrück,et al.  A USB3.0 FPGA event-based filtering and tracking framework for dynamic vision sensors , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[8]  Daniel Matolin,et al.  A QVGA 143 dB Dynamic Range Frame-Free PWM Image Sensor With Lossless Pixel-Level Video Compression and Time-Domain CDS , 2011, IEEE Journal of Solid-State Circuits.

[9]  Tobi Delbrück,et al.  Design of a spatiotemporal correlation filter for event-based sensors , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[10]  Garrick Orchard,et al.  Evaluating noise filtering for event-based asynchronous change detection image sensors , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[11]  Davide Scaramuzza,et al.  Lifetime estimation of events from Dynamic Vision Sensors , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Ryad Benosman,et al.  Asynchronous Neuromorphic Event-Driven Image Filtering , 2014, Proceedings of the IEEE.

[13]  Tobi Delbruck,et al.  A 240×180 10mW 12us latency sparse-output vision sensor for mobile applications , 2013, 2013 Symposium on VLSI Circuits.

[14]  Tobi Delbrück,et al.  A Low Power, Fully Event-Based Gesture Recognition System , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Garrick Orchard,et al.  A Noise Filtering Algorithm for Event-Based Asynchronous Change Detection Image Sensors on TrueNorth and Its Implementation on TrueNorth , 2018, Front. Neurosci..

[16]  Shoushun Chen,et al.  A dynamic vision sensor with direct logarithmic output and full-frame picture-on-demand , 2017, 2017 IEEE International Symposium on Circuits and Systems (ISCAS).

[17]  Eric A. Vittoz,et al.  A communication architecture tailored for analog VLSI artificial neural networks: intrinsic performance and limitations , 1994, IEEE Trans. Neural Networks.

[18]  Ryan Kastner,et al.  $O(N)$O(N)-Space Spatiotemporal Filter for Reducing Noise in Neuromorphic Vision Sensors , 2021, IEEE Trans. Emerg. Top. Comput..