Lossless Compression of Data From Static and Mobile Dynamic Vision Sensors-Performance and Trade-Offs

Dynamic Vision Sensors (DVS) are emerging retinomorphic visual capturing devices, with great advantages over conventional vision sensors in terms of wide dynamic range, low power consumption, and high temporal resolution. The bio-inspired approach of the DVS results in lower data rates than conventional vision sensors. Still, such data can be further compressed. Compression of DVS data is an emerging research area and a detailed performance comparison of different compression strategies for these data is still missing. This paper addresses lossless compression strategies for data output by neuromorphic visual sensors. We compare the performance of a number of strategies, including the only strategy developed specifically for such data and other more generic data compression strategies, tailored here to the case of neuromorphic data. We perform the comparison in terms of compression ratio, as well as compression and decompression speed and latency. Moreover, the compression performance analysis is performed under diverse scenarios including stationary and mobile DVS. According to the detailed experimental analysis, Lempel-Ziv-Markov chain algorithm (LZMA) achieves the best compression ratios among all the considered strategies for the case when the DVS is static. On the other hand, Spike coding achieves the best compression ratios under the scenario when spike events are produced by a sensor in motion. However, both strategies result in low compression speed and high latency which restrict the applications of these strategies in real-time scenarios. The Brotli strategy achieves the best trade-off between compression ratio, speed and latency under static as well as mobile scenarios. We also observe a significant decrease in compression and decompression performance (in terms of ratio, speed and latency) of all the strategies under mobile DVS scenarios.

[1]  Tiejun Huang,et al.  Event-Based Vision Enhanced: A Joint Detection Framework in Autonomous Driving , 2019, 2019 IEEE International Conference on Multimedia and Expo (ICME).

[2]  Maria G. Martini,et al.  Bandwidth Modeling of Silicon Retinas for Next Generation Visual Sensor Networks , 2019, Sensors.

[3]  Shengyong Chen,et al.  Event-Based Stereo Depth Estimation Using Belief Propagation , 2017, Front. Neurosci..

[4]  Alistair Moffat,et al.  Index compression using 64‐bit words , 2010, Softw. Pract. Exp..

[5]  Tobi Delbrück,et al.  Steering a predator robot using a mixed frame/event-driven convolutional neural network , 2016, 2016 Second International Conference on Event-based Control, Communication, and Signal Processing (EBCCSP).

[6]  Davide Scaramuzza,et al.  Feature detection and tracking with the dynamic and active-pixel vision sensor (DAVIS) , 2016, 2016 Second International Conference on Event-based Control, Communication, and Signal Processing (EBCCSP).

[7]  Heinrich Garn,et al.  Estimation of Vehicle Speed Based on Asynchronous Data from a Silicon Retina Optical Sensor , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[8]  Tobi Delbrück,et al.  The event-camera dataset and simulator: Event-based data for pose estimation, visual odometry, and SLAM , 2016, Int. J. Robotics Res..

[9]  Fariborz Baghaei Naeini,et al.  A Novel Dynamic-Vision-Based Approach for Tactile Sensing Applications , 2020, IEEE Transactions on Instrumentation and Measurement.

[10]  Peter Deutsch,et al.  ZLIB Compressed Data Format Specification version 3.3 , 1996, RFC.

[11]  Maria G. Martini,et al.  Data rate estimation based on scene complexity for dynamic vision sensors on unmanned vehicles , 2018, 2018 IEEE 29th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC).

[12]  Narciso García,et al.  Event-Based Vision Meets Deep Learning on Steering Prediction for Self-Driving Cars , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Chiara Bartolozzi,et al.  Robust visual tracking with a freely-moving event camera , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Davide Scaramuzza,et al.  A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  T. Delbruck,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 1 , 2022 .

[16]  Matteo Matteucci,et al.  Attention Mechanisms for Object Recognition With Event-Based Cameras , 2018, 2019 IEEE Winter Conference on Applications of Computer Vision (WACV).

[17]  David A. Huffman,et al.  A method for the construction of minimum-redundancy codes , 1952, Proceedings of the IRE.

[18]  Stephan Schraml,et al.  Spatiotemporal multiple persons tracking using Dynamic Vision Sensor , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[19]  Davide Scaramuzza,et al.  Event-based, 6-DOF pose tracking for high-speed maneuvers , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Samuel Madden,et al.  Sprintz , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[21]  Fariborz Baghaei Naeini,et al.  A Novel Event-Based Incipient Slip Detection Using Dynamic Active-Pixel Vision Sensor (DAVIS) , 2018, Sensors.

[22]  Tobi Delbrück,et al.  Asynchronous Event-Based Binocular Stereo Matching , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Tobi Delbrück,et al.  A 128 X 128 120db 30mw asynchronous vision sensor that responds to relative intensity change , 2006, 2006 IEEE International Solid State Circuits Conference - Digest of Technical Papers.

[24]  Ian H. Witten,et al.  Arithmetic coding for data compression , 1987, CACM.

[25]  Maria G. Martini,et al.  Performance Comparison of Lossless Compression Strategies for Dynamic Vision Sensor Data , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Tiejun Huang,et al.  Spike Coding for Dynamic Vision Sensor in Intelligent Driving , 2019, IEEE Internet of Things Journal.

[27]  Leonid Boytsov,et al.  Decoding billions of integers per second through vectorization , 2012, Softw. Pract. Exp..

[28]  Yasuo Tabei,et al.  LZRR: LZ77 Parsing with Right Reference , 2018, 2019 Data Compression Conference (DCC).

[29]  Tiejun Huang,et al.  Spike Coding for Dynamic Vision Sensors , 2018, 2018 Data Compression Conference.