HydraSpace: Computational Data Storage for Autonomous Vehicles

To ensure the safety and reliability of an autonomous driving system, multiple sensors have been installed in various positions around the vehicle to eliminate any blind point which could bring potential risks. Although the sensor data is quite useful for localization and perception, the high volume of these data becomes a burden for on-board computing systems. More importantly, the situation will worsen with the demand for increased precision and reduced response time of self-driving applications. Therefore, how to manage this massive amount of sensed data has become a big challenge. The existing vehicle data logging system cannot handle sensor data because both the data type and the amount far exceed its processing capability. In this paper, we propose a computational storage system called HydraSpace with multi-layered storage architecture and practical compression algorithms to manage the sensor pipe data, and we discuss five open questions related to the challenge of storage design for autonomous vehicles. According to the experimental results, the total reduction of storage space is achieved by 88.6% while maintaining the comparable performance of the self-driving applications.

[1]  Hesham A. Ali,et al.  Image compression algorithms in wireless multimedia sensor networks: A survey , 2015 .

[2]  Vineeth N. Balasubramanian,et al.  Deep Model Compression: Distilling Knowledge from Noisy Teachers , 2016, ArXiv.

[3]  Weisong Shi,et al.  HydraOne: An Indoor Experimental Research and Education Platform for CAVs , 2019, HotEdge.

[4]  Xiao Zhou,et al.  DCT-Based Color Image Compression Algorithm Using an Efficient Lossless Encoder , 2018, 2018 14th IEEE International Conference on Signal Processing (ICSP).

[5]  Xiaopei Wu,et al.  OpenVDAP: An Open Vehicular Data Analytics Platform for CAVs , 2018, 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS).

[6]  Franck Cappello,et al.  Fast Error-Bounded Lossy HPC Data Compression with SZ , 2016, 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS).

[7]  Deborah Estrin,et al.  GHT: a geographic hash table for data-centric storage , 2002, WSNA '02.

[8]  Hai Jin,et al.  A CostEffective, HighBandwidth Storage Architecture , 2002 .

[9]  Meir Feder,et al.  Image compression via improved quadtree decomposition algorithms , 1994, IEEE Trans. Image Process..

[10]  Wenying Zeng,et al.  Research on cloud storage architecture and key technologies , 2009, ICIS.

[11]  Di Wang,et al.  Image compression and encryption scheme based on 2D compressive sensing and fractional Mellin transform , 2015 .

[12]  David Minnen,et al.  Full Resolution Image Compression with Recurrent Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  D. Burschka,et al.  Motion segmentation and scene classification from 3D LIDAR data , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[14]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[15]  B. Koch,et al.  A Lidar Point Cloud Based Procedure for Vertical Canopy Structure Analysis And 3D Single Tree Modelling in Forest , 2008, Sensors.

[16]  Peter Lindstrom,et al.  Error Analysis of ZFP Compression for Floating-Point Data , 2018, SIAM J. Sci. Comput..

[17]  Doaa Mohammed Image Compression Using Block Truncation Coding , 2011 .

[18]  Peng Huang,et al.  TerseCades: Efficient Data Compression in Stream Processing , 2018, USENIX Annual Technical Conference.

[19]  Lubomir D. Bourdev,et al.  Real-Time Adaptive Image Compression , 2017, ICML.

[20]  David Minnen,et al.  Spatially adaptive image compression using a tiled deep network , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[21]  Chiranjeevi Karri,et al.  Fast vector quantization using a Bat algorithm for image compression , 2016 .

[22]  Junguo Zhang,et al.  Adaptive compressed sensing for wireless image sensor networks , 2017, Multimedia Tools and Applications.

[23]  Mark J. Shensa,et al.  The discrete wavelet transform: wedding the a trous and Mallat algorithms , 1992, IEEE Trans. Signal Process..

[24]  Lizhe Tan,et al.  Bit-Error Aware Lossless Color Image Compression , 2019, 2019 IEEE International Conference on Electro Information Technology (EIT).

[25]  Mahadev Satyanarayanan,et al.  Diamond: A Storage Architecture for Early Discard in Interactive Search , 2004, FAST.

[26]  Xiaogang Wang,et al.  Face Model Compression by Distilling Knowledge from Neurons , 2016, AAAI.

[27]  Weisong Shi,et al.  A Comparison of Communication Mechanisms in Vehicular Edge Computing , 2020, HotEdge.

[28]  Wen-Hsiung Chen,et al.  A Fast Computational Algorithm for the Discrete Cosine Transform , 1977, IEEE Trans. Commun..

[29]  Mohamed A. Deriche,et al.  A new wavelet based efficient image compression algorithm using compressive sensing , 2015, Multimedia Tools and Applications.

[30]  Slobodan Ilic,et al.  In-vehicle data logging system for fatigue analysis of drive shaft , 2004, International Workshop on Robot Sensing, 2004. ROSE 2004..

[31]  Nasser M. Nasrabadi,et al.  Image coding using vector quantization: a review , 1988, IEEE Trans. Commun..