Automotive Radar Data Acquisition Using Object Detection

The growing urban complexity demands an efficient algorithm to acquire and process various sensor information from autonomous vehicles. In this paper, we introduce an algorithm to utilize object detection results from the image to adaptively sample and acquire radar data using Compressed Sensing (CS). This novel algorithm is motivated by the hypothesis that with a limited sampling budget, allocating more sampling budget to areas with the object as opposed to a uniform sampling ultimately improves relevant object detection performance. We improve detection performance by dynamically allocating a lower sampling rate to objects such as buses than pedestrians leading to better reconstruction than baseline across areas with objects of interest. We automate the sampling rate allocation using linear programming and show significant time savings while reducing the radar block size by a factor of 2. We also analyze a Binary Permuted Diagonal measurement matrix for radar acquisition which is hardware-efficient and show its performance is similar to Gaussian and Binary Permuted Block Diagonal matrix. Our experiments on the Oxford radar dataset show an effective reconstruction of objects of interest with 10% sampling rate. Finally, we develop a transformer-based 2D object detection network using the NuScenes radar and image data.

[1]  Yifan Zhang,et al.  Spatial Attention Fusion for Obstacle Detection Using MmWave Radar and Vision Sensor , 2020, Sensors.

[2]  Ioannis Kyriakides,et al.  Adaptive compressive sensing and processing for radar tracking , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Amar Rouane,et al.  Compressed Sensing: A Simple Deterministic Measurement Matrix and a Fast Recovery Algorithm , 2015, IEEE Transactions on Instrumentation and Measurement.

[4]  Qiang Xu,et al.  nuScenes: A Multimodal Dataset for Autonomous Driving , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Paul Newman,et al.  The Oxford Radar RobotCar Dataset: A Radar Extension to the Oxford RobotCar Dataset , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Jürgen Dickmann,et al.  Data rate reduction for chirp-sequence based automotive radars using compressed sensing , 2018, 2018 11th German Microwave Conference (GeMiC).

[7]  Daiyin Zhu,et al.  Adaptive Compressed Sensing Radar Oriented Toward Cognitive Detection in Dynamic Sparse Target Scene , 2012, IEEE Transactions on Signal Processing.

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Hairong Qi,et al.  RRPN: Radar Region Proposal Network for Object Detection in Autonomous Vehicles , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[10]  Wei He,et al.  Adaptive Compressive Sensing of Images Using Spatial Entropy , 2017, Comput. Intell. Neurosci..

[11]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[12]  Richard M. Dansereau,et al.  Adaptive sub-nyquist sampling based on haar wavelet and compressive sensing in pulsed radar , 2016, 2016 4th International Workshop on Compressed Sensing Theory and its Applications to Radar, Sonar and Remote Sensing (CoSeRa).

[13]  Nicolas Usunier,et al.  End-to-End Object Detection with Transformers , 2020, ECCV.

[14]  Yu Wang,et al.  Compressed sensing-based method for electrocardiogram monitoring on wireless body sensor using binary matrix , 2015, Int. J. Wirel. Mob. Comput..

[15]  María A. González-Huici,et al.  Experimental Evaluation of Compressive Sensing for DoA Estimation in Automotive Radar , 2018, 2018 19th International Radar Symposium (IRS).

[16]  Miki Haseyama,et al.  The simplest measurement matrix for compressed sensing of natural images , 2010, 2010 IEEE International Conference on Image Processing.

[17]  Massimiliano Pieraccini,et al.  Compressive Sensing for No-Contact 3D Ground Penetrating Radar , 2018, 2018 41st International Conference on Telecommunications and Signal Processing (TSP).

[18]  Paul Newman,et al.  Distant Vehicle Detection Using Radar and Vision , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[19]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Maria Trocan,et al.  Robust Image Reconstruction for Block-Based Compressed Sensing Using a Binary Measurement Matrix , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[21]  Matthew Gadd,et al.  RSS-Net: Weakly-Supervised Multi-Class Semantic Segmentation with FMCW Radar , 2020, 2020 IEEE Intelligent Vehicles Symposium (IV).

[22]  Michael Meyer,et al.  Deep Learning Based 3D Object Detection for Automotive Radar and Camera , 2019, 2019 16th European Radar Conference (EuRAD).

[23]  Wolfgang Rosenstiel,et al.  Compressive sensing-based noise radar for automotive applications , 2016, 2016 12th IEEE International Symposium on Electronics and Telecommunications (ISETC).