Azimuth Super-Resolution for FMCW Radar in Autonomous Driving

We tackle the task of Azimuth (angular dimension) super-resolution for Frequency Modulated Continuous Wave (FMCW) multiple-input multiple-output (MIMO) radar. FMCW MIMO radar is widely used in autonomous driving alongside Lidar and RGB cameras. However, compared to Lidar, MIMO radar is usually of low resolution due to hardware size restrictions. For example, achieving 1 ◦ azimuth resolution requires at least 100 receivers, but a single MIMO device usually supports at most 12 receivers. Having limitations on the number of receivers is problem-atic since a high-resolution measurement of azimuth angle is essential for estimating the location and velocity of objects. To improve the azimuth resolution of MIMO radar, we propose a light, yet efficient, Analog-to-Digital super-resolution model (ADC-SR) that predicts or hallucinates additional radar signals using signals from only a few receivers. Compared with the baseline models that are applied to processed radar Range-Azimuth-Doppler (RAD) maps, we show that our ADC-SR method that processes raw ADC signals achieves comparable performance with 98% (50 times) fewer parameters. We also propose a hybrid super-resolution model (Hybrid-SR) combining our ADC-SR with a standard RAD super-resolution model, and show that performance can be improved by a large margin. Experiments on our Pitt-Radar dataset and the RADIal dataset validate the importance of leveraging raw radar ADC signals. To assess the value of our super-resolution model for autonomous driving, we also perform object detection on the results of our super-resolution model and find that our super-resolution model

[1]  K. Berntorp,et al.  Exploiting Temporal Relations on Radar Perception for Autonomous Driving , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Patrick P'erez,et al.  Raw High-Definition Radar for Multi-Task Learning , 2021, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Erran L. Li,et al.  Robust Multimodal Vehicle Detection in Foggy Weather Using Complementary Lidar and Radar Signals , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Jenq-Neng Hwang,et al.  Rethinking of Radar’s Role: A Camera-Radar Dataset and Systematic Annotator via Coordinate Alignment , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[5]  Robert Laganiere,et al.  RADDet: Range-Azimuth-Doppler based Radar Object Detection for Dynamic Road Users , 2021, 2021 18th Conference on Robots and Vision (CRV).

[6]  Jürgen Dickmann,et al.  RadarScenes: A Real-World Radar Point Cloud Data Set for Automotive Applications , 2021, 2021 IEEE 24th International Conference on Information Fusion (FUSION).

[7]  Jenq-Neng Hwang,et al.  RODNet: A Real-Time Radar Object Detection Network Cross-Supervised by Camera-Radar Fused Object 3D Localization , 2021, IEEE Journal of Selected Topics in Signal Processing.

[8]  Jenq-Neng Hwang,et al.  RODNet: Radar Object Detection using Cross-Modal Supervision , 2021, 2021 IEEE Winter Conference on Applications of Computer Vision (WACV).

[9]  Sen Wang,et al.  RADIATE: A Radar Dataset for Automotive Perception in Bad Weather , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Andrew Geiss,et al.  Radar Super Resolution Using a Deep Convolutional Neural Network , 2020, Journal of Atmospheric and Oceanic Technology.

[11]  Shunqiao Sun,et al.  MIMO Radar for Advanced Driver-Assistance Systems and Autonomous Driving: Advantages and Challenges , 2020, IEEE Signal Processing Magazine.

[12]  Mohammadreza Mostajabi,et al.  High Resolution Radar Dataset for Semi-Supervised Learning of Dynamic Objects , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  Yulin Huang,et al.  Fast Split Bregman Based Deconvolution Algorithm for Airborne Radar Imaging , 2020, Remote Sensing.

[14]  F. Tupin,et al.  CARRADA Dataset: Camera and Automotive Radar with Range- Angle- Doppler Annotations , 2020, 2020 25th International Conference on Pattern Recognition (ICPR).

[15]  Jinyong Jeong,et al.  MulRan: Multimodal Range Dataset for Urban Place Recognition , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Haiguang Yang,et al.  Bistatic Forward-Looking SAR MP-DPCA Method for Space–Time Extension Clutter Suppression , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[17]  M. N. Akıncı,et al.  Truncated singular value decomposition for through‐the‐wall microwave imaging application , 2020, IET Microwaves, Antennas & Propagation.

[18]  P. Newman,et al.  The Oxford Radar RobotCar Dataset: A Radar Extension to the Oxford RobotCar Dataset , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Jianyu Yang,et al.  Airborne Forward-Looking Radar Super-Resolution Imaging Using Iterative Adaptive Approach , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Yongchao Zhang,et al.  Azimuth Superresolution of Forward-Looking Radar Imaging Which Relies on Linearized Bregman , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Qiang Xu,et al.  nuScenes: A Multimodal Dataset for Autonomous Driving , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Urs Schneider,et al.  An Adversarial Super-Resolution Remedy for Radar Design Trade-offs , 2019, 2019 27th European Signal Processing Conference (EUSIPCO).

[23]  Felix Heide,et al.  Seeing Through Fog Without Seeing Fog: Deep Multimodal Sensor Fusion in Unseen Adverse Weather , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  C. Raju,et al.  MST radar signal processing using iterative adaptive approach , 2018, Geoscience Letters.

[25]  Jianyu Yang,et al.  A Bayesian Super-Resolution Method for Forward-Looking Scanning Radar Imaging Based on Split Bregman , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[26]  Andreas Jakobsson,et al.  Wideband Sparse Reconstruction for Scanning Radar , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Karen O. Egiazarian,et al.  Single Image Super-Resolution Based on Wiener Filter in Similarity Domain , 2017, IEEE Transactions on Image Processing.

[28]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  M. Obland,et al.  Super-resolution technique for CW lidar using Fourier transform reordering and Richardson-Lucy deconvolution. , 2014, Optics letters.

[30]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[31]  H. Dropkin,et al.  Superresolution for scanning antenna , 1997, Proceedings of the 1997 IEEE National Radar Conference.

[32]  Andrew Gerald Stove,et al.  Linear FMCW radar techniques , 1992 .

[33]  R. Mole,et al.  Estimations of non-linearities in structural vibrations of string musical instruments , 2012, 1210.4024.