High Fidelity Physics-Based Simulation of a 512-Channel 4D-Radar Sensor for Automotive Applications

Radar has emerged as a core sensing technology for many active-safety and comfort related advanced driver assistance systems (ADAS) being deployed in today’s vehicles. Using radar technology, the ego vehicle can simultaneously detect the range and velocity of multiple targets. With multiple-input, multiple-output (MIMO) arrays, it is also possible to detect the angle of arrival of targets in azimuth and elevation. 4D automotive radar sensors can determine the range, velocity, azimuth and elevation angles-of-arrival (AoA) of targets in a traffic scene. Currently, radar-returns from traffic scenes have been mainly obtained through measurement. While measurement is valuable, it can be costly, time consuming, restrictive due to practicality issues and also unsafe in some corner-case traffic scenarios. Simulation has emerged as a potential alternative source of synthetic radar-returns that can be used to develop, test and refine signal processing techniques and detection algorithms. A key challenge in simulation has been to retain an accurate representation of actors in full-scale traffic scenes while still being able to solve electrically large problems efficiently. The introduction of MIMO arrays further increases the complexity and computational load demands of such simulations. In this paper, we present a computationally efficient, high fidelity, physics-based simulation workflow for a 77 GHz frequency-modulated continuous-waveform (FMCW)-based, 512-channel MIMO radar sensor. We demonstrate how the synthetic radar returns obtained from full-scale traffic scene simulations can be used to create 4D-radar point clouds. The accuracy of the synthetic radar returns is then evaluated by overlaying the resulting 4D-radar point clouds on 4 corresponding full-scale traffic scenes with varying levels of complexity. Results from this study demonstrate how accurate radar returns obtained from simulation can be used to develop next-generation radar sensors for autonomous vehicles.

[1]  C. Waldschmidt,et al.  System Performance of a 79 GHz High-Resolution 4D Imaging MIMO Radar With 1728 Virtual Channels , 2022, IEEE Journal of Microwaves.

[2]  Hui Zhang,et al.  High-resolution Automotive Radar Point Cloud Imaging and Processing , 2022, 2022 Photonics & Electromagnetics Research Symposium (PIERS).

[3]  F. Weinmann,et al.  Ray-Tracing-Based Micro-Doppler Simulation for 77 GHz Automotive Scenarios , 2022, 2021 18th European Radar Conference (EuRAD).

[4]  Y. F. Wu,et al.  A Sparse Array for 77 GHz 4D High-Resolution Imaging Radar Based on Entropy Model and Convex Optimization , 2021, 2021 IEEE International Workshop on Electromagnetics: Applications and Student Innovation Competition (iWEM).

[5]  Girish Chowdhary,et al.  3D Detection and Tracking for On-road Vehicles with a Monovision Camera and Dual Low-cost 4D mmWave Radars , 2021, 2021 IEEE International Intelligent Transportation Systems Conference (ITSC).

[6]  V. Brazda,et al.  Automotive Radar – Road Boundary Estimation , 2021, 2021 International Symposium ELMAR.

[7]  B. Ai,et al.  Measurement and Ray-Tracing Simulation for Millimeter-Wave Automotive Radar , 2021, 2021 IEEE 4th International Conference on Electronic Information and Communication Technology (ICEICT).

[8]  Hongyu Chen,et al.  A New Automotive Radar 4D Point Clouds Detector by Using Deep Learning , 2021, ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Shunqiao Sun,et al.  4D Automotive Radar Sensing for Autonomous Vehicles: A Sparsity-Oriented Approach , 2021, IEEE Journal of Selected Topics in Signal Processing.

[10]  Gang Xu,et al.  A Two-Chip Cascaded FMCW Radar For 2D Angle Estimation , 2021, 2021 IEEE MTT-S International Wireless Symposium (IWS).

[11]  Carlos Moreno Leon,et al.  ATRIUM: Test Environment for Automotive Radars , 2020, 2020 IEEE MTT-S International Conference on Microwaves for Intelligent Mobility (ICMIM).

[12]  Onur Toker,et al.  Design of a Cyberattack Resilient 77 GHz Automotive Radar Sensor , 2020, Electronics.

[13]  Ushemadzoro Chipengo,et al.  A 77 GHz Simulation Study of Roadway Infrastructure Radar Signatures for Smart Roads , 2019, 2019 16th European Radar Conference (EuRAD).

[14]  Christian Sturm,et al.  Pioneer Study on Near-Range Sensing with 4D MIMO-FMCW Automotive Radars , 2019, 2019 20th International Radar Symposium (IRS).

[15]  Bane Sullivan,et al.  PyVista: 3D plotting and mesh analysis through a streamlined interface for the Visualization Toolkit (VTK) , 2019, J. Open Source Softw..

[16]  Frank Weinmann,et al.  Ray Tracing for Range-Doppler Simulation of 77 GHz Automotive Scenarios , 2019, 2019 13th European Conference on Antennas and Propagation (EuCAP).

[17]  Gang Li,et al.  Novel 4D 79 GHz Radar Concept for Object Detection and Active Safety Applications , 2019, 2019 12th German Microwave Conference (GeMiC).

[18]  Shawn Carpenter,et al.  From Antenna Design to High Fidelity, Full Physics Automotive Radar Sensor Corner Case Simulation , 2018, Modelling and Simulation in Engineering.

[19]  Chengwei Zhou,et al.  FFT-Based DOA Estimation for Coprime MIMO Radar: A Hardware-Friendly Approach , 2018, 2018 IEEE 23rd International Conference on Digital Signal Processing (DSP).

[20]  Wolfgang Menzel,et al.  A New Antenna Array and Signal Processing Concept for an Automotive 4D Radar , 2018, 2018 15th European Radar Conference (EuRAD).

[21]  Peng Peng,et al.  A Facet-Based Simulation of the Multipath Effect on the EM Scattering and Doppler Spectrum of a Low-Flying Target at Maritime Scene , 2018, IEEE Geoscience and Remote Sensing Letters.

[22]  Igal Bilik,et al.  Automotive MIMO radar for urban environments , 2016, 2016 IEEE Radar Conference (RadarConf).

[23]  David Johnson,et al.  Radar Sensing for Intelligent Vehicles in Urban Environments , 2015, Sensors.

[24]  Theodore S. Rappaport,et al.  The human body and millimeter-wave wireless communication systems: Interactions and implications , 2015, 2015 IEEE International Conference on Communications (ICC).

[25]  Ming Chen,et al.  77 GHz radar scattering properties of pedestrians , 2014, 2014 IEEE Radar Conference.

[26]  Steffen Lutz,et al.  77 GHz lens-based multistatic MIMO radar with colocated antennas for automotive applications , 2012, 2012 IEEE/MTT-S International Microwave Symposium Digest.

[27]  T. Zwick,et al.  Millimeter-Wave Technology for Automotive Radar Sensors in the 77 GHz Frequency Band , 2012, IEEE Transactions on Microwave Theory and Techniques.

[28]  Hao Ling,et al.  Microdoppler signature simulation of computer animated human and animal motions , 2008, 2008 IEEE Antennas and Propagation Society International Symposium.

[29]  Jian Li,et al.  MIMO Radar with Colocated Antennas , 2007, IEEE Signal Processing Magazine.

[30]  Ronald Poppe,et al.  Vision-based human motion analysis: An overview , 2007, Comput. Vis. Image Underst..

[31]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[32]  Ralph Helmar Rasshofer,et al.  Automotive Radar and Lidar Systems for Next Generation Driver Assistance Functions , 2005 .

[33]  Rick S. Blum,et al.  MIMO radar: an idea whose time has come , 2004, Proceedings of the 2004 IEEE Radar Conference (IEEE Cat. No.04CH37509).

[34]  Markus Goldgruber,et al.  High Fidelity Physics Simulation-Based Convolutional Neural Network for Automotive Radar Target Classification Using Micro-Doppler , 2021, IEEE Access.

[35]  Ushemadzoro Chipengo,et al.  High Fidelity Physics Simulation of 128 Channel MIMO Sensor for 77GHz Automotive Radar , 2020, IEEE Access.

[36]  R. Kipp,et al.  Range-Doppler Radar Signature Prediction of Wind Turbine Using SBR , 2018 .

[37]  Implementing Digital Processing for Automotive Radar Using SoCs , 2010 .

[38]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[39]  Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles , 2022 .