Navigation-Aided Automotive SAR for High-Resolution Imaging of Driving Environments

The evolution of Advanced Driver Assistance Systems (ADAS) towards the ultimate goal of autonomous driving relies on a conspicuous number of sensors, to perform a wide range of operations, from parking assistance to emergency braking and environment mapping for target recognition/classification. Low-cost Mass-Market Radars (MMRs) are today widely used for object detection at various ranges (up to 250 meters) but they might not be suited for high-precision environment mapping. In this context, vehicular Synthetic Aperture Radar (SAR) is emerging as a promising technique to augment radar imaging capability by exploiting the vehicle motion to provide two-dimensional (2D), or even three-dimensional (3D), images of the surroundings. SAR has a higher resolution compared to standard automotive radars, provided that motion is precisely known. In this regard, one of the most attractive solutions to increase the positioning accuracy is to fuse the information from multiple on-board sensors, such as Global Navigation Satellite System (GNSS), Inertial Measurement Units (IMUs), odometers and steering angle sensors. This paper proposes a multi-sensor fusion technique to support automotive SAR systems, experimentally validating the approach and demonstrating its advantages compared to standard navigation solutions. The results show that multi-sensor-aided SAR images the surrounding with centimeter-level accuracy over typical urban trajectories, confirming its potential for practical applications and leaving room for further improvements.

[1]  Christophe Magnard,et al.  Focusing of Airborne Synthetic Aperture Radar Data From Highly Nonlinear Flight Tracks , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[2]  P. Groves Principles of GNSS, Inertial, and Multi-Sensor Integrated Navigation Systems , 2007 .

[3]  Marc-Michael Meinecke,et al.  Synthetic Aperture Radar Towards Automotive Applications , 2019, 2019 20th International Radar Symposium (IRS).

[4]  D. Blacknell,et al.  SAR motion compensation using autofocus , 1991 .

[5]  Mehrdad Dianati,et al.  A Survey of the State-of-the-Art Localization Techniques and Their Potentials for Autonomous Vehicle Applications , 2018, IEEE Internet of Things Journal.

[6]  Monica Nicoli,et al.  Augmenting Vehicle Localization by Cooperative Sensing of the Driving Environment: Insight on Data Association in Urban Traffic Scenarios , 2020, IEEE Transactions on Intelligent Transportation Systems.

[7]  S. Stanko,et al.  300 GHz radar for high resolution SAR and ISAR applications , 2015, 2015 16th International Radar Symposium (IRS).

[8]  Thomas Zwick,et al.  Automotive SAR for Parking Lot Detection , 2009, 2009 German Microwave Conference.

[9]  Lars M. H. Ulander,et al.  Synthetic-aperture radar processing using fast factorized back-projection , 2003 .

[10]  Stefano Tebaldini,et al.  Digital Terrain Model Retrieval in Tropical Forests Through P-Band SAR Tomography , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Stefan Brisken,et al.  Recent evolution of automotive imaging radar and its information content , 2018, IET Radar, Sonar & Navigation.

[12]  David G. Long,et al.  Generalized Frequency Scaling and Backprojection for LFM-CW SAR Processing , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Stefano Tebaldini,et al.  Focusing Synthetic Aperture Sonar (SAS) data with the Omega-K technique , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[14]  Andrea Matera,et al.  Sensor-Aided V2X Beam Tracking for Connected Automated Driving: Distributed Architecture and Processing Algorithms , 2020, Sensors.

[15]  H. Wang,et al.  Multipath propagation analysis and ghost target removal for FMCW automotive radars , 2021, IET International Radar Conference (IET IRC 2020).

[16]  Alberto Moreira,et al.  Fully Polarimetric High-Resolution 3-D Imaging With Circular SAR at L-Band , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Erwin M. Biebl,et al.  Synthetic aperture radar algorithm for a global amplitude map , 2017, 2017 14th Workshop on Positioning, Navigation and Communications (WPNC).

[18]  Jürgen Dickmann,et al.  Performance Investigation of Automotive SAR Imaging , 2018, 2018 IEEE MTT-S International Conference on Microwaves for Intelligent Mobility (ICMIM).

[19]  Alberto Moreira,et al.  Extended chirp scaling algorithm for air- and spaceborne SAR data processing in stripmap and ScanSAR imaging modes , 1996, IEEE Trans. Geosci. Remote. Sens..

[20]  Reinhard Feger,et al.  Experimental verification of a 77-GHz synthetic aperture radar system for automotive applications , 2017, 2017 IEEE MTT-S International Conference on Microwaves for Intelligent Mobility (ICMIM).

[21]  Heinz Heisler,et al.  Advanced vehicle technology , 1989 .

[22]  Lars M. H. Ulander,et al.  SAR processing without a motion measurement system , 2017, 2017 European Radar Conference (EURAD).

[23]  Naser El-Sheimy,et al.  Inertial sensors technologies for navigation applications: state of the art and future trends , 2020 .

[24]  S. Scirpoli,et al.  SAS multipass interferometry for monitoring seabed deformation using a high-frequency imaging sonar , 2011, OCEANS 2011 IEEE - Spain.

[25]  Erwin Biebl,et al.  Multi channel approaches for an automotive synthetic aperture radar , 2018, 2018 11th German Microwave Conference (GeMiC).

[26]  Gerd Wanielik,et al.  Comparison and evaluation of advanced motion models for vehicle tracking , 2008, 2008 11th International Conference on Information Fusion.

[27]  Yulin Huang,et al.  An Auxiliary Parking Method Based on Automotive Millimeter wave SAR , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[28]  Christian Waldschmidt,et al.  Millimeter-Wave SAR-Imaging With Radar Networks Based on Radar Self-Localization , 2020, IEEE Transactions on Microwave Theory and Techniques.

[29]  Tang Kan,et al.  Implementation of Real-time Automotive SAR Imaging , 2020 .

[30]  Hauke Stahle,et al.  A sensor fusion approach for localization with cumulative error elimination , 2012, 2012 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[31]  Davide Giudici,et al.  Along-Track Multistatic Synthetic Aperture Radar Formations of Minisatellites , 2020, Remote. Sens..

[32]  Paul D. Groves,et al.  Principles of GNSS, Inertial, and Multi-sensor Integrated Navigation Systems , 2012 .

[33]  F. Rocca,et al.  InSAR Principles-Guidelines for SAR Interferometry Processing and Interpretation , 2007 .

[34]  T. Zwick,et al.  Millimeter-Wave Technology for Automotive Radar Sensors in the 77 GHz Frequency Band , 2012, IEEE Transactions on Microwave Theory and Techniques.

[35]  Stephan Stanko,et al.  Millimeter resolution SAR imaging of infrastructure in the lower THz region using MIRANDA-300 , 2016, 2016 46th European Microwave Conference (EuMC).

[36]  Vittorio M. N. Passaro,et al.  Gyroscope Technology and Applications: A Review in the Industrial Perspective , 2017, Sensors.

[37]  Paolo Dabove,et al.  Performance Assessment of an Ultra Low-Cost Inertial Measurement Unit for Ground Vehicle Navigation , 2019, Sensors.

[38]  Lorenzo Bruzzone,et al.  The ASI Integrated Sounder-SAR System Operating in the UHF-VHF Bands: First Results of the 2018 Helicopter-Borne Morocco Desert Campaign , 2019, Remote. Sens..

[39]  Erwin Biebl,et al.  Application Of A Stream-Based SAR-Backprojection Approach For Automotive Environment Perception , 2018, 2018 19th International Radar Symposium (IRS).

[40]  J. Dickmann,et al.  Real-Time Radar SLAM , 2017 .

[41]  Rudolph van der Merwe,et al.  The unscented Kalman filter for nonlinear estimation , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[42]  Stefano Tebaldini,et al.  Imaging the Internal Structure of an Alpine Glacier via L-Band Airborne SAR Tomography , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[43]  David G. Long,et al.  Analysis of time-domain back-projection for stripmap SAR , 2015 .

[44]  T.A. Kennedy Strapdown inertial measurement units for motion compensation for synthetic aperture radars , 1988, IEEE Aerospace and Electronic Systems Magazine.

[45]  Hao Wang,et al.  Robust and Precise Vehicle Localization Based on Multi-Sensor Fusion in Diverse City Scenes , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[46]  Mingsheng Liao,et al.  Signal Processing Options for High Resolution SAR Tomography of Natural Scenarios , 2020, Remote. Sens..

[47]  Kamal Sarabandi,et al.  Microwave Radar and Radiometric Remote Sensing , 2013 .

[48]  Lars Reichardt,et al.  Motion compensation with one-axis gyroscope and two-axis accelerometer for automotive SAR , 2011, 2011 German Microwave Conference.

[49]  Thomas B. Schön,et al.  Using Inertial Sensors for Position and Orientation Estimation , 2017, Found. Trends Signal Process..

[50]  F. Rocca,et al.  SAR data focusing using seismic migration techniques , 1991 .

[51]  Fernando Garcia,et al.  A Review of Sensor Technologies for Perception in Automated Driving , 2019, IEEE Intelligent Transportation Systems Magazine.

[52]  I. Hajnsek,et al.  A tutorial on synthetic aperture radar , 2013, IEEE Geoscience and Remote Sensing Magazine.

[53]  Christian Waldschmidt,et al.  SAR imaging in an automotive scenario , 2015, 2015 IEEE 15th Mediterranean Microwave Symposium (MMS).