NR5G-SAM: A SLAM Framework for Field Robot Applications Based on 5G New Radio

Robot localization is a crucial task in robotic systems and is a pre-requisite for navigation. In outdoor environments, Global Navigation Satellite Systems (GNSS) have aided towards this direction, alongside laser and visual sensing. Despite their application in the field, GNSS suffers from limited availability in dense urban and rural environments. Light Detection and Ranging (LiDAR), inertial and visual methods are also prone to drift and can be susceptible to outliers due to environmental changes and illumination conditions. In this work, we propose a cellular Simultaneous Localization and Mapping (SLAM) framework based on 5G New Radio (NR) signals and inertial measurements for mobile robot localization with several gNodeB stations. The method outputs the pose of the robot along with a radio signal map based on the Received Signal Strength Indicator (RSSI) measurements for correction purposes. We then perform benchmarking against LiDAR-Inertial Odometry Smoothing and Mapping (LIO-SAM), a state-of-the-art LiDAR SLAM method, comparing performance via a simulator ground truth reference. Two experimental setups are presented and discussed using the sub-6 GHz and mmWave frequency bands for communication, while the transmission is based on down-link (DL) signals. Our results show that 5G positioning can be utilized for radio SLAM, providing increased robustness in outdoor environments and demonstrating its potential to assist in robot localization, as an additional absolute source of information when LiDAR methods fail and GNSS data is unreliable.

[1]  R. Cortesão,et al.  UWB Aided Mobile Robot Localization with Neural Networks and the EKF* , 2022, 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[2]  E. Leitinger,et al.  Data Fusion for Radio Frequency SLAM with Robust Sampling , 2022, 2022 25th International Conference on Information Fusion (FUSION).

[3]  Billy Pik Lik Lau,et al.  Efficient WiFi LiDAR SLAM for Autonomous Robots in Large Environments , 2022, 2022 IEEE 18th International Conference on Automation Science and Engineering (CASE).

[4]  Joseph B. Soriaga,et al.  Neural RF SLAM for unsupervised positioning and mapping with channel state information , 2022, ICC 2022 - IEEE International Conference on Communications.

[5]  G. Seco-Granados,et al.  Evaluation of 5G Positioning Performance Based on UTDoA, AoA and Base-Station Selective Exclusion , 2021, Sensors.

[6]  Jason O. Hallstrom,et al.  MobIntel: Passive Outdoor Localization via RSSI and Machine Learning , 2021, 2021 17th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).

[7]  Xiwei Wu,et al.  Factor graph based navigation and positioning for control system design: A review , 2021, Chinese Journal of Aeronautics.

[8]  Syed Azhar Ali Zaidi,et al.  A Comparative Survey of LiDAR-SLAM and LiDAR based Sensor Technologies , 2021, 2021 Mohammad Ali Jinnah University International Conference on Computing (MAJICC).

[9]  Xiaolu Zeng,et al.  Massive MIMO for High-Accuracy Target Localization and Tracking , 2021, IEEE Internet of Things Journal.

[10]  Sebastian Scherer,et al.  Super Odometry: IMU-centric LiDAR-Visual-Inertial Estimator for Challenging Environments , 2021, 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  H. Wymeersch,et al.  5G SLAM with Low-complexity Channel Estimation , 2021, 2021 15th European Conference on Antennas and Propagation (EuCAP).

[12]  V. D. Esposti Ray tracing: techniques, applications and prospect , 2021, 2020 International Symposium on Antennas and Propagation (ISAP).

[13]  Henk Wymeersch,et al.  5G Synchronization, Positioning, and Mapping From Diffuse Multipath , 2021, IEEE Wireless Communications Letters.

[14]  Mohsin Murtaza,et al.  Comparison of 4G and 5G Cellular Network Architecture and Proposing of 6G, a new era of AI , 2020, 2020 5th International Conference on Innovative Technologies in Intelligent Systems and Industrial Applications (CITISIA).

[15]  Yuanwei Liu,et al.  SLARM: Simultaneous Localization and Radio Mapping for Communication-aware Connected Robot , 2020, 2021 IEEE International Conference on Communications Workshops (ICC Workshops).

[16]  Wonpil Yu,et al.  3D Portable Mapping System to Build Radio Fingerprints and Spatial Map , 2020, 2020 International Conference on Information and Communication Technology Convergence (ICTC).

[17]  Erik Aguirre,et al.  Fifth-Generation (5G) mmWave Spatial Channel Characterization for Urban Environments’ System Analysis , 2020, Sensors.

[18]  Henk Wymeersch,et al.  5G SLAM Using the Clustering and Assignment Approach with Diffuse Multipath , 2020, Sensors.

[19]  Wei Wang,et al.  LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  V. Nagarajan,et al.  Localization Techniques of Wireless Sensor Networks: A Review , 2020, 2020 International Conference on Communication and Signal Processing (ICCSP).

[21]  Jianwei Ren,et al.  An improved binocular LSD_SLAM method for object localization , 2020, 2020 IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA).

[22]  Mikael Gidlund,et al.  RSSI Fingerprinting-Based Localization Using Machine Learning in LoRa Networks , 2020, IEEE Internet of Things Magazine.

[23]  Simo Särkkä,et al.  Levenberg-Marquardt and Line-Search Extended Kalman Smoothers , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Leonel Sousa,et al.  Dethroning GPS: Low-Power Accurate 5G Positioning Systems Using Machine Learning , 2020, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[25]  Morteza Taheribakhsh,et al.  5G Implementation: Major Issues and Challenges , 2020, 2020 25th International Computer Conference, Computer Society of Iran (CSICC).

[26]  Jun Zhang,et al.  Hybrid Beamforming for 5G and Beyond Millimeter-Wave Systems: A Holistic View , 2019, IEEE Open Journal of the Communications Society.

[27]  A. M. Sharaf,et al.  Experimental Evaluation of Computation Cost of FastSLAM Algorithm for Unmanned Ground Vehicles , 2019, 2019 7th International Conference on Control, Mechatronics and Automation (ICCMA).

[28]  Naser El-Sheimy,et al.  Seamless navigation and mapping using an INS/GNSS/grid-based SLAM semi-tightly coupled integration scheme , 2019, Inf. Fusion.

[29]  Edward Golan,et al.  Localization of Transmitters in VHF Band Based on the Radio Environment Maps Concept , 2019, 2019 Communication and Information Technologies (KIT).

[30]  Yi Jiang,et al.  Measurement and Modeling of Path Loss and Channel Capacity Analysis for 5G UMa Scenario , 2019, 2019 11th International Conference on Wireless Communications and Signal Processing (WCSP).

[31]  Christian Wietfeld,et al.  Experimental 5G mmWave Beam Tracking Testbed for Evaluation of Vehicular Communications , 2019, 2019 IEEE 2nd 5G World Forum (5GWF).

[32]  Naohiko Kohtake,et al.  Rapid BLE Beacon Localization with Range-Only EKF-SLAM Using Beacon Interval Constraint , 2019, 2019 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[33]  Ilze Andersone,et al.  Heterogeneous Map Merging: State of the Art , 2019, Robotics.

[34]  Gerhard Bauch,et al.  Localization, Mapping, and Synchronization in 5G Millimeter Wave Massive MIMO Systems , 2019, 2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[35]  Yutaka Ishibashi,et al.  Radio Environment Maps for 5G Cognitive Radio Network , 2019, 2019 8th International Conference on Modern Circuits and Systems Technologies (MOCAST).

[36]  Henk Wymeersch,et al.  5G mmWave Vehicular Tracking , 2018, 2018 52nd Asilomar Conference on Signals, Systems, and Computers.

[37]  Thomas Jost,et al.  Simultaneous Localization of a Receiver and Mapping of Multipath Generating Geometry in Indoor Environments , 2018, 2021 IEEE Radar Conference (RadarConf21).

[38]  Moe Z. Win,et al.  Efficient Multisensor Localization for the Internet of Things: Exploring a New Class of Scalable Localization Algorithms , 2018, IEEE Signal Processing Magazine.

[39]  Carlo Fischione,et al.  A Survey of Enabling Technologies for Network Localization, Tracking, and Navigation , 2018, IEEE Communications Surveys & Tutorials.

[40]  Mariette Awad,et al.  Geometric Approach in Simultaneous Context Inference, Localization and Mapping using mm-Wave , 2018, 2018 25th International Conference on Telecommunications (ICT).

[41]  Thushara D. Abhayapala,et al.  Single-Anchor Two-Way Localization Bounds for 5G mmWave Systems , 2018, IEEE Transactions on Vehicular Technology.

[42]  Moe Z. Win,et al.  A Belief Propagation Algorithm for Multipath-Based SLAM , 2018, IEEE Transactions on Wireless Communications.

[43]  K. J. Ray Liu,et al.  WiBall: A Time-Reversal Focusing Ball Method for Decimeter-Accuracy Indoor Tracking , 2017, IEEE Internet of Things Journal.

[44]  Jan Steckel,et al.  RadarSLAM: Biomimetic SLAM using ultra-wideband pulse-echo radar , 2017, 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[45]  Rittwik Jana,et al.  Can you find me now? Evaluation of network-based localization in a 4G LTE network , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[46]  Xiangyun Zhou,et al.  Error Bounds for Uplink and Downlink 3D Localization in 5G Millimeter Wave Systems , 2017, IEEE Transactions on Wireless Communications.

[47]  Zdenek Chaloupka,et al.  Technology and Standardization Gaps for High Accuracy Positioning in 5g , 2017, IEEE Communications Standards.

[48]  Fawzi Nashashibi,et al.  Indoor Intelligent Vehicle localization using WiFi received signal strength indicator , 2017, 2017 IEEE MTT-S International Conference on Microwaves for Intelligent Mobility (ICMIM).

[49]  Michal Reinstein,et al.  WiFi localization in 3D , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[50]  Uwe-Carsten Fiebig,et al.  Multipath Assisted Positioning with Simultaneous Localization and Mapping , 2016, IEEE Transactions on Wireless Communications.

[51]  Chun-Yi Su,et al.  RGB-D sensor-based visual SLAM for localization and navigation of indoor mobile robot , 2016, 2016 International Conference on Advanced Robotics and Mechatronics (ICARM).

[52]  Mikko Valkama,et al.  Joint Device Positioning and Clock Synchronization in 5G Ultra-Dense Networks , 2016, IEEE Transactions on Wireless Communications.

[53]  Moe Z. Win,et al.  High-Accuracy Localization for Assisted Living: 5G systems will turn multipath channels from foe to friend , 2016, IEEE Signal Processing Magazine.

[54]  Frank Dellaert,et al.  On-Manifold Preintegration for Real-Time Visual--Inertial Odometry , 2015, IEEE Transactions on Robotics.

[55]  Tuna Tugcu,et al.  Location estimation-based radio environment map construction in fading channels , 2015, Wirel. Commun. Mob. Comput..

[56]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[57]  K. J. Ray Liu,et al.  A Time-Reversal Paradigm for Indoor Positioning System , 2015, IEEE Transactions on Vehicular Technology.

[58]  Andrej Kosir,et al.  Radio Environment Maps: The Survey of Construction Methods , 2014, KSII Trans. Internet Inf. Syst..

[59]  Lei Yang,et al.  Method of improving WiFi SLAM based on spatial and temporal coherence , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[60]  Tin Kam Ho,et al.  SignalSLAM: Simultaneous localization and mapping with mixed WiFi, Bluetooth, LTE and magnetic signals , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[61]  Dirk Grunwald,et al.  Practical radio environment mapping with geostatistics , 2012, 2012 IEEE International Symposium on Dynamic Spectrum Access Networks.

[62]  Janne Riihijärvi,et al.  Reliability of a radio environment Map: Case of spatial interpolation techniques , 2012, 2012 7th International ICST Conference on Cognitive Radio Oriented Wireless Networks and Communications (CROWNCOM).

[63]  Frank Dellaert,et al.  iSAM2: Incremental smoothing and mapping using the Bayes tree , 2012, Int. J. Robotics Res..

[64]  Liljana Gavrilovska,et al.  Comparative analysis of spatial interpolation methods for creating radio environment maps , 2011, 2011 19thTelecommunications Forum (TELFOR) Proceedings of Papers.

[65]  Mahamod Ismail,et al.  Availability of GPS and A-GPS signal in UKM campus for hearability check , 2011, 2011 IEEE 10th Malaysia International Conference on Communications.

[66]  Alok Aggarwal,et al.  Efficient, generalized indoor WiFi GraphSLAM , 2011, 2011 IEEE International Conference on Robotics and Automation.

[67]  Andreas Geiger,et al.  Visual SLAM for autonomous ground vehicles , 2011, 2011 IEEE International Conference on Robotics and Automation.

[68]  Guolin Sun,et al.  Simple distributed interference source localization for radio environment mapping , 2010, 2010 IFIP Wireless Days.

[69]  Andy Vesa,et al.  The ESPRIT algorithm. Variants and precision , 2010, 2010 9th International Symposium on Electronics and Telecommunications.

[70]  Eduardo Bayro-Corrochano,et al.  EKF-SLAM and Machine Learning Techniques for Visual Robot Navigation , 2010, 2010 20th International Conference on Pattern Recognition.

[71]  Wolfram Burgard,et al.  A Tutorial on Graph-Based SLAM , 2010, IEEE Intelligent Transportation Systems Magazine.

[72]  Daniele Borio,et al.  Doppler Measurements and Velocity Estimation: A Theoretical Framework with Software Receiver Implementation , 2009 .

[73]  Berna Sayraç,et al.  Informed spectrum usage in cognitive radio networks: Interference cartography , 2008, 2008 IEEE 19th International Symposium on Personal, Indoor and Mobile Radio Communications.

[74]  Frank Dellaert,et al.  iSAM: Incremental Smoothing and Mapping , 2008, IEEE Transactions on Robotics.

[75]  J. Wiart,et al.  Geostatistical interpolation for mapping radio-electric exposure levels , 2006, 2006 First European Conference on Antennas and Propagation.

[76]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[77]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[78]  C. H. Antunes,et al.  A Comparative Study of Mobile Robot Positioning Using 5G NR , 2022 .

[79]  Dinesh Bharadia,et al.  P2SLAM: Bearing based WiFi SLAM for Indoor Robots , 2022, IEEE Robotics and Automation Letters.

[80]  Ziyang Meng,et al.  Efficient Probabilistic Approach to Range-Only SLAM With a Novel Likelihood Model , 2021, IEEE Transactions on Instrumentation and Measurement.

[81]  Carlos Baquero Barneto,et al.  Radio-based Sensing and Environment Mapping in Millimeter-Wave 5G and Beyond Networks , 2021 .

[82]  Sabit Ekin,et al.  RSSI-Based Localization Using LoRaWAN Technology , 2019, IEEE Access.

[83]  Ronald Raulefs,et al.  Survey of Cellular Mobile Radio Localization Methods: From 1G to 5G , 2018, IEEE Communications Surveys & Tutorials.

[84]  Farnham Tim,et al.  Radio environment map techniques and performance in the presence of errors , 2016 .

[85]  Thomas Moore,et al.  A Generalized Extended Kalman Filter Implementation for the Robot Operating System , 2014, IAS.

[86]  Adewale Abe Outdoor Localization System Using RSSI Measurement of Wireless Sensor Network , 2013 .

[87]  Frank Dellaert,et al.  Incremental smoothing and mapping , 2008 .