3D Point Clouds Data Super Resolution-Aided LiDAR Odometry for Vehicular Positioning in Urban Canyons

LiDAR odometry algorithms are extensively studied for vehicular positioning. However, achieving high-precision positioning using low-cost 16-channel LiDAR in urban canyons remains a challenging problem due to the limited point cloud density from low-cost LiDAR and excessive dynamic surrounding objects. To fill this gap, this paper proposes enriching sparse 3D point clouds to denser clouds via a novel deep learning-based superresolution (SR) algorithm before its utilization in 3D LiDAR odometry. We validate the effectiveness of the proposed method using the KITTI dataset and a challenging dataset collected in an urban canyon (with complex environmental structures and dynamic objects) of Hong Kong. We conclude that significantly denser point clouds are achieved with considerable accuracy. In addition, significantly improved performance of 3D LiDAR odometry is obtained in the evaluated dataset collected in an urban canyon of Hong Kong.

[1]  Ian D. Reid,et al.  Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fields , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Ruigang Yang,et al.  GA-Net: Guided Aggregation Net for End-To-End Stereo Matching , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Petros A. Ioannou,et al.  Autonomous intelligent cruise control , 1993 .

[5]  Xi Wang,et al.  High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth , 2014, GCPR.

[6]  Sertac Karaman,et al.  Self-Supervised Sparse-to-Dense: Self-Supervised Depth Completion from LiDAR and Monocular Camera , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[7]  Brendan Englot,et al.  LeGO-LOAM: Lightweight and Ground-Optimized Lidar Odometry and Mapping on Variable Terrain , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Li-Ta Hsu,et al.  Performance Analysis of NDT-based Graph SLAM for Autonomous Vehicle in Diverse Typical Driving Scenarios of Hong Kong , 2018, Sensors.

[9]  Danping Zou,et al.  StructSLAM: Visual SLAM With Building Structure Lines , 2015, IEEE Transactions on Vehicular Technology.

[10]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[11]  M. Tomizuka,et al.  Uncertainty estimation of LiDAR matching aided by dynamic vehicle detection and high definition map , 2019, Electronics Letters.

[12]  Li-Ta Hsu,et al.  Correcting NLOS by 3D LiDAR and building height to improve GNSS single point positioning , 2019, Navigation.

[13]  Tom Duckett,et al.  Scan registration for autonomous mining vehicles using 3D‐NDT , 2007, J. Field Robotics.

[14]  E. Menegatti,et al.  A Portable 3D LIDAR-based System for Long-term and Wide-area People Behavior Measurement , 2019 .

[15]  Peter Biber,et al.  The normal distributions transform: a new approach to laser scan matching , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[16]  Aline Roumy,et al.  Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding , 2012, BMVC.

[17]  Aleksandr V. Segal,et al.  Generalized-ICP , 2009, Robotics: Science and Systems.

[18]  Eduardo Romera,et al.  ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic Segmentation , 2018, IEEE Transactions on Intelligent Transportation Systems.

[19]  Ruigang Yang,et al.  Spatial-Depth Super Resolution for Range Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Li-Ta Hsu,et al.  Tightly Coupled GNSS/INS Integration via Factor Graph and Aided by Fish-Eye Camera , 2019, IEEE Transactions on Vehicular Technology.

[21]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[22]  Peter Protzel,et al.  Expectation-Maximization for Adaptive Mixture Models in Graph Optimization , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[23]  Pavel Krsek,et al.  Robust Euclidean alignment of 3D point sets: the trimmed iterative closest point algorithm , 2005, Image Vis. Comput..

[24]  Thomas Brox,et al.  Sparsity Invariant CNNs , 2017, 2017 International Conference on 3D Vision (3DV).

[25]  Ardeshir Goshtasby,et al.  On the Canny edge detector , 2001, Pattern Recognit..

[26]  Zhenhua Guo,et al.  Color-Guided Depth Recovery via Joint Local Structural and Nonlocal Low-Rank Regularization , 2017, IEEE Transactions on Multimedia.

[27]  Michael Elad,et al.  On Single Image Scale-Up Using Sparse-Representations , 2010, Curves and Surfaces.

[28]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[29]  Stefano Soatto,et al.  Dense Depth Posterior (DDP) From Single Image and Sparse Range , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Li-Ta Hsu,et al.  GNSS NLOS Exclusion Based on Dynamic Object Detection Using LiDAR Point Cloud , 2021, IEEE Transactions on Intelligent Transportation Systems.

[31]  Hayder Radha,et al.  3D Scan Registration Based Localization for Autonomous Vehicles - A Comparison of NDT and ICP under Realistic Conditions , 2018, 2018 IEEE 88th Vehicular Technology Conference (VTC-Fall).

[32]  Touradj Ebrahimi,et al.  The JPEG 2000 still image compression standard , 2001, IEEE Signal Process. Mag..

[33]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[34]  Ming Liu,et al.  Tightly Coupled 3D Lidar Inertial Odometry and Mapping , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[35]  Zheng Fang,et al.  A Robust Laser-Inertial Odometry and Mapping Method for Large-Scale Highway Environments , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[36]  Ji Zhang,et al.  LOAM: Lidar Odometry and Mapping in Real-time , 2014, Robotics: Science and Systems.

[37]  Jianqin Zhou,et al.  On discrete cosine transform , 2011, ArXiv.

[38]  Masayoshi Tomizuka,et al.  UrbanLoco: A Full Sensor Suite Dataset for Mapping and Localization in Urban Scenes , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[39]  Ming Liu,et al.  Low-Cost GPS-Aided LiDAR State Estimation and Map Building , 2019, 2019 IEEE International Conference on Imaging Systems and Techniques (IST).

[40]  Ji Zhang,et al.  Visual-lidar odometry and mapping: low-drift, robust, and fast , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[41]  Samer S. Saab,et al.  A map matching approach for train positioning. I. Development and analysis , 2000, IEEE Trans. Veh. Technol..

[42]  Luc Van Gool,et al.  Sparse and Noisy LiDAR Completion with RGB Guidance and Uncertainty , 2019, 2019 16th International Conference on Machine Vision Applications (MVA).

[43]  Jie Tang,et al.  Learning Guided Convolutional Network for Depth Completion , 2019, IEEE Transactions on Image Processing.

[44]  Michael T. Orchard,et al.  A comparative study of DCT- and wavelet-based image coding , 1999, IEEE Trans. Circuits Syst. Video Technol..

[45]  Xiaoou Tang,et al.  Depth Map Super-Resolution by Deep Multi-Scale Guidance , 2016, ECCV.

[46]  Li-Ta Hsu,et al.  LiDAR Data Enrichment Using Deep Learning Based on High-Resolution Image: An Approach to Achieve High-Performance LiDAR SLAM Using Low-cost LiDAR. , 2020 .

[47]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[48]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[49]  Martin Magnusson,et al.  The three-dimensional normal-distributions transform : an efficient representation for registration, surface analysis, and loop detection , 2009 .

[50]  M. Pollefeys,et al.  DeepLiDAR: Deep Surface Normal Guided Depth Prediction for Outdoor Scene From Sparse LiDAR Data and Single Color Image , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).