Deep Learning-Based Localization and Perception Systems: Approaches for Autonomous Cargo Transportation Vehicles in Large-Scale, Semiclosed Environments

Vehicles capable of delivering heavy cargoes are a major means for the promotion of social productivity and are widely applied in industry. Even though self-driving technologies have been studied for a few decades and several successful applications have been demonstrated, autonomous industry vehicles are currently applied only in some specific scenarios with very low speed and fixed routes and are typically implemented in the indoor closed area of small-scale warehouses. In this article, we introduce the main perception and localization approaches of autonomous cargo transportation vehicles for industrial applications. We also demonstrate how these technologies can enable autonomous cargo transportation in the Hong Kong International Airport.

[1]  Wei Wu,et al.  Distractor-aware Siamese Networks for Visual Object Tracking , 2018, ECCV.

[2]  Changchun Liu,et al.  Baidu Apollo EM Motion Planner , 2018, ArXiv.

[3]  Ji Zhang,et al.  Robot Farmers: Autonomous Orchard Vehicles Help Tree Fruit Production , 2015, IEEE Robotics & Automation Magazine.

[4]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[5]  Liam Paull,et al.  Autonomous Vehicle Navigation in Rural Environments Without Detailed Prior Maps , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Vishnu Radhakrishnan,et al.  LiDAR-Camera Calibration using 3D-3D Point correspondences , 2017, ArXiv.

[7]  Leonidas J. Guibas,et al.  FlowNet3D: Learning Scene Flow in 3D Point Clouds , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Leonidas J. Guibas,et al.  Frustum PointNets for 3D Object Detection from RGB-D Data , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Yun-Hui Liu,et al.  A Multi-Sensor Fusion Based 2D-Driven 3D Object Detection Approach for Large Scene Applications ∗ , 2019, 2019 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[10]  Yun-Hui Liu,et al.  SeqLPD: Sequence Matching Enhanced Loop-Closure Detection Based on Large-Scale Point Cloud Description for Self-Driving Vehicles , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  C.J. Tomlin,et al.  Autonomous Automobile Trajectory Tracking for Off-Road Driving: Controller Design, Experimental Validation and Racing , 2007, 2007 American Control Conference.

[13]  Fabio Oleari,et al.  The PAN-Robots Project: Advanced Automated Guided Vehicle Systems for Industrial Logistics , 2018, IEEE Robotics & Automation Magazine.

[14]  Tamas Haidegger,et al.  Highly Automated Vehicles and Self-Driving Cars [Industry Tutorial] , 2018, IEEE Robotics & Automation Magazine.

[15]  Yun-Hui Liu,et al.  Modelling and Dynamic Tracking Control of Industrial Vehicles with Tractor-trailer Structure , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Hesheng Wang,et al.  LPD-Net: 3D Point Cloud Learning for Large-Scale Place Recognition and Environment Analysis , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[17]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[18]  Brendan Englot,et al.  LeGO-LOAM: Lightweight and Ground-Optimized Lidar Odometry and Mapping on Variable Terrain , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Renaud Dubé,et al.  SegMap: 3D Segment Mapping using Data-Driven Descriptors , 2018, Robotics: Science and Systems.