Intelligent Collaborative Localization Among Air-Ground Robots for Industrial Environment Perception

Multiple mobile robots have gradually played a key role in many industrial systems, such as factory freight logistics system, patrol security in the factory environment, and multirobot collaborative service and work. As a key issue in industrial environment perception, the accurate robot localization can enhance their autonomous ability and is an important branch of robotic studies in artificial intelligence. In this paper, we propose a new method for cooperative autonomous localization among air-ground robots in a wide-ranging outdoor industrial environment. The aerial robot first maps an area of interest and achieves self-localization. Then the aerial robot transfers a simplified orthogonal perspective 2.5-D map to the ground robots for collaboration. Within the collaboration, the ground robot achieves pose estimation with respect to the unmanned aerial vehicle pose by instantaneously registering a single panorama with respect to the 2.5-D map. The 2.5-D map is used as the spatial association among air-ground robots. The ground robots estimate the orientation using automatically detected geometric information and generates the translation by aligning the 2.5-D map with a semantic segmentation of the panorama. Our method effectively overcomes the dramatic differences between the air-level view and the ground-level view. A set of experiments is performed in the outdoor industrial environment to demonstrate the applicability of our localization method. The proposed robotic collaborative localization outperforms most consumer sensor in accuracy and also has an outstanding running time.

[1]  Tobias Höllerer,et al.  Wide-area scene mapping for mobile visual tracking , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[2]  Davide Scaramuzza,et al.  Benefit of large field-of-view cameras for visual odometry , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Ji Zhang,et al.  LOAM: Lidar Odometry and Mapping in Real-time , 2014, Robotics: Science and Systems.

[4]  Davide Scaramuzza,et al.  Air‐ground Matching: Appearance‐based GPS‐denied Urban Localization of Micro Aerial Vehicles , 2015, J. Field Robotics.

[5]  Pascal Vasseur,et al.  Motion estimation by decoupling rotation and translation in catadioptric vision , 2010, Comput. Vis. Image Underst..

[6]  Richard Szeliski,et al.  City-Scale Location Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Peter F. Sturm,et al.  Pose estimation using both points and lines for geo-localization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Davide Scaramuzza,et al.  Air-ground localization and map augmentation using monocular dense reconstruction , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Roberto Cipolla,et al.  An Image-Based System for Urban Navigation , 2004, BMVC.

[10]  Tsuhan Chen,et al.  GPS Refinement and Camera Orientation Estimation from a Single Image and a 2D Map , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[11]  Mubarak Shah,et al.  Accurate Image Localization Based on Google Maps Street View , 2010, ECCV.

[12]  Pascal Fua,et al.  Worldwide Pose Estimation Using 3D Point Clouds , 2012, ECCV.

[13]  Wolfram Burgard,et al.  Monocular camera localization in 3D LiDAR maps , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Torsten Sattler,et al.  Improving Image-Based Localization by Active Correspondence Search , 2012, ECCV.

[15]  Marc Pollefeys,et al.  Registration of Spherical Panoramic Images with Cadastral 3D Models , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[16]  Vincent Lepetit,et al.  Instant Outdoor Localization and SLAM Initialization from 2.5D Maps , 2015, IEEE Transactions on Visualization and Computer Graphics.

[17]  Liang-Tien Chia,et al.  Estimating camera pose from a single urban ground-view omnidirectional image and a 2D building outline map , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Antonio Barrientos,et al.  An Aerial–Ground Robotic System for Navigation and Obstacle Mapping in Large Outdoor Areas , 2013, Sensors.

[19]  Yuefeng Li,et al.  Multi-frequency ultrasound transducers for medical applications: a survey , 2018, International Journal of Intelligent Robotics and Applications.

[20]  Sean J. Barbeau,et al.  Positional Accuracy of Assisted GPS Data from High-Sensitivity GPS-enabled Mobile Phones , 2011, Journal of Navigation.

[21]  Claus Brenner,et al.  Extraction of buildings and trees in urban environments , 1999 .

[22]  Edwin Olson,et al.  FLAG: Feature-based Localization between Air and Ground , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).