Robust RGB-D Camera and IMU Fusion-based Cooperative and Relative Close-range Localization for Multiple Turtle-inspired Amphibious Spherical Robots

In the narrow, submarine, unstructured environment, the present localization approaches, such as GPS measurement, dead-reckoning, acoustic positioning, artificial landmarks-based method, are hard to be used for multiple small-scale underwater robots. Therefore, this paper proposes a novel RGB-D camera and Inertial Measurement Unit (IMU) fusion-based cooperative and relative close-range localization approach for special environments, such as underwater caves. Owing to the rotation movement with zero-radius, the cooperative localization of Multiple Turtle-inspired Amphibious Spherical Robot (MTASRs) is realized. Firstly, we present an efficient Histogram of Oriented Gradient (HOG) and Color Names (CNs) fusion feature extracted from color images of TASRs. Then, by training Support Vector Machine (SVM) classifier with this fusion feature, an automatic recognition method of TASRs is developed. Secondly, RGB-D camera-based measurement model is obtained by the depth map. In order to realize the cooperative and relative close-range localization of MTASRs, the MTASRs model is established with RGB-D camera and IMU. Finally, the depth measurement in water is corrected and the efficiency of RGB-D camera for underwater application is validated. Then experiments of our proposed localization method with three robots were conducted and the results verified the feasibility of the proposed method for MTASRs.

[1]  Shuxiang Guo,et al.  Design and characteristics evaluation of a novel spherical underwater robot , 2017, Robotics Auton. Syst..

[2]  Shuxiang Guo,et al.  Hydrodynamic Analysis-Based Modeling and Experimental Verification of a New Water-Jet Thruster for an Amphibious Spherical Robot , 2019, Sensors.

[3]  Shuxiang Guo,et al.  Modeling and experimental evaluation of an improved amphibious robot with compact structure , 2018, Robotics and Computer-Integrated Manufacturing.

[4]  Luigi Chisci,et al.  An unscented Kalman filter based navigation algorithm for autonomous underwater vehicles , 2016 .

[5]  Huimin Lu,et al.  Depth Map Reconstruction for Underwater Kinect Camera Using Inpainting and Local Image Mode Filtering , 2017, IEEE Access.

[6]  Shuxiang Guo,et al.  Kalman Filter-based navigation system for the Amphibious Spherical Robot , 2017, 2017 IEEE International Conference on Mechatronics and Automation (ICMA).

[7]  Pere Ridao,et al.  Vision-based localization of an underwater robot in a structured environment , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[8]  Pere Ridao,et al.  Underwater Multi-Vehicle Trajectory Alignment and Mapping Using Acoustic and Optical Constraints , 2016, Sensors.

[9]  Shuxiang Guo,et al.  A Kinect-Based Real-Time Compressive Tracking Prototype System for Amphibious Spherical Robots , 2015, Sensors.

[10]  Pere Ridao,et al.  Close-Range Tracking of Underwater Vehicles Using Light Beacons , 2016, Sensors.

[11]  Shuxiang Guo,et al.  Vision locating method based RGB-D camera for amphibious spherical robots , 2017, 2017 IEEE International Conference on Mechatronics and Automation (ICMA).

[12]  Auke Jan Ijspeert,et al.  Salamandra Robotica II: An Amphibious Robot to Study Salamander-Like Swimming and Walking Gaits , 2013, IEEE Transactions on Robotics.

[13]  John J. Leonard,et al.  Decentralized cooperative trajectory estimation for autonomous underwater vehicles , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Shuxiang Guo,et al.  Development of an Amphibious Turtle-Inspired Spherical Mother Robot , 2013 .

[15]  Shuxiang Guo,et al.  Performance Evaluation of a Novel Propulsion System for the Spherical Underwater Robot (SURIII) , 2017 .

[16]  Qiang Huang,et al.  A Modified Robotic Rat to Study Rat-Like Pitch and Yaw Movements , 2018, IEEE/ASME Transactions on Mechatronics.

[17]  Xiaoxiang Li,et al.  Locomotion performance of the amphibious robot on various terrains and underwater with flexible flipper legs , 2016 .

[18]  Davide Scaramuzza,et al.  A monocular pose estimation system based on infrared LEDs , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Arne Sieber,et al.  GSM/GPS diving computer for underwater tracking and mapping , 2012 .

[20]  Shuxiang Guo,et al.  Visual Detection and Tracking System for a Spherical Amphibious Robot , 2017, Sensors.

[21]  Nuno Gracias,et al.  Pose Estimation for Underwater Vehicles using Light Beacons , 2015 .

[22]  Joan Batlle,et al.  High-Accuracy Localization of an Underwater Robot in a Structured Environment Using Computer Vision , 2003, IbPRIA.

[23]  Weihua Li,et al.  On a CPG-Based Hexapod Robot: AmphiHex-II With Variable Stiffness Legs , 2018, IEEE/ASME Transactions on Mechatronics.

[24]  K.J. Kyriakopoulos,et al.  Localization of an underwater vehicle using an IMU and a laser-based vision system , 2007, 2007 Mediterranean Conference on Control & Automation.

[25]  Wei Gao,et al.  An improved cooperative localization method for multiple autonomous underwater vehicles based on acoustic round-trip ranging , 2014, 2014 IEEE/ION Position, Location and Navigation Symposium - PLANS 2014.

[26]  Jianwei Zhang,et al.  On a Bio-inspired Amphibious Robot Capable of Multimodal Motion , 2012, IEEE/ASME Transactions on Mechatronics.

[27]  Toshihiro Maki,et al.  Experimental Evaluation of Accuracy and Efficiency of Alternating Landmark Navigation by Multiple AUVs , 2018, IEEE Journal of Oceanic Engineering.

[28]  Shuxiang Guo,et al.  Hybrid Locomotion Evaluation for a Novel Amphibious Spherical Robot , 2018 .

[29]  Navinda Kottege,et al.  Underwater acoustic localization for small submersibles , 2011, J. Field Robotics.

[30]  Donghwa Lee,et al.  Artificial landmark-based underwater localization for AUVs using weighted template matching , 2014, Intell. Serv. Robotics.

[31]  Fabrice Mériaudeau,et al.  Underwater online 3D mapping and scene reconstruction using low cost kinect RGB-D sensor , 2016, 2016 6th International Conference on Intelligent and Advanced Systems (ICIAS).

[32]  Bo Wang,et al.  INS/DVL/PS Tightly Coupled Underwater Navigation Method With Limited DVL Measurements , 2018, IEEE Sensors Journal.

[33]  Bruno Jouvencel,et al.  Cooperative positioning and navigation for multiple AUV operations , 2001, MTS/IEEE Oceans 2001. An Ocean Odyssey. Conference Proceedings (IEEE Cat. No.01CH37295).

[34]  Shiwu Zhang,et al.  Initial Development of a Novel Amphibious Robot with Transformable Fin-Leg Composite Propulsion Mechanisms , 2013 .

[35]  Haryong Song,et al.  Robust Vision-Based Relative-Localization Approach Using an RGB-Depth Camera and LiDAR Sensor Fusion , 2016, IEEE Transactions on Industrial Electronics.

[36]  W. Hawkinson,et al.  Tactical underwater navigation system (TUNS) , 2008, 2008 IEEE/ION Position, Location and Navigation Symposium.

[37]  Qiang Huang,et al.  An overview of biomimetic robots with animal behaviors , 2019, Neurocomputing.