A Multi-Binocular Camera-based Localization Method for Amphibious Spherical Robots

This paper presents a novel multi-binocular camera based localization method with panoramic view and high precision for amphibious spherical robots. In our previous work, the proposed approach based on RGB-D camera and inertial measurement unit (IMU) realized a cooperative and relatively close-range localization. While, position drifts caused by the rotation movement and short positioning range of RGB-D camera in underwater environments are the drawbacks of the previous approach. This paper designs a multi-binocular camera system on the amphibious spherical robot, which makes the robot observe targets in a nearly 360-degree visual range without rotation movement. Meanwhile, through the stereo vision model, the robot obtains the position information about the target robot. Then, according to the position information and the relative position of the binocular cameras, the cooperative localization model is established. To validate the proposed approach, experiments were performed in gazebo simulator with varying distances and relative degree. Compared with the previous works, the proposed localization method reveals higher accuracy and robustness.

[1]  Shuxiang Guo,et al.  Hybrid Locomotion Evaluation for a Novel Amphibious Spherical Robot , 2018 .

[2]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[3]  Donghwa Lee,et al.  Artificial landmark-based underwater localization for AUVs using weighted template matching , 2014, Intell. Serv. Robotics.

[4]  Shuxiang Guo,et al.  A Novel Step Optimal Path Planning Algorithm for the Spherical Mobile Robot Based on Fuzzy Control , 2020, IEEE Access.

[5]  Robert B. McGhee,et al.  Testing and evaluation of an integrated GPS/INS system for small AUV navigation , 1999 .

[6]  Liang Zheng,et al.  A highly stable and efficient spherical underwater robot with hybrid propulsion devices , 2020, Auton. Robots.

[7]  Shuxiang Guo,et al.  Robust RGB-D Camera and IMU Fusion-based Cooperative and Relative Close-range Localization for Multiple Turtle-inspired Amphibious Spherical Robots , 2019 .

[8]  Shuxiang Guo,et al.  Modeling and experimental evaluation of an improved amphibious robot with compact structure , 2018, Robotics and Computer-Integrated Manufacturing.

[9]  Zhouhua Peng,et al.  Output-Feedback Path-Following Control of Autonomous Underwater Vehicles Based on an Extended State Observer and Projection Neural Networks , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Shuxiang Guo,et al.  Hydrodynamic Analysis-Based Modeling and Experimental Verification of a New Water-Jet Thruster for an Amphibious Spherical Robot , 2019, Sensors.

[11]  Zheping Yan,et al.  A Real-Time Reaction Obstacle Avoidance Algorithm for Autonomous Underwater Vehicles in Unknown Environments , 2018, Sensors.

[12]  Shuxiang Guo,et al.  Collaboration and Task Planning of Turtle-Inspired Multiple Amphibious Spherical Robots , 2020, Micromachines.

[13]  Yu Wang,et al.  A Paradigm for Path Following Control of a Ribbon-Fin Propelled Biomimetic Underwater Vehicle , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[14]  Pere Ridao,et al.  Vision-based localization of an underwater robot in a structured environment , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[15]  Shuxiang Guo,et al.  A Novel Small-scale Turtle-inspired Amphibious Spherical Robot , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Zheping Yan,et al.  Robust adaptive sliding mode control of underactuated autonomous underwater vehicles with uncertain dynamics , 2019, Ocean Engineering.

[17]  Weidong Zhang,et al.  Trajectory Tracking Control of AUVs via Adaptive Fast Nonsingular Integral Terminal Sliding Mode Control , 2020, IEEE Transactions on Industrial Informatics.

[18]  Wei Wang,et al.  Online State Estimation of a Fin-Actuated Underwater Robot Using Artificial Lateral Line System , 2020, IEEE Transactions on Robotics.

[19]  Bing Sun,et al.  SURVEY OF TRAJECTORY TRACKING CONTROL OF AUTONOMOUS UNDERWATER VEHICLES , 2017 .

[20]  Shuxiang Guo,et al.  Binocular Camera-based a Docking System for an Amphibious Spherical Robot , 2018, 2018 IEEE International Conference on Mechatronics and Automation (ICMA).

[21]  Meng Joo Er,et al.  Direct Adaptive Fuzzy Tracking Control of Marine Vehicles With Fully Unknown Parametric Dynamics and Uncertainties , 2016, IEEE Transactions on Control Systems Technology.