Adaptive Visual Servoing for an Underwater Soft Robot Considering Refraction Effects

Robots inspired from marine organisms are tremendously developed for applications of underwater exploration, rescuing, navigation, etc. In this article, we implement an uncalibrated visual servoing scheme to achieve accurate positioning performance of an octopus-tentacle-like soft robot arm. The image-based adaptive visual servoing controller is designed based on the underwater dynamic model of the robot system. An adaptive mechanism to solve the tedious camera calibration problem is also extremely complicated in underwater environment due to the refraction effect resulting in changes of optical condition. In this article, this effect is analogous to the radial distortion. The presented algorithm can linearize the distortion model, and then online iteratively estimate the unknown image mapping model based on the classical Slotine-Li adaptive algorithm. The intrinsic and extrinsic parameters can also be estimated in real time. The presented adaptive controller is verified both theoretically using the Lyapunov stability analysis to prove the stability of the dynamical system, and experimentally to prove the accuracy and rapid convergence to the target image position.

[1]  Xuebo Zhang,et al.  Visual Servo Regulation of Wheeled Mobile Robots With Simultaneous Depth Identification , 2018, IEEE Transactions on Industrial Electronics.

[2]  Xi Liu,et al.  Adaptive Active Visual Servoing of Nonholonomic Mobile Robots , 2012, IEEE Transactions on Industrial Electronics.

[3]  J. N. Reddy,et al.  Bending of Euler–Bernoulli beams using Eringen’s integral formulation: A paradox resolved , 2016 .

[4]  Xinwu Liang,et al.  Visual Servoing of Soft Robot Manipulator in Constrained Environments With an Adaptive Controller , 2017, IEEE/ASME Transactions on Mechatronics.

[5]  Stephen Gates,et al.  Motivating Kane's method for obtaining equations of motion for dynamic systems , 1989 .

[6]  Darwin G. Caldwell,et al.  Shape function-based kinematics and dynamics for variable length continuum robotic arms , 2011, 2011 IEEE International Conference on Robotics and Automation.

[7]  Yee-Hong Yang,et al.  A Closed-Form Solution to Single Underwater Camera Calibration Using Triple Wavelength Dispersion and Its Application to Single Camera 3D Reconstruction , 2017, IEEE Transactions on Image Processing.

[8]  Roland Siegwart,et al.  Target-based calibration of underwater camera housing parameters , 2016, 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[9]  Andrea Maria Zanchettin,et al.  Robust constraint-based control of robot manipulators: An application to a visual aided grasping task , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Xuebo Zhang,et al.  Visual Servoing of Nonholonomic Mobile Robots With Uncalibrated Camera-to-Robot Parameters , 2017, IEEE Transactions on Industrial Electronics.

[11]  Ian D. Walker,et al.  Kinematics for multisection continuum robots , 2006, IEEE Transactions on Robotics.

[12]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[13]  Yunhui Liu,et al.  Uncalibrated visual servoing of robots using a depth-independent interaction matrix , 2006, IEEE Transactions on Robotics.

[14]  Tao Liu,et al.  Eye-in-Hand Tracking Control of a Free-Floating Space Manipulator , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[15]  Andrea Torsello,et al.  Parameter-Free Lens Distortion Calibration of Central Cameras , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[16]  Fuqiang Zhou,et al.  Line-based camera calibration with lens distortion correction from a single image , 2013 .

[17]  A Meline,et al.  A camcorder for 3D underwater reconstruction of archeological objects , 2010, OCEANS 2010 MTS/IEEE SEATTLE.

[18]  Tingting Wang,et al.  Robust Online Model Predictive Control for a Constrained Image-Based Visual Servoing , 2016, IEEE Transactions on Industrial Electronics.

[19]  De Xu,et al.  Embedded Vision-Guided 3-D Tracking Control for Robotic Fish , 2016, IEEE Transactions on Industrial Electronics.

[20]  John Kenneth Salisbury,et al.  Mechanics Modeling of Tendon-Driven Continuum Manipulators , 2008, IEEE Transactions on Robotics.

[21]  Yunhui Liu,et al.  Uncalibrated visual tracking control without visual velocity , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[22]  Yunhui Liu,et al.  Leader-Following Formation Tracking Control of Mobile Robots Without Direct Position Measurements , 2016, IEEE Transactions on Automatic Control.

[23]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[24]  Christopher D. Rahn,et al.  Geometrically Exact Models for Soft Robotic Manipulators , 2008, IEEE Transactions on Robotics.

[25]  Tao Deng,et al.  Visual servo control of cable-driven soft robotic manipulator , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  D. Rus,et al.  Design, fabrication and control of soft robots , 2015, Nature.

[27]  S.S. da Costa Botelho,et al.  Visual odometry and mapping for Underwater Autonomous Vehicles , 2009, 2009 6th Latin American Robotics Symposium (LARS 2009).

[28]  Yunhui Liu,et al.  Dynamic Visual Tracking for Manipulators Using an Uncalibrated Fixed Camera , 2007, IEEE Transactions on Robotics.

[29]  B. Siciliano,et al.  Visual Grasp Planning for Unknown Objects Using a Multifingered Robotic Hand , 2013, IEEE/ASME Transactions on Mechatronics.

[30]  Zhao Shuang,et al.  Camera distortion calibration method based on nonspecific planar target , 2016, 2016 IEEE International Conference on Signal and Image Processing (ICSIP).

[31]  Michael C. Yip,et al.  Model-Less Feedback Control of Continuum Manipulators in Constrained Environments , 2014, IEEE Transactions on Robotics.

[32]  Zhongwei Li,et al.  Generic radial distortion calibration of a novel single camera based panoramic stereoscopic system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[33]  Kyu-Jin Cho,et al.  Review of biomimetic underwater robots using smart actuators , 2012 .

[34]  Hesheng Wang,et al.  Underwater Dynamic Modeling for a Cable-Driven Soft Robot Arm , 2018, IEEE/ASME Transactions on Mechatronics.

[35]  Abolfazl Mohebbi,et al.  Augmented Image-Based Visual Servoing of a Manipulator Using Acceleration Command , 2014, IEEE Transactions on Industrial Electronics.