A Robust Data-Driven Approach for Online Learning and Manipulation of Unmodeled 3-D Heterogeneous Compliant Objects

We present a generic data-driven method to address the problem of manipulating a three-dimensional (3-D) compliant object (CO) with heterogeneous physical properties in the presence of unknown disturbances. In this study, we do not assume a prior knowledge about the deformation behavior of the CO and type of the disturbance (e.g., internal or external). We also do not impose any constraints on the CO's physical properties (e.g., shape, mass, and stiffness). The proposed optimal iterative algorithm incorporates the provided visual feedback data to simultaneously learn and estimate the deformation behavior of the CO in order to accomplish the desired control objective. To demonstrate the capabilities and robustness of our algorithm, we fabricated two novel heterogeneous compliant phantoms and performed experiments on the da Vinci Research Kit. Experimental results demonstrated the adaptivity, robustness, and accuracy of the proposed method and, therefore, its suitability for a variety of medical and industrial applications involving CO manipulation.

[1]  Mozafar Saadat,et al.  Industrial applications of automatic manipulation of flexible materials , 2002 .

[2]  Pierre Payeur,et al.  Dexterous Robotic Manipulation of Deformable Objects with Multi-Sensory Feedback - a Review , 2010 .

[3]  Pranav A. Bhounsule,et al.  A discrete control lyapunov function for exponential orbital stabilization of the simplest walker , 2017 .

[4]  M. Navabi,et al.  Robust Optimal Adaptive Trajectory Tracking Control of Quadrotor Helicopter 1 , 2017 .

[5]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[6]  H. Mirzaei,et al.  ROBUST OPTIMAL ADAPTIVE TRAJECTORY TRACKING CONTROL FOR MIMO UNCERTAIN INPUT CONSTRAINED QUADROTOR HELICOPTER , 2017 .

[7]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[8]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[9]  Shinichi Hirai,et al.  Deformation control of rheological food dough using a forming process model , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[10]  James K. Mills,et al.  Dynamic modeling and control of a multi-robot system for assembly of flexible payloads with applications to automotive body assembly , 1996, J. Field Robotics.

[11]  Hui Zhang,et al.  On cutting and dissection of virtual deformable objects , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[12]  Russell H. Taylor,et al.  Development and Experimental Evaluation of Concurrent Control of a Robotic Arm and Continuum Manipulator for Osteolytic Lesion Treatment , 2017, IEEE Robotics and Automation Letters.

[13]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Yunhui Liu,et al.  On the visual deformation servoing of compliant objects: Uncalibrated control methods and experiments , 2014, Int. J. Robotics Res..

[15]  Dmitry Berenson,et al.  Manipulation of deformable objects without modeling and simulating deformation , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Russell H. Taylor,et al.  Integration of a Snake-like Dexterous Manipulator for Head and Neck Surgery with the da Vinci Research Kit. , 2017 .

[17]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[18]  Zerui Wang,et al.  Toward Semi-autonomous Cryoablation of Kidney Tumors via Model-Independent Deformable Tissue Manipulation Technique , 2018, Annals of Biomedical Engineering.

[19]  Tsuneo Yoshikawa,et al.  Manipulability of Robotic Mechanisms , 1985 .

[20]  Yunhui Liu,et al.  Automatic 3-D Manipulation of Soft Objects by Robotic Arms With an Adaptive Deformation Model , 2016, IEEE Transactions on Robotics.

[21]  Yuan F. Zheng,et al.  Deformation identification and estimation of one-dimensional objects by using vision sensors , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[22]  Shinichi Hirai,et al.  Indirect simultaneous positioning of deformable objects with multi-pinching fingers based on an uncertain model , 2000, Robotica.