Adaptive image-based positioning of RCM mechanisms using angle and distance features

In this paper, we address the positioning problem of remote centre of motion (RCM) mechanisms with uncalibrated image feedback from a monocular camera. Nowadays, RCM mechanisms are widely used in minimally invasive robotic surgery due to their ability to distally rotate a tool around a fixed entry port; note that in most surgical applications, the tools are typically controlled by manual/teleoperated motion commands given by a human user. In this paper, we depart from the traditional manual control scheme and derive sensor-based methods to automatically position the manipulated tool using real-time image feedback. To this end, we first characterise the mechanism's 3-DOF configuration with the angle of the image projected tool and scalar distances between feature points. To cope with uncertainty in the camera's calibration parameters, we propose two gradient descent estimators that adaptively compute the unknown Jacobian matrix; the stability of these algorithms is proved with Lyapunov theory. Finally, we derive a kinematic image-based controller and evaluate its performance with several positioning experiments.

[1]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[2]  Wyatt S. Newman,et al.  A novel vision guided knot-tying method for autonomous robotic surgery , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[3]  Ki-Young Kim,et al.  A Novel Surgical Manipulator with Workspace-Conversion Ability for Telesurgery , 2013, IEEE/ASME Transactions on Mechatronics.

[4]  P. Hynes,et al.  Uncalibrated Visual-Servoing of a Dual-Arm Robot for MIS Suturing , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[5]  Olac Fuentes,et al.  Experimental evaluation of uncalibrated visual servoing for precision manipulation , 1997, Proceedings of International Conference on Robotics and Automation.

[6]  Luc Soler,et al.  Autonomous 3-D positioning of surgical instruments in robotized laparoscopic surgery using visual servoing , 2003, IEEE Trans. Robotics Autom..

[7]  Daniel E. Whitney,et al.  Resolved Motion Rate Control of Manipulators and Human Prostheses , 1969 .

[8]  Yunhui Liu,et al.  A new circular-guided remote center of motion mechanism for assistive surgical robots , 2014, 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014).

[9]  Larry S. Davis,et al.  Iterative Pose Estimation Using Coplanar Feature Points , 1996, Comput. Vis. Image Underst..

[10]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[11]  Christophe Rosenberger,et al.  A tele-operated mobile ultrasound scanner using a light-weight robot , 2005, IEEE Transactions on Information Technology in Biomedicine.

[12]  Alois Knoll,et al.  Framework of automatic robot surgery system using Visual servoing , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Chunwoo Kim,et al.  Endocavity Ultrasound Probe Manipulators , 2013, IEEE/ASME Transactions on Mechatronics.

[14]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[15]  Yunhui Liu,et al.  Uncalibrated visual servoing of robots using a depth-independent interaction matrix , 2006, IEEE Transactions on Robotics.

[16]  Chin-Hsing Kuo,et al.  Kinematic design considerations for minimally invasive surgical robots: an overview , 2012, The international journal of medical robotics + computer assisted surgery : MRCAS.

[17]  Minoru Asada,et al.  Versatile visual servoing without knowledge of true Jacobian , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[18]  Yunhui Liu,et al.  Model-Free Visually Servoed Deformation Control of Elastic Objects by Robot Manipulators , 2013, IEEE Transactions on Robotics.

[19]  Nima Najmaei,et al.  Visual servoing in medical robotics: a survey. Part I: endoscopic and direct vision imaging – techniques and applications , 2014, The international journal of medical robotics + computer assisted surgery : MRCAS.

[20]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[21]  Philippe Zanne,et al.  Visual Servoing-Based Endoscopic Path Following for Robot-Assisted Laparoscopic Surgery , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .