A dynamic active constraints approach for hands-on robotic surgery

Toward the goal of developing a hands-on robotic surgery control strategy which simultaneously utilizes the various strengths of both the surgeon and robot, we present a dynamic active constraint approach tailored for hands-on surgery. Forbidden region active constraints are used to prevent motion into areas which have been deemed dangerous by the surgeon, helping to overcome some of the disadvantages of fully active systems such as loss of tactile feedback, limited workspace, and limited field-of-view. The computer graphics technique of metaballs is used to represent point cloud data from an imaging system with an analytical, differentiable surface and a dynamics-based controller is proposed which controls the robot to lie on the zero set of the generated time-varying implicit function for which the motion is either known or unknown. This controller has been incorporated into a recursive null-space approach to allow for unimpeded motion along the surface and for further extension to joint optimization in the future. This methodology is demonstrated in simulation and on a lightweight, seven-degree-of-freedom serial manipulator.

[1]  Tosiyasu L. Kunii,et al.  Function Representation of Solids Reconstructed from Scattered Surface Points and Contours , 1995, Comput. Graph. Forum.

[2]  James F. Blinn,et al.  A Generalization of Algebraic Surface Drawing , 1982, TOGS.

[3]  Brian L. Davies,et al.  Preliminary Results of an Early Clinical Experience with the AcrobotTM System for Total Knee Replacement Surgery , 2002, MICCAI.

[4]  Kalpathi R. Subramanian,et al.  Interpolating implicit surfaces from scattered surface data using compactly supported radial basis functions , 2001, Proceedings International Conference on Shape Modeling and Applications.

[5]  Oussama Khatib,et al.  A unified approach for motion and force control of robot manipulators: The operational space formulation , 1987, IEEE J. Robotics Autom..

[6]  Timothy N Judkins,et al.  Augmented reality and haptic interfaces for robot‐assisted surgery , 2012, The international journal of medical robotics + computer assisted surgery : MRCAS.

[7]  John Kenneth Salisbury,et al.  Point clouds can be represented as implicit surfaces for constraint-based haptic rendering , 2012, 2012 IEEE International Conference on Robotics and Automation.

[8]  Gregory D. Hager,et al.  Vision-assisted control for manipulation using virtual fixtures , 2001, IEEE Transactions on Robotics.

[9]  Jing Ren,et al.  Dynamic 3-D Virtual Fixtures for Minimally Invasive Beating Heart Procedures , 2008, IEEE Transactions on Medical Imaging.

[10]  Oussama Khatib,et al.  Synthesis and control of whole-body behaviors in humanoid systems , 2007 .

[11]  Tobias Ortmaier,et al.  A hands-on-robot for accurate placement of pedicle screws , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[12]  R. D. Hibberd,et al.  Robot assisted knee surgery , 1995 .

[13]  Oussama Khatib,et al.  An open source extensible software package to create whole-body compliant skills in personal mobile manipulators , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Louis B. Rosenberg,et al.  The Use of Virtual Fixtures as Perceptual Overlays to Enhance Operator Performance in Remote Environments. , 1992 .

[15]  Holger Wendland,et al.  Piecewise polynomial, positive definite and compactly supported radial functions of minimal degree , 1995, Adv. Comput. Math..

[16]  Ève Coste-Manière,et al.  Haptically augmented teleoperation , 2000, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[17]  Howard Jay Chizeck,et al.  Forbidden-region virtual fixtures from streaming point clouds: Remotely touching and protecting a beating heart , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  M. Jakopec,et al.  Hands-On Robotic Surgery: Is This the Future? , 2004, MIAR.

[19]  Allison M. Okamura,et al.  Design considerations and human-machine performance of moving virtual fixtures , 2009, 2009 IEEE International Conference on Robotics and Automation.