Guaranteed Active Constraints Enforcement on Point Cloud-approximated Regions for Surgical Applications

In this work, a passive physical human-robot interaction (pHRI) controller is proposed to intraoperatively ensure that sensitive tissues will not be damaged by the robot’s tool. The proposed scheme uses the point cloud of the restricted region’s surface as constraint definition and Artificial Potential fields for constraint enforcement. The controller is proven to be passive with respect to the interaction force and to guarantee constraint satisfaction in all cases. The proposed methodology is experimentally validated by the kinesthetic guidance of a KUKA LWR4+ robot’s end-effector driving a virtual slave KUKA in the vicinity of a 3D point-cloud of a kidney and its adjacent vessels.

[1]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[2]  Gregory D. Hager,et al.  Vision assisted control for manipulation using virtual fixtures: experiments at macro and micro scales , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[3]  Ferdinando Rodriguez y Baena,et al.  Dissipative Control for Physical Human–Robot Interaction , 2015, IEEE Transactions on Robotics.

[4]  Robert D. Howe,et al.  Virtual Fixtures for Robotic Cardiac Surgery , 2001, MICCAI.

[5]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[6]  Oussama Khatib,et al.  Commande dynamique dans l''espace op'erational des robots ma-nipulaters en pr'esence d''obstacles , 1980 .

[7]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[8]  O. Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[9]  Blake Hannaford,et al.  Forbidden region virtual fixtures from streaming point clouds , 2014, Adv. Robotics.

[10]  Louis B. Rosenberg,et al.  Virtual fixtures: Perceptual tools for telerobotic manipulation , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[11]  George A. Rovithakis,et al.  Constrained visual servoing under uncertain dynamics , 2019, Int. J. Control.

[12]  Louis B. Rosenberg,et al.  The Use of Virtual Fixtures as Perceptual Overlays to Enhance Operator Performance in Remote Environments. , 1992 .

[13]  Charalampos P. Bechlioulis,et al.  Prescribed performance image based visual servoing under field of view constraints , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  J. Edward Colgate,et al.  Intelligent assist devices in industrial applications: a review , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[15]  Brian L. Davies,et al.  Active Constraints/Virtual Fixtures: A Survey , 2014, IEEE Transactions on Robotics.

[16]  Howard Jay Chizeck,et al.  Forbidden-region virtual fixtures from streaming point clouds: Remotely touching and protecting a beating heart , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Kouhei Ohnishi,et al.  Modulated potential field for position adjusting with human interaction for implant surgery , 2015, 2015 IEEE International Conference on Mechatronics (ICM).

[18]  D E Mcgovern.  HUMAN INTERFACES IN REMOTE DRIVING , 1988 .

[19]  Gregory D. Hager,et al.  Vision-assisted control for manipulation using virtual fixtures , 2001, IEEE Transactions on Robotics.

[20]  Chien Chern Cheah.  Region reaching control of robots with motion constraints , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[21]  Dimitrios Papageorgiou,et al.  On the Stability of Robot Kinesthetic Guidance in the Presence of Active Constraints , 2018, 2018 European Control Conference (ECC).

[22]  Michael Ortega-Binderberger,et al.  A Six Degree-of-Freedom God-Object Method for Haptic Display of Rigid Bodies with Surface Properties , 2007, IEEE Transactions on Visualization and Computer Graphics.

[23]  Dinesh Manocha,et al.  FCL: A general purpose library for collision and proximity queries , 2012, 2012 IEEE International Conference on Robotics and Automation.

[24]  Howard Jay Chizeck,et al.  Advanced telerobotic underwater manipulation using virtual fixtures and haptic rendering , 2013, 2013 OCEANS - San Diego.

[25]  Raymond W. Harrigan,et al.  An alternative control structure for telerobotics , 1989 .

[26]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[27]  Guang-Zhong Yang,et al.  Implicit active constraints for a compliant surgical manipulator , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Peter Kazanzides,et al.  Portability and applicability of virtual fixtures across medical and manufacturing tasks , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..