Spatial Motion Constraints Using Virtual Fixtures Generated by Anatomy

This paper describes a spatial-motion-constraints-generation approach for a human-machine collaborative surgical-assistant system from registered computer tomography models. We extend constrained optimization formulation incorporating task goals, anatomy-based constraints, "no fly zones," etc. We use a fast potential-collision-constraint-detection method based on a 3-D surface model and covariance tree data structure. These boundary constraints, along with task behaviors and joint limits, serve as constraint conditions for constrained robot control. We are able to follow a complex path inside a human skull, phantom represented by a surface model composed of 99 000 vertices and 182 000 triangles in real time. Our approach enables real-time task-based control of a surgical robot in a precise interactive minimally invasive surgery task. We illustrate our approach based on two example tasks which are analogous to the procedures in endoscopic sinus surgery, and analyze the user's performance on both teleoperation and cooperative control for one of the example tasks. The experimental results show that a robotic assistant employing our approach on spatial motion constraints can assist the user in skilled manipulation tasks, while maintaining desired properties. Our approach is equally applicable to teleoperative and cooperative controlled robots

[1]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[2]  Russell H. Taylor,et al.  Constrained control for surgical assistant robots , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[3]  Daniel E. Whitney,et al.  Resolved Motion Rate Control of Manipulators and Human Prostheses , 1969 .

[4]  O Schneider,et al.  A six-degree-of-freedom passive arm with dynamic constraints (PADyC) for cardiac surgery application: preliminary experiments. , 2001, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[5]  Dinesh K. Pai,et al.  Programming and control of robots by means of differential algebraic inequalities , 2000, IEEE Trans. Robotics Autom..

[6]  S. Shankar Sastry,et al.  A laparoscopic telesurgical workstation , 1999, IEEE Trans. Robotics Autom..

[7]  Russell H. Taylor,et al.  A Steady-Hand Robotic System for Microsurgical Augmentation , 1999, Int. J. Robotics Res..

[8]  Russell H. Taylor,et al.  A telerobotic assistant for laparoscopic surgery , 1995 .

[9]  K Koulechov,et al.  Navigated control in functional endoscopic sinus surgery , 2005, The international journal of medical robotics + computer assisted surgery : MRCAS.

[10]  Shuzhi Sam Ge,et al.  Adaptive neural network control of robot manipulators in task space , 1997, IEEE Trans. Ind. Electron..

[11]  Ève Coste-Manière,et al.  Planning and Simulation of Robotically Assisted Minimal Invasive Surgery , 2000, MICCAI.

[12]  John M. Hollerbach,et al.  Redundancy resolution of manipulators through torque optimization , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[13]  Allison M. Okamura,et al.  Effect of virtual fixture compliance on human-machine cooperative manipulation , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Tim C. Lueth,et al.  FESS control: Realization and evaluation of navigated control for functional endoscopic sinus surgery , 2006, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[15]  Tim C. Lueth,et al.  Mechatronical assistance for paranasal sinus surgery , 2005 .

[16]  Robert D. Howe,et al.  Evaluating control modes for constrained robotic surgery , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[17]  Michael A. Peshkin,et al.  The use of localizers, robots and synergistic devices in CAS , 1997, CVRMed.

[18]  Jocelyne Troccaz,et al.  Synergistic robots for surgery: an algorithmic view of the approach , 1998 .

[19]  Shahram Payandeh,et al.  On application of virtual fixtures as an aid for telemanipulation and training , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[20]  Charles A. Klein,et al.  Dexterity Measures for the Design and Control of Kinematically Redundant Manipulators , 1987 .

[21]  Russell H. Taylor,et al.  Constrained Cartesian motion control for teleoperated surgical robots , 1996, IEEE Trans. Robotics Autom..

[22]  Michael S. Benninger,et al.  Diagnosis and treatment of uncomplicated acute bacterial rhinosinusitis: Summary of the Agency for Health Care Policy and Research evidence-based report , 2000, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[23]  Valerie J. Lund,et al.  Infectious rhinosinusitis in adults: classification, etiology and management. International Rhinosinusitis Advisory Board. , 1997, Ear, nose, & throat journal.

[24]  Bruno Siciliano,et al.  Closed-Loop Inverse Kinematics Schemes for Constrained Redundant Manipulators with Task Space Augmentation and Task Priority Strategy , 1991, Int. J. Robotics Res..

[25]  Russell H. Taylor,et al.  A constrained optimization approach to virtual fixtures , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  T. Yoshikawa,et al.  Task-Priority Based Redundancy Control of Robot Manipulators , 1987 .

[27]  Lydia E. Kavraki,et al.  Treatment planning for a radiosurgical system with general kinematics , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[28]  C. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[29]  Gregory D. Hager,et al.  Spatial motion constraints: theory and demonstrations for robot guidance using virtual fixtures , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[30]  R. Aust,et al.  The functional size of the human maxillary ostium in vivo. , 1974, Acta oto-laryngologica.

[31]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Darius Burschka,et al.  Scale-Invariant Registration of Monocular Endoscopic Images to CT-Scans for Sinus Surgery , 2004, MICCAI.

[33]  Christopher Nimsky,et al.  A novel robot system for fully automated paranasal sinus surgery , 2003, CARS.

[34]  A. A. Maciejewski,et al.  Obstacle Avoidance , 2005 .

[35]  Robert D. Howe,et al.  Virtual Fixtures for Robotic Cardiac Surgery , 2001, MICCAI.

[36]  Russell H. Taylor,et al.  Medical robotics in computer-integrated surgery , 2003, IEEE Trans. Robotics Autom..

[37]  Optimized Port Placement for the Totally Endoscopic Coronary Artery Bypass Grafting using the da Vinci Robotic System , 2000, ISER.

[38]  Rajiv V. Dubey,et al.  Vision-based end-effector alignment assistance for teleoperation , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[39]  Shaoping Bai,et al.  Hexapod Intervention Planning for a Robotic Skull-Base Surgery System , 2001, MICCAI.

[40]  B L Davies,et al.  Active compliance in robotic surgery—the use of force control as a dynamic constraint , 1997, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[41]  Gregory D. Hager,et al.  Steady-hand teleoperation with virtual fixtures , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[42]  Homayoun Seraji,et al.  Motion control of 7-DOF arms: the configuration control approach , 1993, IEEE Trans. Robotics Autom..

[43]  Jean-Claude Latombe,et al.  CARABEAMER: a treatment planner for a robotic radiosurgical system with general kinematics , 1999, Medical Image Anal..

[44]  J. Edward Colgate,et al.  Cobot architecture , 2001, IEEE Trans. Robotics Autom..

[45]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[46]  Jocelyne Troccaz,et al.  Semi-active guiding systems in surgery. A two-dof prototype of the passive arm with dynamic constraints (PADyC) , 1996 .

[47]  Russell H. Taylor,et al.  A Steady-Hand Robotic System for Microsurgical Augmentation , 1999, Int. J. Robotics Res..

[48]  Gregory D. Hager,et al.  Vision-assisted control for manipulation using virtual fixtures , 2001, IEEE Transactions on Robotics.

[49]  John Kenneth Salisbury,et al.  The Intuitive/sup TM/ telesurgery system: overview and application , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[50]  Frank L. Lewis,et al.  Neural network output feedback control of robot manipulators , 1999, IEEE Trans. Robotics Autom..

[51]  C. Chevallereau,et al.  Resolution of robot redundancy in the Cartesian space by criteria optimization , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[52]  Russell H. Taylor,et al.  Telemanipulation of Snake-Like Robots for Minimally Invasive Surgery of the Upper Airway , 2006 .

[53]  Darius Burschka,et al.  Scale-invariant registration of monocular endoscopic images to CT-scans for sinus surgery , 2005, Medical Image Anal..

[54]  Brent A. Senior,et al.  Use of the Rhinosinusitis Disability Index (RSDI) in Rhinologic Disease , 2001, American journal of rhinology.

[55]  Kazuhiro Kosuge,et al.  Unified approach for teleoperation of virtual and real environment-manipulation based on reference dynamics , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[56]  Robert D. Howe,et al.  Port placement planning in robot-assisted coronary artery bypass , 2003, IEEE Trans. Robotics Autom..