Motion Compensation in Minimally Invasive Robotic Surgery

Minimally invasive beating heart surgery allows a very sparing operation, but increases the requirements for the surgeon: The remaining motion of the mechanically stabilized beating heart makes fast and safe surgery difficult. The goal of an advanced robotic surgery system is to compensate for this motion. This work presents control and vision algorithms necessary for such novel robotic surgery applications. Cartesian position and velocity control laws in a minimally invasive surgery environment allow correct hand eye coordination which the surgeon got used to in open surgery. In combination with appropriate filtering and scaling of input commands, high accuracy manipulation of fine structures is possible. A self-adapting Cartesian force control law reduces the risk of unintentional damage of delicate tissue structures. Motion of the mechanically stabilized beating heart is locally captured by tracking natural landmarks with an affine motion model. To circumvent disturbances of the tracking approach, specular reflections on the heart surface have to be handled appropriately. Automatic detection of landmarks allowing reliable determination of the affine model parameters can be achieved by special confidence measures. A new motion prediction framework is introduced to further increase robustness of the motion tracking scheme. This framework is able to compensate for short occlusions and small disturbances. Additional signals correlated with the heart motion (e.g. electrocardiogram) are included in this prediction scheme to reduce the dependency on visual information.

[1]  Tobias Ortmaier,et al.  Bewegungsschätzung in der minimal invasiven Herzchirurgie , 2002 .

[2]  Harald Kirchner Bewegungserkennung in Bildfolgen - ein mehrstufiger Ansatz , 1993 .

[3]  S. Shankar Sastry,et al.  Telesurgery and surgical simulation: design, modeling, and evaluation of haptic interfaces to real and virtual surgical environments , 2000 .

[4]  Tobias Ortmaier,et al.  Teleoperation Concepts in Minimal Invasive Surgery , 2001 .

[5]  Ludwig M. Auer,et al.  Neurobot: a special-purpose robot for neurosurgery , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[6]  Towards Minimally Invasive Coronary Artery Bypass Grafting. Proceedings of the 2nd Utrecht MICABG Workshop. Utrecht, the Netherlands, October 4-5, 1996. , 1997, The Annals of thoracic surgery.

[7]  S. Shankar Sastry,et al.  A laparoscopic telesurgical workstation , 1999, IEEE Trans. Robotics Autom..

[8]  E. C. Poulton,et al.  Tracking skill and manual control , 1974 .

[9]  Tobias Ortmaier,et al.  Autonomy and Haptic Feedback in Minimally Invasive Robotic Surgery , 2001 .

[10]  Tobias Ortmaier,et al.  The DLR Minimally Invasive Robotics Surgery Scenario , 2001 .

[11]  Tobias Ortmaier,et al.  Cartesian control issues for minimally invasive robot surgery , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[12]  Richard S. Sutton,et al.  Neural networks for control , 1990 .

[13]  Gerd Hirzinger,et al.  Automatic tracking of laparoscopic instruments by color coding , 1997, CVRMed.

[14]  Lawrence B. Wolff,et al.  On the relative brightness of specular and diffuse reflection , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Juan Jesús Fernández Lozano,et al.  A medical robotic assistant for minimally invasive surgery , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[16]  S. Sauerland,et al.  Laparoscopic versus open surgery for suspected appendicitis. , 2002, The Cochrane database of systematic reviews.

[17]  Tobias Ortmaier,et al.  Reconstruction of Image Structure in Presence of Specular Reflections , 2001, DAGM-Symposium.

[18]  Raúl Rojas,et al.  Theorie der neuronalen Netze , 1993 .

[19]  F. Takens Detecting strange attractors in turbulence , 1981 .

[20]  G. Hirzinger,et al.  Scaling Issues for Teleoperation , 2000 .

[21]  Ingemar J. Cox,et al.  A Maximum Likelihood Stereo Algorithm , 1996, Comput. Vis. Image Underst..

[22]  Gregory D. Hager,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Christopher R. Wagner,et al.  The role of force feedback in surgery: analysis of blunt dissection , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[24]  Martin Gröger,et al.  Robust Motion Estimation in Robotic Surgery on the Beating Heart , 2002 .

[25]  F. Mohr,et al.  Endoscopic coronary artery bypass grafting on the beating heart using a computer enhanced telemanipulation system. , 1999, The heart surgery forum.

[26]  Ciro Natale,et al.  An automatic procedure for force controller design , 1999, 1999 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (Cat. No.99TH8399).

[27]  David J. Kriegman,et al.  What is the set of images of an object under all possible lighting conditions? , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  H. Kantz,et al.  Nonlinear time series analysis , 1997 .

[29]  V Falk,et al.  Pearls and pitfalls: lessons learned in endoscopic robotic surgery- the da Vinci experience. , 2001, The heart surgery forum.

[30]  B Kiaii,et al.  Closed chest CABG on the beating heart with a computer-enhanced articulating system: case report. , 2001, The heart surgery forum.

[31]  J. Adler,et al.  Robotic motion compensation for respiratory movement during radiosurgery. , 2000, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[32]  C Bolger,et al.  Frameless stereotaxy and anterior cervical surgery. , 1999, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[33]  S. Laurberg,et al.  Randomized clinical trial of laparoscopic versus open appendicectomy , 2001, The British journal of surgery.

[34]  Eva R. Helgeson,et al.  A prospective randomized comparison of laparoscopic appendectomy with open appendectomy: Clinical and economic analyses. , 2001, Surgery.

[35]  Andreas S. Weigend,et al.  Time Series Prediction: Forecasting the Future and Understanding the Past , 1994 .

[36]  John Kenneth Salisbury,et al.  The Intuitive/sup TM/ telesurgery system: overview and application , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[37]  R Caprotti,et al.  Laparoscopic Versus Open Splenectomy: A Comparative Study , 2000, Surgical laparoscopy, endoscopy & percutaneous techniques.

[38]  M Caversaccio,et al.  The "Bernese" frameless optical computer aided surgery system. , 1999, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[39]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[40]  W Zylka,et al.  Effect of localization devices and registration methods on the accuracy of stereotactic frame systems predicted by the Gaussian approach. , 1999, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[41]  Lerner Ej Computer-integrated surgery. , 1997, New Jersey medicine : the journal of the Medical Society of New Jersey.

[42]  Yulun Wang,et al.  Robotic surgery - the transatlantic case , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[43]  Bruno Siciliano,et al.  Modeling and Control of Robot Manipulators , 1995 .

[44]  A. Albu-Schäffer Regelung von Robotern mit elastischen Gelenken am Beispiel der DLR-Leichtbauarme , 2002 .

[45]  Tobias Ortmaier,et al.  Cartesian Control of Robots with Working-Position Dependent Dynamics , 2000 .

[46]  John G. Hunter,et al.  A prospective, randomized comparison of laparoscopic appendectomy with open appendectomy , 1995 .

[47]  Hong Liu,et al.  DLR-Hand II: next generation of a dextrous robot hand , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[48]  Dong-Soo Kwon,et al.  Microsurgical telerobot system , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[49]  Luc Soler,et al.  Towards Semi-autonomy in Laparoscopic Surgery through Vision and Force Feedback Control , 2000, ISER.

[50]  D. Winkler,et al.  Spinal markers: A new method for increasing accuracy in spinal navigation. , 1999, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[51]  Tobias Ortmaier,et al.  Tracking local motion on the beating heart , 2002, SPIE Medical Imaging.

[52]  Wyatt S. Newman,et al.  Experimental evaluation of a robotic image-directed radiation therapy system , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[53]  M. Huang,et al.  Needlescopic, Laparoscopic, and Open Appendectomy: A Comparative Study , 2001, Surgical laparoscopy, endoscopy & percutaneous techniques.

[54]  Hans-Peter Meinzer,et al.  Bildverarbeitung für die Medizin 2001 , 2001 .

[55]  Gerd Hirzinger,et al.  Sensor-based space robotics-ROTEX and its telerobotic features , 1993, IEEE Trans. Robotics Autom..

[56]  Shree K. Nayar,et al.  Separation of Reflection Components Using Color and Polarization , 1997, International Journal of Computer Vision.

[57]  M. Helmy A comparative study between laparoscopic versus open appendicectomy in men. , 2001, Journal of the Egyptian Society of Parasitology.

[58]  Alin Albu-Schäffer,et al.  On a new generation of torque controlled light-weight robots , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[59]  S Mutic,et al.  Stereotactic imaging quality assurance using an anthropomorphic phantom. , 1999, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[60]  S. Shankar Sastry,et al.  Robotics for telesurgery: second generation Berkeley/UCSF laparoscopic telesurgical workstation and looking towards the future applications , 2003, Ind. Robot.