A Virtual Environment Testbed for Training Laparoscopic Surgical Skills

With the introduction of minimally invasive techniques, surgeons must learn skills and procedures that are radically different from traditional open surgery. Traditional methods of surgical training that were adequate when techniques and instrumentation changed relatively slowly may not be as efficient or effective in training substantially new procedures. Virtual environments are a promising new medium for training. This paper describes a testbed developed at the San Francisco, Berkeley, and Santa Barbara campuses of the University of California for research in understanding, assessing, and training surgical skills. The testbed includes virtual environments for training perceptual motor skills, spatial skills, and critical steps of surgical procedures. Novel technical elements of the testbed include a four-DOF haptic interface, a fast collision detection algorithm for detecting contact between rigid and deformable objects, and parallel processing of physical modeling and rendering. The major technical challenge in surgical simulation to be investigated using the testbed is the development of accurate, real-time methods for modeling deformable tissue behavior. Several simulations have been implemented in the testbed, including environments for assessing performance of basic perceptual motor skills, training the use of an angled laparoscope, and teaching critical steps of the cholecystectomy, a common laparoscopic procedure. The major challenges of extending and integrating these tools for training are discussed.

[1]  Sarah F. Frisken 3D Chainmail: A Fast Algorithm for Deforming Volumetric Objects , 1997, SI3D.

[2]  Laurie A. Broedling,et al.  Taxonomies of Human Performance: The Description of Human Tasks , 1984 .

[3]  M. Hegarty,et al.  Individual differences in mental animation during mechanical reasoning , 1994, Memory & cognition.

[4]  A Uchiyama,et al.  Simulator for virtual surgery using deformable organ models and force feedback system. , 1998, Studies in health technology and informatics.

[5]  F Tendick,et al.  Comparison of laparoscopic imaging systems and conditions using a knot-tying task. , 1997, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[6]  E J Graves,et al.  Detailed diagnoses and procedures, National Hospital Discharge Survey, 1993. , 1995, Vital and health statistics. Series 13, Data from the National Health Survey.

[7]  A K Morimoto,et al.  Force sensor for laparoscopic Babcock. , 1997, Studies in health technology and informatics.

[8]  Louis B. Rosenberg,et al.  A virtual simulation environment for learning epidural anesthesia. , 1996, Studies in health technology and informatics.

[9]  Ole Vilhelm Larsen,et al.  Using Region-of-Interest Based Finite Element Modeling for Brain-Surgery Simulation , 1998, MICCAI.

[10]  Kenneth D. Forbus,et al.  Qualitative Spatial Reasoning: The Clock Project , 1991, Artif. Intell..

[11]  M. Srinivasan,et al.  Simulation of tissue cutting and bleeding for laparoscopic surgery using auxiliary surfaces. , 1999, Studies in health technology and informatics.

[12]  M A Srinivasan,et al.  Thin walled models for haptic and graphical rendering of soft tissues in surgical simulations. , 1999, Studies in health technology and informatics.

[13]  A Darzi,et al.  Early experience and validation work with Procedicus VA--the Prosolvia virtual reality shoulder arthroscopy trainer. , 1999, Studies in health technology and informatics.

[14]  John F. Canny,et al.  Collision Detection for Moving Polyhedra , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  G Fischer,et al.  Virtual reality arthroscopy training simulator. , 1995, Computers in biology and medicine.

[16]  Koji Ikuta,et al.  Virtual Endoscope System with Force Sensation , 1998, MICCAI.

[17]  S. Lehman The Neural and Behavioural Organization of Goal‐Directed Movements , 1990, Neurology.

[18]  Gerald A. Higgins,et al.  New Simulation Technologies for Surgical Training and Certification: Current Status and Future Projections , 1997, Presence: Teleoperators & Virtual Environments.

[19]  M. Bro-Nielsen,et al.  Finite element modeling in surgery simulation , 1998, Proc. IEEE.

[20]  James A. Sethian,et al.  A unified approach to noise removal, image enhancement, and shape recovery , 1996, IEEE Trans. Image Process..

[21]  T. T. Blackmon,et al.  Human hand trajectory analysis in point-and-direct telerobotics , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[22]  B. Neisius,et al.  The Karlsruhe Endoscopic Surgery Trainer as an example for virtual reality in medical education , 1997 .

[23]  W. See,et al.  Predictors of laparoscopic complications after formal training in laparoscopic surgery. , 1993, JAMA.

[24]  Yoshifumi Kitamura,et al.  A Real-Time Algorithm for Accurate Collision Detection for Deformable Polyhedral Objects , 1998, Presence.

[25]  Richard A. Robb,et al.  Simulation of spinal nerve blocks for training anesthesiology residents , 1998, Photonics West - Biomedical Optics.

[26]  J. Rosser,et al.  Objective evaluation of a laparoscopic surgical skill program for residents and senior surgeons. , 1998, Archives of surgery.

[27]  Graves Ej,et al.  Detailed diagnoses and procedures, National Hospital Discharge Survey, 1994. , 1997, Vital and health statistics. Series 13, Data from the National Health Survey.

[28]  A. Darzi,et al.  Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MIST VR laparoscopic simulator. , 1998, Studies in health technology and informatics.

[29]  B. Hannaford,et al.  Computerized endoscopic surgical grasper. , 1998, Studies in health technology and informatics.

[30]  G Székely,et al.  Virtual reality based surgery simulation for endoscopic gynaecology. , 1999, Studies in health technology and informatics.

[31]  P. Cotton,et al.  Use of computer graphics simulation for teaching of flexible sigmoidoscopy. , 1991, Endoscopy.

[32]  Norberto F. Ezquerra,et al.  Interactively deformable models for surgery simulation , 1993, IEEE Computer Graphics and Applications.

[33]  John C. Platt,et al.  Constraints methods for flexible models , 1988, SIGGRAPH.

[34]  Dinesh Manocha,et al.  I-COLLIDE: an interactive and exact collision detection system for large-scale environments , 1995, I3D '95.

[35]  Dimitris N. Metaxas Physics-Based Deformable Models: Applications to Computer Vision, Graphics, and Medical Imaging , 1996 .

[36]  Johan de Kleer,et al.  A Qualitative Physics Based on Confluences , 1984, Artif. Intell..

[37]  R B Loftin,et al.  Assessing a virtual reality surgical skills simulator. , 1996, Studies in health technology and informatics.

[38]  Sarah F. Frisken Beyond volume rendering: visualization, haptic exploration, and physical modeling of voxel-based objects , 1995, Visualization in Scientific Computing.

[39]  Jocelyne Troccaz,et al.  Ultrasound Imaging Simulation: Application to the Diagnosis of Deep Venous Thromboses of Lower Limbs , 1998, MICCAI.

[40]  S Weghorst,et al.  Fast finite element modeling for surgical simulation. , 1999, Studies in health technology and informatics.

[41]  M J Sinclair,et al.  Applied virtual reality for simulation of endoscopic retrograde cholangio-pancreatography (ERCP). , 1996, Studies in health technology and informatics.

[42]  J. Peifer,et al.  Applied virtual reality for simulation of endoscopic retrograde cholangio-pancreatography (ERCP). , 1996, Studies in health technology and informatics.

[43]  L. Way,et al.  Fundamentals of laparoscopic surgery , 1995 .

[44]  Patrick Dubois,et al.  Training simulator for retinal laser photocoagulation: a new approach for surgeons' apprenticeships , 1998, Photonics West - Biomedical Optics.

[45]  R. V. O'Toole,et al.  Assessing Skill and Learning in Surgeons and Medical Students Using a Force Feedback Surgical Simulator , 1998, MICCAI.

[46]  Shahram Payandeh,et al.  Task and Motion Analyses in Endoscopic Surgery , 1996, Dynamic Systems and Control.

[47]  Christian Laugier,et al.  Parameter identification for dynamic simulation , 1997, Proceedings of International Conference on Robotics and Automation.

[48]  Arie E. Kaufman,et al.  Collision detection for volumetric objects , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[49]  J. E. Barone,et al.  Correction: A prospective analysis of 1518 laparoscopic cholecystectomies. , 1991, The New England journal of medicine.

[50]  D Stredney,et al.  A comparative analysis of integrating visual representations with haptic displays. , 1998, Studies in health technology and informatics.

[51]  Peter J. Hunter,et al.  A virtual environment and model of the eye for surgical simulation , 1994, SIGGRAPH.

[52]  John Patrick,et al.  Training: Research and practice. , 1992 .

[53]  Frank Tendick,et al.  Development of virtual environments for training skills and reducing errors in laparoscopic surgery , 1998, Photonics West - Biomedical Optics.

[54]  C. Chui,et al.  Real-time interactive simulator for percutaneous coronary revascularization procedures. , 1998, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[55]  Lawrence W. Stark,et al.  Sensing and Manipulation Problems in Endoscopic Surgery: Experiment, Analysis, and Observation , 1993, Presence: Teleoperators & Virtual Environments.

[56]  S Weghorst,et al.  Validation of the Madigan ESS simulator. , 1998, Studies in health technology and informatics.

[57]  A. L. Schueneman,et al.  Neuropsychologic predictors of operative skill among general surgery residents. , 1984, Surgery.

[58]  Frank Tendick,et al.  Error analysis in laparoscopic surgery , 1998, Photonics West - Biomedical Optics.

[59]  M Hegarty,et al.  Mental animation in the visuospatial sketchpad: Evidence from dual-task studies , 1997, Memory & cognition.

[60]  M. Tuggy,et al.  Virtual Reality Flexible Sigmoidoscopy Simulator Training: Impact on Resident Performance , 1998, The Journal of the American Board of Family Medicine.

[61]  Keith K. Green,et al.  Computer-simulated eye surgery. A novel teaching method for residents and practitioners. , 1995, Ophthalmology.

[62]  A McCarthy,et al.  Virtual arthroscopy training: do the "virtual skills" developed match the real skills required? , 1999, Studies in health technology and informatics.

[63]  Lewis L. Sadler,et al.  Virtual Reality Vitrectomy Simulator , 1998, MICCAI.

[64]  Frank Tendick,et al.  Human-machine interfaces for minimally invasive surgery , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[65]  T. Asano,et al.  Basic technology of simulation system for laparoscopic surgery in virtual environment with force display. , 1997, Studies in health technology and informatics.

[66]  W. Grundfest Credentialing in an era of change. , 1993, JAMA.

[67]  J L Tasto,et al.  PreOp endoscopic simulator: a PC-based immersive training system for bronchoscopy. , 1999, Studies in health technology and informatics.

[68]  G. Fried,et al.  Development of a model for training and evaluation of laparoscopic skills. , 1998, American journal of surgery.

[69]  Patrick Dubois,et al.  Residents' training to retinal photocoagulation: virtual reality compared to conventional apprenticeship , 1998, Photonics West - Biomedical Optics.

[70]  F. Tendick MAXIMIZING THE SENSATION OF COMPLIANCE IN TELEOPERATIVE SURGERY , 1999 .

[71]  Craig R. Carignan,et al.  Simulator/planner for CT-directed needle biopsy of the spine , 1998, Photonics West - Biomedical Optics.

[72]  Louis B. Rosenberg,et al.  A volumetric approach to virtual simulation of functional endoscopic sinus surgery. , 1997, Studies in health technology and informatics.

[73]  Shinsuke Shimojo,et al.  Visual surface representation: a critical link between lower-level and higher level vision , 1995 .

[74]  R. Gibbons,et al.  Field articulation testing: a predictor of technical skills in surgical residents. , 1986, The Journal of surgical research.

[75]  H Delingette,et al.  Geometric and physical representations for a simulator of hepatic surgery. , 1996, Studies in health technology and informatics.

[76]  R. Steele,et al.  Psychomotor testing and the ability to perform an anastomosis in junior surgical trainees , 1992, The British journal of surgery.

[77]  Frank Tendick,et al.  Multirate simulation for high fidelity haptic interaction with deformable objects in virtual environments , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[78]  F Tendick,et al.  Virtual environments for training critical skills in laparoscopic surgery. , 1998, Studies in health technology and informatics.

[79]  R. Reznick,et al.  Reliability and construct validity of a structured technical skills assessment form. , 1994, American journal of surgery.

[80]  Gerald A. Higgins,et al.  Teleos™: Development of a Software Toolkit for Authoring Virtual Medical Environments , 1997, Presence: Teleoperators & Virtual Environments.

[81]  Ming C. Lin,et al.  Efficient collision detection for animation and robotics , 1993 .

[82]  E. Mühe,et al.  296. Die erste Cholecystektomie durch das Laparoskop , 1986, Langenbecks Archiv für Chirurgie.

[83]  W. Eric L. Grimson,et al.  Simulating arthroscopic knee surgery using volumetric object representations, real-time volume rendering and haptic feedback , 1997, CVRMed.

[84]  A. Cuschieri,et al.  Computer-controlled endoscopic performance assessment system , 1998, Surgical Endoscopy.

[85]  Alex Pentland,et al.  Shape analysis of brain structures using physical and experimental modes , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[86]  R. Gibbons,et al.  A study of the relationship between flexibility of closure and surgical skill. , 1983, Journal of the American Podiatry Association.