VR Training System for Endoscopic Surgery Robot - Development of a System Enabling 4D Analysis of Surgical Technique Training

Our research group is currently developing an endoscopic surgical robot for digestive organs. In the current study, we sought to train surgeons to manipulate the system we are developing for clinical applications. To this end, we are developing a training system with the same interface as the real system, so that surgeons in training can practice basic manipulations and surgical techniques using organ models. To learn the basic manipulations of the system, we emphasized training the surgeon to operate the robotic arms, as this is the biggest difference from the conventional surgical techniques. We set up several types of tasks for the trainee, so that a beginner trainee could get used to operating the robot arms of the system. We developed a surgical training method using a stomach model reconstructed from MRI data sets. In addition to basic surgical techniques such as grabbing, lifting and cutting open soft tissue with the robot arm, we enabled the training system to perform techniques necessary for the surgical system, such as delivering water to the surgical field in case of bleeding, and clipping of incision sites. We added a function to record the performance of the trainee, enabling the system to analyze changes of the surgical field and robot arms in four dimensions during training.

[1]  Naoki Suzuki,et al.  Sphere-filled organ model for virtual surgery system , 2004, IEEE Transactions on Medical Imaging.

[2]  Jihad H Kaouk,et al.  Robotic-assisted laparoendoscopic single-site surgery in gynecology: initial report and technique. , 2009, Journal of minimally invasive gynecology.

[3]  Naoki Suzuki,et al.  Development of a surgical robot system for endovascular surgery with augmented reality function , 2007, MMVR.

[4]  William J. Peine,et al.  Design of an endoluminal NOTES robotic system , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Naoki Suzuki,et al.  Surgery Simulation System with Haptic Sensation and Modeling of Elastic Organ That Re.ect the Patients' Anatomy , 2003, IS4TH.

[6]  G Piskun,et al.  Transumbilical laparoscopic cholecystectomy utilizes no incisions outside the umbilicus. , 1999, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[7]  J. Kenneth Salisbury,et al.  The Heart of Microsurgery , 1998 .

[8]  Nathan A. Wood,et al.  Natural Orifice Translumenal Endoscopic Surgery with a miniature in vivo surgical robot , 2009, Surgical Endoscopy.

[9]  Hervé Delingette,et al.  Surgery Simulation and Soft Tissue Modeling , 2003, Lecture Notes in Computer Science.

[10]  Naoki Suzuki,et al.  Development of an endoscopic robotic system with two hands for various gastric tube surgeries. , 2003, Studies in health technology and informatics.

[11]  Naoki Suzuki,et al.  Navigation system for a developed endoscopic surgical robot system , 2004, CARS.

[12]  A. Kubota,et al.  Laparoscopic ovarian cystectomy using a single umbilical puncture method. , 2001, Surgical laparoscopy, endoscopy & percutaneous techniques.

[13]  Mark A. Ganter,et al.  Real-time finite element modeling for surgery simulation: an application to virtual suturing , 2004, IEEE Transactions on Visualization and Computer Graphics.

[14]  A Kashfi,et al.  Robot‐assisted abdominal surgery , 2004, The British journal of surgery.

[15]  John Kenneth Salisbury,et al.  The Intuitive/sup TM/ telesurgery system: overview and application , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[16]  Jihad H Kaouk,et al.  Technological Advances in Robotic-Assisted Laparoscopic Surgery , 2022 .

[17]  Naoki Suzuki,et al.  Scorpion Shaped Endoscopic Surgical Robot for NOTES and SPS With Augmented Reality Functions , 2010, MIAR.

[18]  Herve Delingette,et al.  Real-Time Elastic Deformations of Soft Tissues for Surgery Simulation , 1999, IEEE Trans. Vis. Comput. Graph..

[19]  Naoki Suzuki,et al.  Development of a navigation function for an endosocopic robot surgery system. , 2005, Studies in health technology and informatics.

[20]  G. Ballantyne Robotic surgery, telerobotic surgery, telepresence, and telementoring , 2002, Surgical Endoscopy And Other Interventional Techniques.

[21]  Hongen Liao,et al.  Medical Imaging and Augmented Reality , 2004 .

[22]  Eliana Della Flora,et al.  A Review of Natural Orifice Translumenal Endoscopic Surgery (NOTES) for Intra-abdominal Surgery: Experimental Models, Techniques, and Applicability to the Clinical Setting , 2008, Annals of surgery.

[23]  M. Mack,et al.  Use of the voice-controlled and computer-assisted surgical system ZEUS for endoscopic coronary artery bypass grafting. , 1999, The Journal of thoracic and cardiovascular surgery.

[24]  Georges-Pascal Haber,et al.  Transumbilical single-port surgery: evolution and current status. , 2008, European urology.

[25]  Peter K. Allen,et al.  Design, simulation and evaluation of kinematic alternatives for Insertable Robotic Effectors Platforms in Single Port Access Surgery , 2010, 2010 IEEE International Conference on Robotics and Automation.

[26]  Russell H. Taylor,et al.  Medical robotics in computer-integrated surgery , 2003, IEEE Trans. Robotics Autom..

[27]  Christian Laugier,et al.  Tissue Cutting Using Finite Elements and Force Feedback , 2003, IS4TH.

[28]  Jason Dumpert,et al.  Natural orifice surgery with an endoluminal mobile robot , 2007, Surgical Endoscopy.

[29]  M. Menon,et al.  da Vinci-assisted robotic partial nephrectomy: technique and results at a mean of 15 months of follow-up. , 2007, European urology.

[30]  Russell H. Taylor,et al.  Applications of robotics for laryngeal surgery. , 2008, Otolaryngologic clinics of North America.

[31]  M. Talamini,et al.  Robotic abdominal surgery. , 2004, American journal of surgery.

[32]  F. Pirozzi,et al.  Advantages and limits of robot-assisted laparoscopic surgery: preliminary experience , 2004, Surgical Endoscopy And Other Interventional Techniques.

[33]  Paul Suetens,et al.  Tetrahedral Mass Spring Model for Fast Soft Tissue Deformation , 2003, IS4TH.

[34]  N. A. Wood,et al.  Natural orifice cholecystectomy using a miniature robot , 2009, Surgical Endoscopy.

[35]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[36]  J. Bodner,et al.  First experiences with the da Vinci operating robot in thoracic surgery. , 2004, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.