Neuro-endo-activity-tracker: An automatic activity detection application for Neuro-Endo-Trainer: Neuro-Endo-activity-tracker

Neuro-endoscopy is a highly demanding surgical specialty and requires dedicated training systems for imparting the skills. The assessment of surgical skills to identify the level of expertise of technical and cognitive skills, has primarily been performed subjectively by an expert. The development of objective motion analyses and automated skills evaluation can be a significant and suitable alternative. The video-based automatic segmentation can divide the primary activity into sub-tasks and then evaluate them by statistical analysis of motion. In this work, we developed an automated video-based surgical evaluation application. It identifies the basic eye-hand coordination and dexterity of a trainee, while performing a grasping and pick-place task on Neuro-Endo-Trainer. The activity was divided into sub-tasks using Mixture of Gaussian based background subtraction and Tracking Learning Detection algorithms. The kinematic analysis of the tool-tip trajectory was used to provide the synopsis of activity as feedback to the trainee for self-improvement.

[1]  Florent Nageotte,et al.  Detection of grey regions in color images : application to the segmentation of a surgical instrument in robotized laparoscopy , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[2]  J Dankelman,et al.  Fundamental aspects of learning minimally invasive surgical skills , 2005, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[3]  G. Hirzinger,et al.  Real-time visual servoing for laparoscopic surgery. Controlling robot motion with color image segmentation , 1997, IEEE Engineering in Medicine and Biology Magazine.

[4]  V. Pazos,et al.  The Development of a Virtual Simulator for Training Neurosurgeons to Perform and Perfect Endoscopic Endonasal Transsphenoidal Surgery. , 2013, Neurosurgery.

[5]  Blake Hannaford,et al.  Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgical skills , 2001, IEEE Transactions on Biomedical Engineering.

[6]  Ronald C Merrell,et al.  Training in laparoscopic suturing skills using a new computer-based virtual reality simulator (MIST-VR) provides results comparable to those with an established pelvic trainer system. , 2002, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[7]  J. Aucar,et al.  A Review of Surgical Simulation With Attention to Validation Methodology , 2005, Surgical laparoscopy, endoscopy & percutaneous techniques.

[8]  Hideo Hamada,et al.  Preparation of a simple and efficient laboratory model for training in neuroendoscopic procedures , 2008, Child's Nervous System.

[9]  Jenny Dankelman,et al.  TrEndo, a device for tracking minimally invasive surgical instruments in training setups , 2006 .

[10]  Olivier Comas,et al.  The development of a virtual simulator for training neurosurgeons to perform and perfect endoscopic endonasal transsphenoidal surgery. , 2013, Neurosurgery.

[11]  M. Bridges,et al.  The financial impact of teaching surgical residents in the operating room. , 1999, American journal of surgery.

[12]  Rajnikant V. Patel,et al.  The application of force sensing to skills assessment in Minimally Invasive Surgery , 2013, 2013 IEEE International Conference on Robotics and Automation.

[13]  Luc Soler,et al.  Automatic 3-D Positioning of Surgical Instruments during Robotized Laparoscopic Surgery Using Automatic Visual Feedback , 2002, MICCAI.

[14]  Leonid Zhukov,et al.  Measurements of the level of surgical expertise using flight path analysis from da Vinci robotic surgical system. , 2003, Studies in health technology and informatics.

[15]  Juli Yamashita,et al.  The chicken egg and skull model of endoscopic endonasal transsphenoidal surgery improves trainee drilling skills , 2014, Acta Neurochirurgica.

[16]  S. Sessa,et al.  Objective skill analysis and assessment in neurosurgery by using an ultra-miniaturized inertial measurement unit WB-3 — Pilot tests — , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Teodor P Grantcharov,et al.  Assessment of technical surgical skills. , 2002, The European journal of surgery = Acta chirurgica.

[18]  A. Scherpbier,et al.  Validation and implementation of surgical simulators: a critical review of present, past, and future , 2009, Surgical Endoscopy.

[19]  Paolo Dario,et al.  Tracking endoscopic instruments without a localizer: A shape-analysis-based approach , 2007, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[20]  S Wolfsberger,et al.  Virtual endoscopy is a useful device for training and preoperative planning of transsphenoidal endoscopic pituitary surgery. , 2004, Minimally invasive neurosurgery : MIN.

[21]  T. Ind,et al.  Objective assessment of technical surgical skill , 2005 .

[22]  A. Darzi,et al.  Objective assessment of technical skills in surgery , 2003, BMJ : British Medical Journal.

[23]  J. Dankelman,et al.  Validation of a new basic virtual reality simulator for training of basic endoscopic skills , 2006, Surgical Endoscopy And Other Interventional Techniques.

[24]  D M Prevedello,et al.  Animal model for endoscopic neurosurgical training: technical note. , 2010, Minimally invasive neurosurgery : MIN.

[25]  R. Satava,et al.  Virtual Reality Simulation for the Operating Room: Proficiency-Based Training as a Paradigm Shift in Surgical Skills Training , 2005, Annals of surgery.

[26]  Sébastien Ourselin,et al.  2D-3D Pose Tracking of Rigid Instruments in Minimally Invasive Surgery , 2014, IPCAI.

[27]  Petros Faloutsos,et al.  Immersive training and mentoring for laparoscopic surgery , 2007, SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[28]  A. Darzi,et al.  Assessing operative skill , 1999, BMJ.

[29]  V. Krovi,et al.  Robotic Minimally Invasive Surgical skill assessment based on automated video-analysis motion studies , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[30]  Christian Callegari,et al.  Advances in Computing, Communications and Informatics (ICACCI) , 2015 .

[31]  R. Abbott,et al.  History of neuroendoscopy. , 2004, Neurosurgery clinics of North America.

[32]  Henry C. Lin,et al.  Towards automatic skill evaluation: Detection and segmentation of robot-assisted surgical motions , 2006, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[33]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Sneh Anand,et al.  Design and Validation of an Open-Source, Partial Task Trainer for Endonasal Neuro-Endoscopic Skills Development: Indian Experience. , 2016, World neurosurgery.

[35]  Makoto Hashizume,et al.  Skills assessment using a virtual reality simulator, LapSim™, after training to develop fundamental skills for endoscopic surgery , 2010, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[36]  Gregory D. Hager,et al.  Towards automatic skill evaluation: detection and segmentation of robot-assisted surgical motions. , 2006 .

[37]  Naoki Kagawa,et al.  Training to acquire psychomotor skills for endoscopic endonasal surgery using a personal webcam trainer. , 2013, Journal of neurosurgery.

[38]  R. Reznick,et al.  Objective structured assessment of technical skill (OSATS) for surgical residents , 1997, The British journal of surgery.

[39]  Qiang Zhang,et al.  Video-based analysis of motion skills in simulation-based surgical training , 2013, Electronic Imaging.

[40]  Ramandeep Singh,et al.  A novel electro-mechanical neuro-endoscopic box trainer , 2015, 2015 International Conference on Industrial Instrumentation and Control (ICIC).

[41]  Masaaki Mochimaru,et al.  Surgical Skill Evaluation by Force Data for Endoscopic Sinus Surgery Training System , 2002, MICCAI.

[42]  Yuan-Fang Wang,et al.  Image analysis for automated tracking in robot-assisted endoscopic surgery , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[43]  Fumihito Arai,et al.  2-D optical encoding of catheter motion and cyber-physical system for technical skills measurement and quantitative evaluation in endovascular surgery , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  Venkat Krovi,et al.  Vision based Decision-Support and Safety Systems for Robotic Surgery , 2013 .

[45]  A Cuschieri,et al.  Assessment of innate ability and skills for endoscopic manipulations by the Advanced Dundee Endoscopic Psychomotor Tester: predictive and concurrent validity. , 1999, American journal of surgery.

[46]  Robert Anthony Watson.  Quantification of Surgical Technique Using an Inertial Measurement Unit , 2013, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[47]  Rajesh Aggarwal,et al.  Synchronized video and motion analysis for the assessment of procedures in the operating theater. , 2005, Archives of surgery.