Robust Laparoscopic Instruments Tracking Using Colored Strips

To assist surgeons in the acquisition of the required skills for the proper execution of the laparoscopic procedure, surgical simulators are used. During training with simulators it is useful to provide a surgical performance quantitative evaluation. Recent research works showed that such evaluation can be obtained by tracking the laparoscopic instruments, using only the images provided by the laparoscope and without hindering the surgical scene. In this work the state of the art method is improved so that a robust tracking can run even with the noisy background provided by realistic simulators. The method was validated by comparison with the tracking of a “chess-board” pattern and following tests were performed to check the robustness of the developed algorithm. Despite the noisy environment, the implemented method was found to be able to track the tip of the surgical instrument with a good accuracy compared to the other studies in the literature.

[1]  A G Gallagher,et al.  Surgical simulation—a ‘good idea whose time has come’ , 2003, The British journal of surgery.

[2]  Fabrizio Cutolo,et al.  AR visualization of "synthetic Calot's triangle" for training in cholecystectomy , 2016, BioMed 2016.

[3]  Lejing Wang,et al.  Multi-Modal Intra-Operative Navigation During Distal Locking of Intramedullary Nails , 2015, IEEE Transactions on Medical Imaging.

[4]  Sébastien Ourselin,et al.  Image Based Surgical Instrument Pose Estimation with Multi-class Labelling and Optical Flow , 2015, MICCAI.

[5]  V Ferrari,et al.  How to build patient‐specific synthetic abdominal anatomies. An innovative approach from physical toward hybrid surgical simulators , 2011, The international journal of medical robotics + computer assisted surgery : MRCAS.

[6]  Jenny Dankelman,et al.  Retracting and seeking movements during laparoscopic goal-oriented movements. Is the shortest path length optimal? , 2007, Surgical Endoscopy.

[7]  Fabrizio Cutolo,et al.  Augmented reality visualization of deformable tubular structures for surgical simulation , 2016, The international journal of medical robotics + computer assisted surgery : MRCAS.

[8]  Constantinos Loukas,et al.  An integrated approach to endoscopic instrument tracking for augmented reality applications in surgical simulation training , 2013, The international journal of medical robotics + computer assisted surgery : MRCAS.

[9]  E G Shifrin,et al.  Laparoscopic assisted aortic surgery. A review. , 2006, The Journal of cardiovascular surgery.

[10]  Paolo Dario,et al.  Biomechanics–Machine Learning System for Surgical Gesture Analysis and Development of Technologies for Minimal Access Surgery , 2014, Surgical innovation.

[11]  Vincenzo Ferrari,et al.  Patient-specific surgical simulator for the pre-operative planning of single-incision laparoscopic surgery with bimanual robots , 2012, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[12]  Rosanna Maria Viglialoro,et al.  A physical patient specific simulator for cholecystectomy training , 2012 .

[13]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  R. Kneebone Simulation in surgical training: educational issues and practical implications , 2003, Medical education.

[15]  Evangelos Georgiou,et al.  Surgical Simulation Training Systems: Box Trainers, Virtual Reality and Augmented Reality Simulators , 2016, ICRA 2016.

[16]  C Freschi,et al.  Technical review of the da Vinci surgical telemanipulator , 2013, The international journal of medical robotics + computer assisted surgery : MRCAS.

[17]  Mauro Ferrari,et al.  Patient Specific Surgical Simulator for the Evaluation of the Movability of Bimanual Robotic Arms , 2011, MMVR.

[18]  Rosanna Maria Viglialoro,et al.  Augmented Reality Simulator for Laparoscopic Cholecystectomy Training , 2014, AVR.

[19]  Matteo Bianchi,et al.  Tactile Augmented Reality for Arteries Palpation in Open Surgery Training , 2016, MIAR.

[20]  Antonios Gasteratos,et al.  Light-invariant 3D object's pose estimation using color distance transform , 2010, 2010 IEEE International Conference on Imaging Systems and Techniques.

[21]  Fabrizio Cutolo,et al.  Robust and Accurate Algorithm for Wearable Stereoscopic Augmented Reality with Three Indistinguishable Markers , 2016 .