Context specific descriptors for tracking deforming tissue

In minimally invasive surgery, deployment of motion compensation, dynamic active constraints and adaptive intra-operative guidance require accurate estimation of deforming tissue in 3D. To this end, the use of vision-based techniques is advantageous in that it does not require the integration of additional hardware to the existing surgical settings. Deformation can be recovered by tracking features on the surface of the tissue. Existing methods are mostly based on ad hoc machine vision techniques that have generally been developed for rigid scenes or use pre-determined models with parameters fine tuned to specific surgical settings. In this work, we propose a novel tracking technique based on a context specific feature descriptor. The descriptor can adapt to its surroundings and identify the most discriminate information for tracking. The feature descriptor is represented as a decision tree and the tracking process is formulated as a classification problem for which log likelihood ratios are used to improve classifier training. A recursive tracking algorithm obtains examples of tissue deformation used to train the classifier. Additional training data is generated by geometric and appearance modelling. Experimental results have shown that the proposed context specific descriptor is robust to drift, occlusion, and changes in orientation and scale. The performance of the algorithm is compared with existing tracking algorithms and validated with both simulated and in vivo datasets.

[1]  Gregory D. Hager,et al.  Stereo-Based Endoscopic Tracking of Cardiac Surface Deformation , 2004, MICCAI.

[2]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[3]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[4]  Philippe C. Cattin,et al.  Markerless Endoscopic Registration and Referencing , 2006, MICCAI.

[5]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[6]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[8]  Ève Coste-Manière,et al.  Towards endoscopic augmented reality for robotically assisted minimally invasive cardiac surgery , 2001, Proceedings International Workshop on Medical Imaging and Augmented Reality.

[9]  Chao Liu,et al.  Deformable motion tracking of the heart surface , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Daniel Rueckert,et al.  Medical Image Computing and Computer-Assisted Intervention − MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part II , 2017, Lecture Notes in Computer Science.

[11]  G. Tsavellas,et al.  Current attitudes and practices towards diathermy smoke. , 2007, Annals of the Royal College of Surgeons of England.

[12]  Tobias Ortmaier,et al.  Tracking local motion on the beating heart , 2002, SPIE Medical Imaging.

[13]  Philippe Zanne,et al.  In vivo comparison of real-time tracking algorithms for interventional flexible endoscopy , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[14]  Yali Amit,et al.  Shape Quantization and Recognition with Randomized Trees , 1997, Neural Computation.

[15]  Guang-Zhong Yang,et al.  Dense 3D Depth Recovery for Soft Tissue Deformation During Robotically Assisted Laparoscopic Surgery , 2004, MICCAI.

[16]  R. Collins,et al.  On-line selection of discriminative tracking features , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  Yanxi Liu,et al.  Online Selection of Discriminative Tracking Features , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Luc Soler,et al.  Beating heart tracking in robotic surgery using 500 Hz visual servoing, model predictive control and an adaptive observer , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[20]  J. Triboulet,et al.  Efficient Tracking of the Heart Using Texture , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  Guang-Zhong Yang,et al.  Gaze-Contingent Soft Tissue Deformation Tracking for Minimally Invasive Robotic Surgery , 2005, MICCAI.

[22]  Takayuki Okatani,et al.  3D Shape Reconstruction from an Endoscope Image Based on Shading , 1997 .

[23]  Guang-Zhong Yang,et al.  Soft tissue tracking for minimally invasive surgery: learning local deformation online. , 2008, Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention.

[24]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Tobias Ortmaier,et al.  Motion estimation in beating heart surgery , 2005, IEEE Transactions on Biomedical Engineering.

[26]  Kurt Höller,et al.  Taking endoscopy to a higher dimension : Computer Aided 3-D NOTES , 2008 .

[27]  Philippe Poignet,et al.  Robust 3D Visual Tracking for Robotic-Assisted Cardiac Interventions , 2010, MICCAI.

[28]  Guang-Zhong Yang,et al.  A Probabilistic Framework for Tracking Deformable Soft Tissue in Minimally Invasive Surgery , 2007, MICCAI.

[29]  Yuan-Fang Wang,et al.  Toward automated model building from video in computer-assisted diagnoses in colonoscopy , 2007, SPIE Medical Imaging.

[30]  A. Gallagher,et al.  Experienced laparoscopic surgeons are automated to the "fulcrum effect": an ergonomic demonstration. , 1999, Endoscopy.

[31]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[32]  Vincent Lepetit,et al.  Randomized trees for real-time keypoint recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[33]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, CVPR 2004.

[34]  Ramesh Raskar,et al.  Augmented Reality Visualization for Laparoscopic Surgery , 1998, MICCAI.

[35]  Philippe Poignet,et al.  3D Heart Motion Estimation Using Endoscopic Monocular Vision System , 2006 .

[36]  Jacques Gangloff,et al.  Physiological motion rejection in flexible endoscopy using visual servoing , 2008, ICRA.

[37]  Per-Erik Forssén,et al.  Maximally Stable Colour Regions for Recognition and Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  J. Triboulet,et al.  Texture Features Selection for Visual Servoing of the Beating Heart , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[39]  Guang-Zhong Yang,et al.  Soft-Tissue Motion Tracking and Structure Estimation for Robotic Assisted MIS Procedures , 2005, MICCAI.

[40]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[41]  Pierre Graebling,et al.  Robust Structured Light Coding for 3D Reconstruction , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[42]  Carlos Henrique Quartucci Forster,et al.  Towards 3D reconstruction of endoscope images using shape from shading , 2000, Proceedings 13th Brazilian Symposium on Computer Graphics and Image Processing (Cat. No.PR00878).