Context-specific selection of algorithms for recursive feature tracking in endoscopic image using a new methodology

In minimally invasive surgery, the tracking of deformable tissue is a critical component for image-guided applications. Deformation of the tissue can be recovered by tracking features using tissue surface information (texture, color,...). Recent work in this field has shown success in acquiring tissue motion. However, the performance evaluation of detection and tracking algorithms on such images are still difficult and are not standardized. This is mainly due to the lack of ground truth data on real data. Moreover, in order to avoid supplementary techniques to remove outliers, no quantitative work has been undertaken to evaluate the benefit of a pre-process based on image filtering, which can improve feature tracking robustness. In this paper, we propose a methodology to validate detection and feature tracking algorithms, using a trick based on forward-backward tracking that provides an artificial ground truth data. We describe a clear and complete methodology to evaluate and compare different detection and tracking algorithms. In addition, we extend our framework to propose a strategy to identify the best combinations from a set of detector, tracker and pre-process algorithms, according to the live intra-operative data. Experimental results have been performed on in vivo datasets and show that pre-process can have a strong influence on tracking performance and that our strategy to find the best combinations is relevant for a reasonable computation cost.

[1]  Michael Figl,et al.  Reconstruction of a 3D surface from video that is robust to missing data and outliers: Application to minimally invasive surgery using stereo and mono endoscopes , 2012, Medical Image Anal..

[2]  Guang-Zhong Yang,et al.  Soft-Tissue Motion Tracking and Structure Estimation for Robotic Assisted MIS Procedures , 2005, MICCAI.

[3]  Gian Luca Mariottini,et al.  Hierarchical Multi-Affine (HMA) algorithm for fast and accurate feature matching in minimally-invasive surgical images , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Yung-Nien Sun,et al.  Automatic extraction and visualization of human inner structures from endoscopic image sequences , 2004, SPIE Medical Imaging.

[5]  Xiangzhi Bai,et al.  Toggle and top-hat based morphological contrast operators , 2012, Comput. Electr. Eng..

[6]  Allan Hanbury The morphological top-hat operator generalised to multi-channel images , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[7]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[8]  Jiri Matas,et al.  Forward-Backward Error: Automatic Detection of Tracking Failures , 2010, 2010 20th International Conference on Pattern Recognition.

[9]  M. de Mathelin,et al.  Comparison of visual tracking algorithms on in vivo sequences for robot-assisted flexible endoscopic surgery , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Guang-Zhong Yang,et al.  Probabilistic Tracking of Affine-Invariant Anisotropic Regions , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  J. Marescaux,et al.  Performance evaluation of simultaneous RGB analysis for feature detection and tracking in endoscopic images , 2015 .

[12]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[13]  Aleksandra Popovic,et al.  Robust feature tracking on the beating heart for a robotic‐guided endoscope , 2011, The international journal of medical robotics + computer assisted surgery : MRCAS.

[14]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[16]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[17]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[18]  Makoto Hashizume,et al.  Augmented reality navigation system for laparoscopic splenectomy in children based on preoperative CT image using optical tracking device , 2012, Pediatric Surgery International.

[19]  Guang-Zhong Yang,et al.  Enhanced visualisation for minimally invasive surgery , 2012, International Journal of Computer Assisted Radiology and Surgery.

[20]  Tobias Senst,et al.  Robust Local Optical Flow for Feature Tracking , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Guang-Zhong Yang,et al.  Dense 3D Depth Recovery for Soft Tissue Deformation During Robotically Assisted Laparoscopic Surgery , 2004, MICCAI.

[22]  Michael C. Yip,et al.  Tissue Tracking and Registration for Image-Guided Surgery , 2012, IEEE Transactions on Medical Imaging.

[23]  Guang-Zhong Yang,et al.  Three-Dimensional Tissue Deformation Recovery and Tracking , 2010, IEEE Signal Processing Magazine.

[24]  Luc Soler,et al.  Evaluation of Endoscopic Image Enhancement for Feature Tracking: A New Validation Framework , 2013, AE-CAI.

[25]  Guang-Zhong Yang,et al.  Dense Surface Reconstruction for Enhanced Navigation in MIS , 2011, MICCAI.

[26]  Guang-Zhong Yang,et al.  Context specific descriptors for tracking deforming tissue , 2012, Medical Image Anal..

[27]  J. Marescaux,et al.  Augmented reality in laparoscopic surgical oncology. , 2011, Surgical oncology.

[28]  Philippe Poignet,et al.  Robust 3D Visual Tracking for Robotic-Assisted Cardiac Interventions , 2010, MICCAI.

[29]  Adrien Bartoli,et al.  On template-based reconstruction from a single view: Analytical solutions and proofs of well-posedness for developable, isometric and conformal surfaces , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  W. Brent Seales,et al.  Endoscopic Video Texture Mapping on Pre-Built 3-D Anatomical Objects Without Camera Tracking , 2010, IEEE Transactions on Medical Imaging.

[31]  Luc Soler,et al.  Fast 3D Structure From Motion with Missing Points from Registration of Partial Reconstructions , 2012, AMDO.

[32]  A. Bartoli,et al.  Computer assisted minimally invasive surgery: is medical computer vision the answer to improving laparosurgery? , 2012, Medical hypotheses.

[33]  Sejung Yang,et al.  A Novel 3-D Color Histogram Equalization Method With Uniform 1-D Gray Scale Histogram , 2011, IEEE Transactions on Image Processing.

[34]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.