A stable optic-flow based method for tracking colonoscopy images

In this paper, we focus on the robustness and stability of our algorithm to plot the position of an endoscopic camera (during a colonoscopy procedure) on the corresponding pre-operative CT scan of the patient. The colon has few topological landmarks, in contrast to bronchoscopy images, where a number of registration algorithms have taken advantage of features such as anatomical marks or bifurcations. Our method estimates the camera motion from the optic-flow computed from the information contained in the video stream. Optic-flow computation is notoriously susceptible to errors in estimating the motion field. Our method relies on the following features to counter this, (1) we use a small but reliable set of feature points (sparse optic-flow field) to determine the spatio-temporal scale at which to perform optic-flow computation in each frame of the sequence, (2) the chosen scales are used to compute a more accurate dense optic flow field, which is used to compute qualitative parameters relating to the main motion direction, and (3) the sparse optic-flow field and the main motion parameters are then combined to estimate the camera parameters. A mathematical analysis of our algorithm is presented to illustrate the stability of our method, as well as comparison to existing motion estimation algorithms. We present preliminary results of using this algorithm on both a virtual colonoscopy image sequence, as well as a colon phantom image sequence.

[1]  Andrea J. van Doorn,et al.  Invariant Properties of the Motion Parallax Field due to the Movement of Rigid Bodies Relative to an Observer , 1975 .

[2]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[3]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[4]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[5]  Berthold K. P. Horn,et al.  Passive navigation , 1982, Computer Vision Graphics and Image Processing.

[6]  Gilad Adiv,et al.  Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  J H Rieger,et al.  Processing differential image motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[8]  James J. Little,et al.  Parallel Optical Flow Using Local Voting , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[9]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[10]  Gilad Adiv,et al.  Inherent Ambiguities in Recovering 3-D Motion and Structure from a Noisy Flow Field , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  A. Verri,et al.  Differential techniques for optical flow , 1990 .

[12]  V. Sundareswaran.  Egomotion from global flow field data , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[13]  V. N. Bogaevski,et al.  Matrix Perturbation Theory , 1991 .

[14]  Ilse C. F. Ipsen,et al.  On the Sensitivity of Solution Components in Linear Systems of Equations , 1995, SIAM J. Matrix Anal. Appl..

[15]  Steven S. Beauchemin,et al.  The computation of optical flow , 1995, CSUR.

[16]  Carlo Tomasi,et al.  Comparison of approaches to egomotion computation , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Brendan McCane,et al.  Recovering Motion Fields: An Evaluation of Eight Optical Flow Algorithms , 1998, BMVC.

[18]  Tony Lindeberg,et al.  A scale selection principle for estimating image deformations , 1998, Image Vis. Comput..

[19]  Ivan Bricault,et al.  Multi-Level Strategy for Computer-Assisted Transbronchial Biopsy , 1998, MICCAI.

[20]  D. Vining.  Virtual colonoscopy. , 1999, Seminars in ultrasound, CT, and MR.

[21]  Marc M. Van Hulle,et al.  A phase-based approach to the estimation of the optical flow field using spatial filtering , 2002, IEEE Trans. Neural Networks.

[22]  Daisuke Deguchi,et al.  New Image Similarity Measure for Bronchoscope Tracking Based on Image Registration , 2003, MICCAI.

[23]  Allan D. Jepson,et al.  Subspace methods for recovering rigid motion I: Algorithm and implementation , 2004, International Journal of Computer Vision.

[24]  David J. Fleet,et al.  Computation of component image velocity from local phase information , 1990, International Journal of Computer Vision.

[25]  Larry S. Davis,et al.  Temporal Multi-Scale Models for Flow and Acceleration , 2004, International Journal of Computer Vision.

[26]  Daisuke Deguchi,et al.  Fast and Accurate Bronchoscope Tracking Using Image Registration and Motion Prediction , 2004, MICCAI.

[27]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[28]  P. Anandan,et al.  A computational framework and an algorithm for the measurement of visual motion , 1987, International Journal of Computer Vision.

[29]  D. Lieberman.  Quality and colonoscopy: a new imperative. , 2005, Gastrointestinal endoscopy.

[30]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[31]  Daisuke Deguchi,et al.  Hybrid Bronchoscope Tracking Using a Magnetic Tracking Sensor and Image Registration , 2005, MICCAI.

[32]  William E. Higgins,et al.  System for Live Virtual-Endoscopic Guidance of Bronchoscopy , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[33]  Fani Deligianni,et al.  Predictive Camera Tracking for Bronchoscope Simulation with CONDensation , 2005, MICCAI.

[34]  William E. Higgins,et al.  Real-time Image-Based Guidance Method for Lung-Cancer Assessment , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[35]  Guang-Zhong Yang,et al.  Non-rigid 2D-3D Registration with Catheter Tip EM Tracking for Patient Specific Bronchoscope Simulation , 2006, MICCAI.