Combined endoscopic video tracking and virtual 3D CT registration for surgical guidance

Bronchoscopic needle biopsy is a common step for early lung-cancer detection. This procedure uses two steps: (1) 3D computed-tomography (CT) chest image analysis, to choose a biopsy site; (2) live bronchoscopy, to perform the biopsy. CT-based virtual endoscopic analysis can improve the results of biopsies, yet errors can still occur. We describe a procedure to combine the endoscopic video tracking (the "real" world) and CT-based virtual endoscopic registration (the "virtual" world). By bringing both sources of information together, a more robust surgical guidance system is realizable. Both the endoscope's video and the thoracic CT scan are used as data sources in the tracking. An optical flow algorithm estimates the endoscope motion between successive video frames. The virtual CT rendering creates a range map for the optical flow equation. This simplifies the endoscope movement calculation into a straightforward linear system. We demonstrate this method for a phantom human airway-tree example.

[1]  Berthold K. P. Horn,et al.  Direct methods for recovering motion , 1988, International Journal of Computer Vision.

[2]  Kensaku Mori,et al.  Method for tracking camera motion of real endoscope by using virtual endoscopy system , 2000, Medical Imaging.

[3]  Ivan Bricault,et al.  Registration of real and CT-derived virtual bronchoscopic images to assist transbronchial biopsy , 1998, IEEE Transactions on Medical Imaging.

[4]  Geoffrey McLennan,et al.  Image-guided endoscopy for lung-cancer assessment , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[5]  C. Stiller,et al.  Estimating motion in image sequences , 1999, IEEE Signal Process. Mag..

[6]  William E. Higgins,et al.  Technique for registering 3D virtual CT images to endoscopic video , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[7]  Pietro Perona,et al.  Reducing "Structure From Motion": A General Framework for Dynamic Vision Part 1: Modeling , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Konstantinos I. Diamantaras,et al.  Total least squares 3-D motion estimation , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[9]  Hyung-Myung Kim,et al.  Recursive total least squares algorithm for 3-D camera motion estimation from image sequences , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[10]  Alex Pentland,et al.  3D structure from 2D motion , 1999, IEEE Signal Process. Mag..

[11]  Yasuhito Suenaga,et al.  Camera motion tracking of real endoscope by using virtual endoscopy system and texture information , 2001, SPIE Medical Imaging.