Selective image similarity measure for bronchoscope tracking based on image registration

We propose a selective method of measurement for computing image similarities based on characteristic structure extraction and demonstrate its application to flexible endoscope navigation, in particular to a bronchoscope navigation system. Camera motion tracking is a fundamental function required for image-guided treatment or therapy systems. In recent years, an ultra-tiny electromagnetic sensor commercially became available, and many image-guided treatment or therapy systems use this sensor for tracking the camera position and orientation. However, due to space limitations, it is difficult to equip the tip of a bronchoscope with such a position sensor, especially in the case of ultra-thin bronchoscopes. Therefore, continuous image registration between real and virtual bronchoscopic images becomes an efficient tool for tracking the bronchoscope. Usually, image registration is done by calculating the image similarity between real and virtual bronchoscopic images. Since global schemes to measure image similarity, such as mutual information, squared gray-level difference, or cross correlation, average differences in intensity values over an entire region, they fail at tracking of scenes where less characteristic structures can be observed. The proposed method divides an entire image into a set of small subblocks and only selects those in which characteristic shapes are observed. Then image similarity is calculated within the selected subblocks. Selection is done by calculating feature values within each subblock. We applied our proposed method to eight pairs of chest X-ray CT images and bronchoscopic video images. The experimental results revealed that bronchoscope tracking using the proposed method could track up to 1600 consecutive bronchoscopic images (about 50s) without external position sensors. Tracking performance was greatly improved in comparison with a standard method utilizing squared gray-level differences of the entire images.

[1]  D. Caramella,et al.  3D Image Processing: Techniques and Clinical Applications , 2002 .

[2]  Darius Burschka,et al.  Scale-Invariant Registration of Monocular Endoscopic Images to CT-Scans for Sinus Surgery , 2004, MICCAI.

[3]  James S. Duncan,et al.  Medical Image Analysis , 1999, IEEE Pulse.

[4]  David J. Hawkes,et al.  Design and evaluation of a system for microscope-assisted guided interventions (MAGI) , 1999, IEEE Transactions on Medical Imaging.

[5]  Kensaku Mori,et al.  Virtualized Endoscope System--An Application of Virtual Reality Technology to Diagnostic Aid-- , 1996 .

[6]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[7]  Jonathan S. Lewin,et al.  Semiautomatic 3-D image registration as applied to interventional MRI liver cancer treatment , 2000, IEEE Transactions on Medical Imaging.

[8]  Ivan Bricault,et al.  Registration of real and CT-derived virtual bronchoscopic images to assist transbronchial biopsy , 1998, IEEE Transactions on Medical Imaging.

[9]  Balraj Naren,et al.  Medical Image Registration , 2022 .

[10]  R. Y. Tsai,et al.  An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision , 1986, CVPR 1986.

[11]  V Argiro,et al.  Perspective volume rendering of CT and MR images: applications for endoscopic imaging. , 1996, Radiology.

[12]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[13]  Forman S. Acton,et al.  Numerical methods that work , 1970 .

[14]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[15]  Jay B. West,et al.  Implementation, calibration and accuracy testing of an image-enhanced endoscopy system , 2002, IEEE Transactions on Medical Imaging.

[16]  Rüdiger Westermann,et al.  Acceleration techniques for GPU-based volume rendering , 2003, IEEE Visualization, 2003. VIS 2003..

[17]  Guang-Zhong Yang,et al.  Patient-specific bronchoscopy visualization through BRDF estimation and disocclusion correction , 2006, IEEE Transactions on Medical Imaging.

[18]  Yoshikazu Nakajima,et al.  Image guidance of breast cancer surgery using 3-D ultrasound images and augmented reality visualization , 1998, IEEE Transactions on Medical Imaging.

[19]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[20]  Jun Sugiyama,et al.  Tracking of a bronchoscope using epipolar geometry analysis and intensity-based image registration of real and virtual endoscopic images , 2002, Medical Image Anal..

[21]  William E. Higgins,et al.  Technique for registering 3D virtual CT images to endoscopic video , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[22]  Kensaku Mori,et al.  Fast volume rendering based on software optimisation using multimedia instructions on PC platforms , 2002 .

[23]  Dirk Bartz,et al.  Virtual voyage: interactive navigation in the human colon , 1997, SIGGRAPH.

[24]  Mary C. Whitton,et al.  Towards Performing Ultrasound-Guided Needle Biopsies from within a Head-Mounted Display , 1996, VBC.

[25]  Jürgen Weese,et al.  A comparison of similarity measures for use in 2-D-3-D medical image registration , 1998, IEEE Transactions on Medical Imaging.

[26]  Naoki Suzuki,et al.  Development of Three-Dimensional Endoscopic Ultrasound System with Optical Tracking , 2002, MICCAI.

[27]  William E. Higgins,et al.  3D CT-Video Fusion for Image-Guided Bronchoscopy , 2008, Comput. Medical Imaging Graph..

[28]  Daisuke Deguchi,et al.  Hybrid Bronchoscope Tracking Using a Magnetic Tracking Sensor and Image Registration , 2005, MICCAI.

[29]  David J. Hawkes,et al.  Design and evaluation of a system for microscope-assisted guided interventions (MAGI) , 2000 .

[30]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[31]  Guang-Zhong Yang,et al.  Nonrigid 2-D/3-D Registration for Patient Specific Bronchoscopy Simulation With Statistical Shape Modeling: Phantom Validation , 2006, IEEE Transactions on Medical Imaging.

[32]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[33]  Enrico Gobbetti,et al.  3D Image Processing: Techniques and Clinical Applications , 2002 .

[34]  William E. Higgins,et al.  Real-time CT-video registration for continuous endoscopic guidance , 2006, SPIE Medical Imaging.

[35]  K. Cleary,et al.  Image-guided interventions : technology and applications , 2008 .

[36]  William E. Higgins,et al.  Computer-based system for the virtual-endoscopic guidance of bronchoscopy , 2007, Comput. Vis. Image Underst..

[37]  Ron Kikinis,et al.  Simulation of Endoscopy , 1995, CVRMed.

[38]  Daisuke Deguchi,et al.  Branch identification method for CT-guided bronchoscopy based on eigenspace image matching between real and virtual bronchoscopic images , 2006, SPIE Medical Imaging.