3D CT-Video Fusion for Image-Guided Bronchoscopy

Bronchoscopic biopsy of the central-chest lymph nodes is an important step for lung-cancer staging. Before bronchoscopy, the physician first visually assesses a patient's three-dimensional (3D) computed tomography (CT) chest scan to identify suspect lymph-node sites. Next, during bronchoscopy, the physician guides the bronchoscope to each desired lymph-node site. Unfortunately, the physician has no link between the 3D CT image data and the live video stream provided during bronchoscopy. Thus, the physician must essentially perform biopsy blindly, and the skill levels between different physicians differ greatly. We describe an approach that enables synergistic fusion between the 3D CT data and the bronchoscopic video. Both the integrated planning and guidance system and the internal CT-video registration and fusion methods are described. Phantom, animal, and human studies illustrate the efficacy of the methods.

[1]  Geoffrey McLennan,et al.  Virtual bronchoscopic approach for combining 3D CT and endoscopic video , 2000, Medical Imaging.

[2]  Takayuki Okatani,et al.  Shape Reconstruction from an Endoscope Image by Shape from Shading Technique for a Point Light Source at the Projection Center , 1997, Comput. Vis. Image Underst..

[3]  Mariusz Duplaga,et al.  Navigation systems based on registration of endoscopic and CT-derived virtual images for bronchofiberoscopic procedures. , 2004, Studies in health technology and informatics.

[4]  Ivar Jacobson,et al.  The unified modeling language reference manual , 2010 .

[5]  Geoffrey McLennan,et al.  CT-video registration accuracy for virtual guidance of bronchoscopy , 2004, SPIE Medical Imaging.

[6]  William E. Higgins,et al.  Integrated bronchoscopic video tracking and 3D CT registration for virtual bronchoscopy , 2003, SPIE Medical Imaging.

[7]  Geoffrey McLennan,et al.  Virtual bronchoscopy for quantitative airway analysis , 2005, SPIE Medical Imaging.

[8]  Robert J Cerfolio,et al.  Survival and outcomes of pulmonary resection for non-small cell lung cancer in the elderly: a nested case-control study. , 2006, The Annals of thoracic surgery.

[9]  G D Rubin,et al.  STS-MIP: a new reconstruction technique for CT of the chest. , 1993, Journal of computer assisted tomography.

[10]  Takehiko Fujisawa,et al.  Comparison of endobronchial ultrasound, positron emission tomography, and CT for lymph node staging of lung cancer. , 2006, Chest.

[11]  Geoffrey McLennan,et al.  Three-dimensional human airway segmentation methods for clinical virtual bronchoscopy. , 2002, Academic radiology.

[12]  R. Spillane,et al.  High-resolution CT of the lungs. , 1993, American family physician.

[13]  William E. Higgins,et al.  Method for continuous guidance of endoscopy , 2007, SPIE Medical Imaging.

[14]  Geoffrey McLennan,et al.  Videoendoscopic distortion correction and its application to virtual guidance of endoscopy , 2001, IEEE Transactions on Medical Imaging.

[15]  Michael W Freckleton,et al.  Informatics in radiology (infoRAD): introduction to the language of three-dimensional imaging with multidetector CT. , 2005, Radiographics : a review publication of the Radiological Society of North America, Inc.

[16]  William E. Lorensen,et al.  The Exploration of Cross-Sectional Data with a Virtual Endoscope , 1995 .

[17]  P C Goodman,et al.  Virtual bronchoscopy for directing transbronchial needle aspiration of hilar and mediastinal lymph nodes: a pilot study. , 1998, AJR. American journal of roentgenology.

[18]  Yoichiro Ishihara,et al.  Ultrathin bronchoscopic barium marking with virtual bronchoscopic navigation for fluoroscopy-assisted thoracoscopic surgery. , 2004, Chest.

[19]  William E. Higgins,et al.  3D model-based vascular tree analysis using differential geometry , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[20]  M. Levoy,et al.  Fast volume rendering using a shear-warp factorization of the viewing transformation , 1994, SIGGRAPH.

[21]  T. Gildea,et al.  Electromagnetic navigation diagnostic bronchoscopy: a prospective study. , 2006, American journal of respiratory and critical care medicine.

[22]  W E Higgins,et al.  Automatic axis generation for virtual bronchoscopic assessment of major airway obstructions. , 2002, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[23]  I Bricault,et al.  Virtual tools for imaging of the thorax. , 2001, The European respiratory journal.

[24]  Robert J Cerfolio,et al.  Maximum standard uptake value of mediastinal lymph nodes on integrated FDG-PET-CT predicts pathology in patients with non-small cell lung cancer. , 2006, The Annals of thoracic surgery.

[25]  W. Eric L. Grimson,et al.  An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[26]  K Ramaswamy,et al.  Virtual bronchoscopy for three--dimensional pulmonary image assessment: state of the art and future needs. , 1998, Radiographics : a review publication of the Radiological Society of North America, Inc.

[27]  William E. Higgins,et al.  Improved 3D live-wire method with application to 3D CT chest image analysis , 2006, SPIE Medical Imaging.

[28]  H. D. Becker,et al.  Editors’ Comment on Electromagnetic Navigation , 2003, Respiration.

[29]  Ivan Bricault,et al.  Registration of real and CT-derived virtual bronchoscopic images to assist transbronchial biopsy , 1998, IEEE Transactions on Medical Imaging.

[30]  Robyn A. Owens,et al.  Registration of stereo and temporal images of the retina , 1999, IEEE Transactions on Medical Imaging.

[31]  R Weissleder,et al.  Imaging of mediastinal lymph nodes: CT, MR, and FDG PET. , 1998, Radiographics : a review publication of the Radiological Society of North America, Inc.

[32]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[33]  R M Summers,et al.  Navigational aids for real-time virtual bronchoscopy. , 1997, AJR. American journal of roentgenology.

[34]  A. Sihoe,et al.  Lung cancer staging. , 2004, The Journal of surgical research.

[35]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[36]  Ralf Eberhardt,et al.  The Future of Bronchoscopy in Diagnosing, Staging and Treatment of Lung Cancer , 2006, Respiration.

[37]  Koichi Yamazaki,et al.  CT-guided transbronchial biopsy using an ultrathin bronchoscope with virtual bronchoscopic navigation. , 2004, Chest.

[38]  Koichi Yamazaki,et al.  Virtual bronchoscopic navigation system shortens the examination time--feasibility study of virtual bronchoscopic navigation system. , 2007, Lung cancer.

[39]  P M Silverman,et al.  CT identification of bronchopulmonary segments: 50 normal subjects. , 1984, AJR. American journal of roentgenology.

[40]  Koichi Yamazaki,et al.  A virtual bronchoscopic navigation system for pulmonary peripheral lesions. , 2006, Chest.

[41]  William J. Schroeder,et al.  The Visualization Toolkit , 2005, The Visualization Handbook.

[42]  D J Vining,et al.  Virtual bronchoscopy. , 1999, Clinics in chest medicine.

[43]  Yoichiro Ishihara,et al.  Transbronchial Diagnosis of A Pulmonary Peripheral Small Lesion Using an Ultrathin Bronchoscope with Virtual Bronchoscopic Navigation , 2002 .

[44]  V Argiro,et al.  Perspective volume rendering of CT and MR images: applications for endoscopic imaging. , 1996, Radiology.

[45]  C S White,et al.  Transbronchial needle aspiration: guidance with CT fluoroscopy. , 2000, Chest.

[46]  F. Herth,et al.  Electromagnetic Navigation during Flexible Bronchoscopy , 2003, Respiration.

[47]  William E. Higgins,et al.  Computer-based system for the virtual-endoscopic guidance of bronchoscopy , 2007, Comput. Vis. Image Underst..

[48]  William E. Higgins,et al.  3D path planning and extension for endoscopic guidance , 2007, SPIE Medical Imaging.

[49]  Ahuva Engel,et al.  Electromagnetic navigation during flexible bronchoscopy. Commentary , 2003 .

[50]  Janice Z. Turlington,et al.  New techniques for efficient sliding thin-slab volume visualization , 2001, IEEE Transactions on Medical Imaging.

[51]  Ivar Jacobson,et al.  Unified Modeling Language , 2020, Definitions.

[52]  Daisuke Deguchi,et al.  Hybrid Bronchoscope Tracking Using a Magnetic Tracking Sensor and Image Registration , 2005, MICCAI.

[53]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[54]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[55]  K Ramaswamy,et al.  Interactive dynamic navigation for virtual endoscopy. , 1999, Computers in biology and medicine.

[56]  R H Choplin,et al.  Virtual Bronchoscopy: Relationships of Virtual Reality Endobronchial Simulations to Actual Bronchoscopic Findings , 1996 .

[57]  Geoffrey McLennan,et al.  Experiments in virtual-endoscopic guidance of bronchoscopy , 2001, SPIE Medical Imaging.

[58]  William E. Higgins,et al.  Real-time CT-video registration for continuous endoscopic guidance , 2006, SPIE Medical Imaging.

[59]  Martin Gogolla.  Unified Modeling Language , 2009, Encyclopedia of Database Systems.

[60]  William E. Higgins,et al.  3D image fusion and guidance for computer-assisted bronchoscopy , 2005, SPIE Optics East.

[61]  K D Hopper,et al.  Transbronchial biopsy with virtual CT bronchoscopy and nodal highlighting. , 2001, Radiology.

[62]  William E. Higgins,et al.  Endoscopic exploration and measurement in 3D radiological images , 1996, Medical Imaging.

[63]  William E. Higgins,et al.  Interactive segmentation based on the live wire for 3D CT chest image analysis , 2007, International Journal of Computer Assisted Radiology and Surgery.

[64]  Geoffrey McLennan,et al.  Three-dimensional path planning for virtual bronchoscopy , 2004, IEEE Transactions on Medical Imaging.

[65]  K. Shimokata,et al.  Interbronchoscopist variability in the diagnosis of lung cancer by flexible bronchoscopy. , 1994, Chest.

[66]  Armin Ernst,et al.  Multiplanar and three-dimensional imaging of the central airways with multidetector CT. , 2002, AJR. American journal of roentgenology.

[67]  Jun Sugiyama,et al.  Tracking of a bronchoscope using epipolar geometry analysis and intensity-based image registration of real and virtual endoscopic images , 2002, Medical Image Anal..

[68]  William E. Higgins,et al.  Technique for registering 3D virtual CT images to endoscopic video , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).