Registration of real and CT-derived virtual bronchoscopic images to assist transbronchial biopsy

This paper describes research work motivated by an innovative medical application: computer-assisted transbronchial biopsy. This project involves the registration, with no external localization device, of a preoperative three-dimensional (3-D) computed tomography (CT) scan of the thoracic cavity (showing a tumor that requires a needle biopsy), and an intraoperative endoscopic two-dimensional (2-D) image sequence, in order to provide assistance in transbronchial puncture of the tumor. Because of the specific difficulties resulting from the data being processed, a multilevel strategy was introduced. For each analysis level, the relevant information to process and the corresponding algorithms were defined. This multilevel strategy, thus, provides the best possible accuracy. Original image processing methods were elaborated, dealing with segmentation, registration and 3-D reconstruction of the bronchoscopic images. In particular, these methods involve adapted mathematical morphology tools, a "daemon-based" registration algorithm, and a model-based shape-from-shading algorithm. This pilot study presents the application of these algorithms to recorded bronchoscopic video sequences for five patients. The preliminary results presented here demonstrate that it is possible to precisely localize the endoscopic camera within the CT data coordinate system. The computer can thus synthesize in near real-time the CT-derived virtual view that corresponds to the actual endoscopic view.

[1]  Alfred M. Bruckstein,et al.  Global Shape from Shading , 1996, Comput. Vis. Image Underst..

[2]  Paul F. Hemler,et al.  Freeflight: a virtual endoscopy system , 1997, CVRMed.

[3]  I Bricault,et al.  Computer-assisted bronchoscopy: aims and research perspectives. , 1995, Journal of image guided surgery.

[4]  Michel Grimaud,et al.  New measure of contrast: the dynamics , 1992, Optics & Photonics.

[5]  K. Deguchi,et al.  Shape reconstruction from an endoscope image by shape-from-shading technique for a point light source at the projection center , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[6]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[7]  F. Rodríguez de Castro,et al.  Relevance of training in transbronchial fine-needle aspiration technique. , 1997, Chest.

[8]  Ivan Bricault.  Endoscopie bronchique assistée par ordinateur : résolution multi-niveaux d'un problème d'optimisation scène/modèle , 1997 .

[9]  Pascal Fua,et al.  Taking Advantage of Image-Based and Geometry-Based Constraints to Recover 3-D Surfaces , 1996, Comput. Vis. Image Underst..

[10]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Ko-Pen Wang,et al.  Staging of mediastinal involvement in lung cancer by bronchoscopic needle aspiration pro bronchoscopic needle aspiration , 1996 .

[12]  S. Umeyama,et al.  Least-Squares Estimation of Transformation Parameters Between Two Point Patterns , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  G. R. Ferretti,et al.  Central airway stenoses: preliminary results of spiral-CT-generated virtual bronchoscopy simulations in 29 patients , 1997, European Radiology.

[14]  E F Haponik,et al.  Underutilization of transbronchial needle aspiration: experiences of current pulmonary fellows. , 1997, Chest.

[15]  Ko-pen Wang,et al.  Staging of bronchogenic carcinoma by bronchoscopy. , 1994, Chest.

[16]  R H Choplin,et al.  Virtual Bronchoscopy: Relationships of Virtual Reality Endobronchial Simulations to Actual Bronchoscopic Findings , 1996 .