Depth-map-based scene analysis for active navigation in virtual angioscopy

This work presents an approach dealing with virtual exploratory navigation inside vascular structures. It is based on the notion of active vision in which only visual perception drives the motion of the virtual angioscope. The proposed fly-through approach does not require a premodeling of the volume dataset or an interactive control of the virtual sensor during the fly-through. Active navigation combines the on-line computation of the scene view and its analysis, to automatically define the three-dimensional sensor path. The navigation environment and the camera-like model are first sketched. The basic stages of the active navigation framework are then described: the virtual image computation (based on ray casting), the scene analysis process (using depth map), the navigation strategy, and the virtual path estimation. Experimental results obtained from phantom model and patient computed tomography data are finally reported.

[1]  K Neumann,et al.  Real-time interactive virtual endoscopy of the tracheo-bronchial system: influence of CT imaging protocols and observer ability. , 2000, European journal of radiology.

[2]  K Ramaswamy,et al.  Virtual bronchoscopy for three--dimensional pulmonary image assessment: state of the art and future needs. , 1998, Radiographics : a review publication of the Radiological Society of North America, Inc.

[3]  Ivan Bricault,et al.  Registration of real and CT-derived virtual bronchoscopic images to assist transbronchial biopsy , 1998, IEEE Transactions on Medical Imaging.

[4]  Laurent D. Cohen,et al.  Fast extraction of minimal paths in 3D images and applications to virtual endoscopy , 2001, Medical Image Anal..

[5]  J. Ferrucci,et al.  Occlusive colon carcinoma: virtual colonoscopy in the preoperative evaluation of the proximal colon. , 1999, Radiology.

[6]  S. Mattioli,et al.  Three-dimensional CT imaging and virtual endoscopy for the placement of self-expandable stents in oesophageal and tracheobronchial neoplastic stenoses. , 2003, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[7]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Martial Hebert,et al.  A behavior-based system for off-road navigation , 1994, IEEE Trans. Robotics Autom..

[9]  Rae-Hong Park,et al.  Robust Adaptive Segmentation of Range Images , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Max A. Viergever,et al.  Fast delineation and visualization of vessels in 3-D angiographic images , 2000, IEEE Transactions on Medical Imaging.

[11]  P. Cotton,et al.  Virtual endoscopy--comparison with colonoscopy in the detection of space-occupying lesions of the colon. , 2000, Endoscopy.

[12]  Stephen R. Aylward,et al.  Initialization, noise, singularities, and scale in height ridge traversal for tubular object centerline extraction , 2002, IEEE Transactions on Medical Imaging.

[13]  R. Kikinis,et al.  Interactive virtual endoscopy. , 1997, AJR. American journal of roentgenology.

[14]  P. Haigron,et al.  3D navigation in medicine , 1996 .

[15]  Christine Toumoulin,et al.  Fast detection and characterization of vessels in very large 3-D data sets using geometrical moments , 2001, IEEE Transactions on Biomedical Engineering.

[16]  Avinash C. Kak,et al.  Vision for Mobile Robot Navigation: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Jun Sugiyama,et al.  Tracking of a bronchoscope using epipolar geometry analysis and intensity-based image registration of real and virtual endoscopic images , 2002, Medical Image Anal..

[18]  Dorothee P. Auer,et al.  Evaluation of virtual endoscopy for application in clinical neurosciences , 2002 .

[19]  C M Dykes,et al.  Virtual Colonoscopy: A New Approach for Colorectal Cancer Screening , 2001, Gastroenterology nursing : the official journal of the Society of Gastroenterology Nurses and Associates.

[20]  Thierry Siméon,et al.  Robust motion planning for rough terrain navigation , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[21]  D. Buthiau,et al.  Virtual Endoscopy , 2003, Springer Paris.

[22]  Olivier D. Faugeras,et al.  Co-dimension 2 Geodesic Active Contours for MRA Segmentation , 1999, IPMI.

[23]  M E Ladd,et al.  Virtual MR angioscopy of the pulmonary artery tree. , 1996, Journal of computer assisted tomography.

[24]  Bruce Randall Donald,et al.  Real-time robot motion planning using rasterizing computer graphics hardware , 1990, SIGGRAPH.

[25]  P. Petruzzi,et al.  Spiral CT virtual endoscopy of abdominal arteries: clinical applications , 2000, Abdominal Imaging.

[26]  Bin Li,et al.  A novel approach to extract colon lumen from CT images for virtual colonoscopy , 2000, IEEE Transactions on Medical Imaging.

[27]  Demetri Terzopoulos,et al.  Deformable models in medical image analysis: a survey , 1996, Medical Image Anal..

[28]  Dirk Bartz,et al.  Virtual voyage: interactive navigation in the human colon , 1997, SIGGRAPH.

[29]  Zhengrong Liang,et al.  Reliable Path for Virtual Endoscopy: Ensuring Complete Examination of Human Organs , 2001, IEEE Trans. Vis. Comput. Graph..

[30]  Kensaku Mori,et al.  Automated anatomical labeling of the bronchial branch and its application to the virtual bronchoscopy system , 2000, IEEE Transactions on Medical Imaging.

[31]  M Panconi,et al.  [CT virtual angioscopy in the study of thoracic aortic dissection]. , 2001, La Radiologia medica.

[32]  Fernand S. Cohen,et al.  A maximum-likelihood approach to segmenting range data , 1988, IEEE J. Robotics Autom..

[33]  P. Choyke,et al.  Gray-scale skeletonization of small vessels in magnetic resonance angiography , 2000, IEEE Transactions on Medical Imaging.

[34]  W E Higgins,et al.  Automatic axis generation for virtual bronchoscopic assessment of major airway obstructions. , 2002, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[35]  Zhengrong Liang,et al.  Automatic centerline extraction for virtual colonoscopy , 2002, IEEE Transactions on Medical Imaging.

[36]  Jean-Louis Coatrieux,et al.  Depth-map-based scene analysis for active navigation in virtual angioscopy , 1999, IEEE Transactions on Medical Imaging.

[37]  Tatsuya Igarashi,et al.  Virtual Angioscopy Using 3-Dimensional Rotational Digital Subtraction Angiography for Endovascular Assessment , 2002, Journal of endovascular therapy : an official journal of the International Society of Endovascular Specialists.

[38]  Guido Gerig,et al.  Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images , 1998, Medical Image Anal..

[39]  Jean-Louis Coatrieux,et al.  Toward an active three dimensional navigation system in medical imaging , 1997, CVRMed.

[40]  Simon Lacroix,et al.  Reactive navigation in outdoor environments using potential fields , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[41]  C D Claussen,et al.  Hybrid 3D visualization of the chest and virtual endoscopy of the tracheobronchial system: possibilities and limitations of clinical application. , 2001, Lung cancer.

[42]  Simon Lacroix,et al.  Motion and Perception Strategies for Outdoor Mobile Robot Navigation in Unknown Environments , 1995, ISER.

[43]  Claudio Vignali,et al.  Spiral CT virtual endoscopy of abdominal arteries: clinical applications. , 2000 .

[44]  Yuichiro Hayashi,et al.  A method for specifying unobserved regions in virtual endoscopy system , 2001, CARS.

[45]  C. Hamitouche,et al.  A moment-based three-dimensional edge operator , 1990, IEEE Transactions on Biomedical Engineering.

[46]  D G Heath,et al.  Virtual angioscopy using spiral CT and real-time interactive volume-rendering techniques. , 1998, Journal of computer assisted tomography.

[47]  C D Claussen,et al.  Virtual coronary angioscopy using multislice computed tomography , 2002, Heart.

[48]  H. Hoffman,et al.  Virtual reality: teaching tool of the twenty‐first century? , 1997, Academic medicine : journal of the Association of American Medical Colleges.

[49]  U. Ku,et al.  Endoscopic surgery training using virtual reality and deformable tissue simulation , 2000 .

[50]  W. Eric L. Grimson,et al.  An Interactive Virtual Endoscopy Tool , 2001 .

[51]  P L Choyke,et al.  MR Virtual Angioscopy of Thoracic Aortic Atherosclerosis in Homozygous Familial Hypercholesterolemia , 2001, Journal of computer assisted tomography.

[52]  Milan Sonka,et al.  Virtual angioscopy in human coronary arteries with visualization of computational hemodynamics , 2001, SPIE Medical Imaging.

[53]  D J Vining,et al.  Virtual bronchoscopy. , 1999, Clinics in chest medicine.

[54]  Richard A. Robb,et al.  VR in medicine: Virtual colonoscopy , 1998, Future Gener. Comput. Syst..