A Low-Cost Real-Time Three-Dimensional Confocal Fluorescence Endomicroscopy Imaging System

Confocal fluorescence endomicroscopy is an emerging endoscopic modality, which allows in vivo microscopic imaging of the mucosal layer of living tissues. In this paper, we will present a low-cost real-time 3D imaging system using an endomicroscope. In the system, the volumetric image data are automatically captured by continuously scanning the surface and subsurface tissue structures without removing tissues from the body or sacrificing animals. Real-time algorithms including feature-based registration of multiple cross-sectional images and GPU-based reconstruction of 3D microstructure as well as instant rendering of the clinical features are developed to allow the clinicians to navigate within the living tissue freely for a much more definitive diagnostic result. The nature of the proposed system enables the clinicians to diagnose various diseases including the early-stage cancers in a non-invasive way. In vivo histology becomes visible and an online diagnosis can potentially be achieved.

[1]  Ji Chen,et al.  [An interactive volume rendering algorithm for laser scanning confocal microscope data]. , 2004, Hang tian yi xue yu yi xue gong cheng = Space medicine & medical engineering.

[2]  John F. Hughes,et al.  Building an Orthonormal Basis from a Unit Vector , 1999, J. Graphics, GPU, & Game Tools.

[3]  E. Gasparetto,et al.  Potential role of diffusion tensor MRI in the differential diagnosis of mild cognitive impairment and Alzheimer's disease. , 2008, AJR. American journal of roentgenology.

[4]  Heung-Kook Choi,et al.  Three-dimensional visualization and quantitative analysis of cervical cell nuclei with confocal laser scanning microscopy. , 2005, Analytical and quantitative cytology and histology.

[5]  Kun Zhou,et al.  Interactive Shape Interpolation through Controllable Dynamic Deformation , 2011, IEEE Transactions on Visualization and Computer Graphics.

[6]  R. Kiesslich,et al.  In-vivo confocal real-time mini-microscopy in animal models of human inflammatory and neoplastic diseases. , 2007, Endoscopy.

[7]  Helmut Neumann,et al.  Confocal laser endomicroscopy: technical advances and clinical applications. , 2010, Gastroenterology.

[8]  D. Clarke‐Pearson,et al.  Screening for Ovarian Cancer , 2009 .

[9]  S Fang,et al.  Three-dimensional microscopy data exploration by interactive volume visualization. , 2000, Scanning.

[10]  A. Filler.  The History, Development and Impact of Computed Imaging in Neurological Diagnosis and Neurosurgery: CT, MRI, and DTI , 2009 .

[11]  H Stepp,et al.  Diagnosing Cancer in Vivo , 2001, Science.

[12]  Penny Rheingans,et al.  Texture-based Transfer Functions for Direct Volume Rendering , 2008, IEEE Transactions on Visualization and Computer Graphics.

[13]  K. P. Kim,et al.  Radiation dose associated with common computed tomography examinations and the associated lifetime attributable risk of cancer. , 2009, Archives of internal medicine.

[14]  Wieslaw Lucjan Nowinski,et al.  A hybrid approach to shape-based interpolation of stereotactic atlases of the human brain , 2007, Neuroinformatics.

[15]  Joel H. Saltz,et al.  Ieee Transactions on Visualization and Computer Graphics Reconstruction of Cellular Biological Structures from Optical Microscopy Data , 2022 .

[16]  Will Dunham,et al.  Report sees 7.6 million global 2007 cancer deaths , 2000 .

[17]  Vason P. Srini,et al.  An Effective Load Balancing Scheme for 3D Texture-Based Sort-Last Parallel Volume Rendering on GPU Clusters , 2008, IEICE Trans. Inf. Syst..

[18]  K. Soo,et al.  Laser confocal endomicroscopy as a novel technique for fluorescence diagnostic imaging of the oral cavity. , 2007, Journal of biomedical optics.

[19]  Gabor T. Herman,et al.  Fundamentals of Computerized Tomography: Image Reconstruction from Projections , 2009, Advances in Pattern Recognition.

[20]  R. Kiesslich,et al.  Dynamic in vivo Imaging of Microvasculature and Perfusion by Miniaturized Confocal Laser Microscopy , 2008, European Surgical Research.

[21]  Balázs Csébfalvi,et al.  Frequency-Domain Upsampling on a Body-Centered Cubic Lattice for Efficient and High-Quality Volume Rendering , 2009, VMV.