Fiber bundle shifting endomicroscopy for high-resolution imaging

Flexible endomicroscopes commonly use coherent fiber bundles with high core densities to facilitate high-resolution in vivo imaging during endoscopic and minimally-invasive procedures. However, under-sampling due to the inter-core spacing limits the spatial resolution, making it difficult to resolve smaller cellular features. Here, we report a compact and rapid piezoelectric transducer (PZT) based bundle-shifting endomicroscopy system in which a super-resolution (SR) image is restored from multiple pixelation-limited images by computational means. A miniaturized PZT tube actuates the fiber bundle behind a GRIN micro-lens and a Delaunay triangulation based algorithm reconstructs an enhanced SR image. To enable real-time cellular-level imaging, imaging is performed using a line-scan confocal laser endomicroscope system with a raw frame rate of 120 fps, delivering up to 2 times spatial resolution improvement for a field of view of 350 µm at a net frame rate of 30 fps. The resolution enhancement is confirmed using resolution phantoms and ex vivo fluorescence endomicroscopy imaging of human breast specimens is demonstrated.

[1]  Timothy J Muldoon,et al.  Subcellular-resolution molecular imaging within living tissue by fiber microendoscopy. , 2007, Optics express.

[2]  A. Gmitro,et al.  Confocal microscopy through a fiber-optic imaging bundle. , 1993, Optics letters.

[3]  E. Vicaut,et al.  Fibered Confocal Fluorescence Microscopy (Cell-viZio™) Facilitates Extended Imaging in the Field of Microcirculation , 2004, Journal of Vascular Research.

[4]  Robert Kester,et al.  Improving spatial resolution of a fiber bundle optical biopsy system , 2010, BiOS.

[5]  Joel N. Bixler,et al.  Confocal Endomicroscopy: Instrumentation and Medical Applications , 2012, Annals of Biomedical Engineering.

[6]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..

[7]  S. Yun,et al.  Optical fibers for high-resolution in vivo microendoscopic fluorescence imaging , 2013 .

[8]  Eric J Seibel,et al.  Unique features of optical scanning, single fiber endoscopy * ** , 2002, Lasers in surgery and medicine.

[9]  Jin U. Kang,et al.  Pixelation effect removal from fiber bundle probe based optical coherence tomography imaging , 2010, Optics express.

[10]  Wibool Piyawattanametha,et al.  A fast depixelation method of fiber bundle image for an embedded system , 2015, 2015 8th Biomedical Engineering International Conference (BMEiCON).

[11]  Kobus Barnard,et al.  Resolution enhancement for fiber bundle imaging using maximum a posteriori estimation. , 2018, Optics letters.

[12]  J. Fujimoto,et al.  Three-dimensional endomicroscopy using optical coherence tomography , 2007 .

[13]  K. Pienta,et al.  Correlation of nuclear morphometry with progression of breast cancer , 1991, Cancer.

[14]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[15]  Francois Lacombe,et al.  Real time autonomous video image registration for endomicroscopy: fighting the compromises , 2008, SPIE BiOS.

[16]  Andrew Zisserman,et al.  Computer vision applied to super resolution , 2003, IEEE Signal Process. Mag..

[17]  Nicholas Ayache,et al.  Towards Optical Biopsies with an Integrated Fibered Confocal Fluorescence Microscope , 2004, MICCAI.

[18]  A. Polglase,et al.  A fluorescence confocal endomicroscope for in vivo microscopy of the upper- and the lower-GI tract. , 2005, Gastrointestinal endoscopy.

[19]  Tomasz S Tkaczyk,et al.  Development of a multimodal foveated endomicroscope for the detection of oral cancer. , 2017, Biomedical optics express.

[20]  R. Richards-Kortum,et al.  Fiber-optic confocal microscope using a MEMS scanner and miniature objective lens. , 2007, Optics express.

[21]  J. Fujimoto,et al.  In vivo endoscopic optical biopsy with optical coherence tomography. , 1997, Science.

[22]  Guang-Zhong Yang,et al.  Line-scanning fiber bundle endomicroscopy with a virtual detector slit. , 2016, Biomedical optics express.

[23]  Rebecca Richards-Kortum,et al.  A Pilot Study of Low-Cost, High-Resolution Microendoscopy as a Tool for Identifying Women with Cervical Precancer , 2012, Cancer Prevention Research.

[24]  N. K. Bose,et al.  High resolution image formation from low resolution frames using Delaunay triangulation , 2002, IEEE Trans. Image Process..

[25]  C. J. Chen,et al.  Electromechanical deflections of piezoelectric tubes with quartered electrodes , 1992 .

[26]  Guang-Zhong Yang,et al.  Imaging breast cancer morphology using probe-based confocal laser endomicroscopy: towards a real-time intraoperative imaging tool for cavity scanning , 2015, Breast Cancer Research and Treatment.

[27]  Brian M. Cullum,et al.  Large area super-resolution chemical imaging via rapid dithering of a nanoprobe , 2015, Sensing Technologies + Applications.

[28]  Xingde Li,et al.  Compensation-free, all-fiber-optic, two-photon endomicroscopy at 1.55 μm. , 2011, Optics letters.

[29]  Guang-Zhong Yang,et al.  Fiber-shifting endomicroscopy for enhanced resolution imaging , 2017 .

[30]  Anant Shinde,et al.  Pixelate removal in an image fiber probe endoscope incorporating comb structure removal methods , 2014 .