Multimodal endoscopic system based on multispectral and photometric stereo imaging and analysis.

We propose a multimodal endoscopic system based on white light (WL), multispectral (MS), and photometric stereo (PS) imaging for the examination of colorectal cancer (CRC). Recently, the enhancement of the diagnostic accuracy of CRC colonoscopy has been reported; however, tumor diagnosis for a variety of lesion types remains challenging using current endoscopy. In this study, we demonstrate that our developed system can simultaneously discriminate tumor distributions and provide three-dimensional (3D) morphological information about the colon surface using the WL, MS, and PS imaging modalities. The results demonstrate that the proposed system has considerable potential for CRC diagnosis.

[1]  E. E. Gresch.  Genetic Alterations During Colorectal-Tumor Development , 1989 .

[2]  Jennifer K. Barton,et al.  Fluorescence-based surface magnifying chromoendoscopy and optical coherence tomography endoscope , 2012, Photonics West - Biomedical Optics.

[3]  E. Kuipers,et al.  A back-to-back comparison of white light video endoscopy with autofluorescence endoscopy for adenoma detection in high-risk subjects , 2010, Gut.

[4]  A. Zauber,et al.  The National Polyp Study. Patient and polyp characteristics associated with high-grade dysplasia in colorectal adenomas. , 1990, Gastroenterology.

[5]  M. Shrime,et al.  The Lancet Oncology Commission Global cancer surgery: delivering safe, aff ordable, and timely cancer surgery , 2015 .

[6]  M. Bouvet,et al.  Development of a Clinically-Precise Mouse Model of Rectal Cancer , 2013, PloS one.

[7]  Daniel X. Hammer,et al.  Fluorescence-guided optical coherence tomography imaging for colon cancer screening: a preliminary mouse study , 2011, Biomedical optics express.

[8]  Nicholas J Durr,et al.  3D imaging techniques for improved colonoscopy , 2014, Expert review of medical devices.

[9]  Jin U. Kang,et al.  Pixelation effect removal from fiber bundle probe based optical coherence tomography imaging , 2010, Optics express.

[10]  A. Zauber,et al.  The National Polyp Study , 1990 .

[11]  C. J. Prabhakar,et al.  An Image Based Technique for Enhancement of Underwater Images , 2012, ArXiv.

[12]  Jörg Bendix,et al.  Hyperspectral Imaging Using Flexible Endoscopy for Laryngeal Cancer Detection , 2016, Sensors.

[13]  Yoshihiko Hamamoto,et al.  New method for detection of gastric cancer by hyperspectral imaging: a pilot study , 2013, Journal of biomedical optics.

[14]  Jihun Kim,et al.  A Multimodal Biomicroscopic System based on High-frequency Acoustic Radiation Force Impulse and Multispectral Imaging Techniques for Tumor Characterization Ex vivo , 2017, Scientific Reports.

[15]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[16]  Jeongmin Choi,et al.  Comparison of detection and miss rates of narrow band imaging, flexible spectral imaging chromoendoscopy and white light at screening colonoscopy: a randomised controlled back-to-back study , 2013, Gut.

[17]  Kim L. Boyer,et al.  Linearized vegetation indices based on a formal statistical framework , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Ralf Kiesslich,et al.  A guide to multimodal endoscopy imaging for gastrointestinal malignancy — an early indicator , 2017, Nature Reviews Gastroenterology &Hepatology.

[19]  Jörg Bendix,et al.  Hyperspectral imaging of mucosal surfaces in patients , 2012, Journal of biophotonics.

[20]  Maria Petrou,et al.  The 4-Source Photometric Stereo Technique for Three-Dimensional Surfaces in the Presence of Highlights and Shadows , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  R M Cothren,et al.  Gastrointestinal tissue diagnosis by laser-induced fluorescence spectroscopy at endoscopy. , 1990, Gastrointestinal endoscopy.

[22]  J. Mansfield,et al.  Multispectral imaging in biology and medicine: Slices of life , 2006, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[23]  Umberto Veronesi,et al.  Global cancer surgery: delivering safe, affordable, and timely cancer surgery. , 2015, The Lancet. Oncology.

[24]  N. Suzuki,et al.  Narrow band imaging for colonoscopic surveillance in hereditary non-polyposis colorectal cancer , 2007, Gut.

[25]  Boreom Lee,et al.  Smartphone-based multispectral imaging: system development and potential for mobile skin diagnosis. , 2016, Biomedical optics express.

[26]  Y. Jung,et al.  Miss rate of colorectal neoplastic polyps and risk factors for missed polyps in consecutive colonoscopies , 2017, Intestinal research.

[27]  Adrien Bartoli,et al.  Shape-from-Polarization in laparoscopy , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[28]  Joseph C. Jing,et al.  Multimodality endoscopic optical coherence tomography and fluorescence imaging technology for visualization of layered architecture and subsurface microvasculature. , 2018, Optics letters.

[29]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Christoph Schmalz,et al.  An endoscopic 3D scanner based on structured light , 2012, Medical Image Anal..

[31]  Cem Unsalan,et al.  Damaged building detection in aerial images using shadow Information , 2009, 2009 4th International Conference on Recent Advances in Space Technologies.

[32]  Boris Thies,et al.  Hyperspectral hybrid method classification for detecting altered mucosa of the human larynx , 2012, International Journal of Health Geographics.

[33]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Y. Kosugi,et al.  Cancer detection using infrared hyperspectral imaging , 2011, Cancer science.

[35]  Huabei Jiang,et al.  Miniature Endoscope for Multimodal Imaging , 2017 .

[36]  Siavash Yazdanfar,et al.  Detection of colorectal polyps in humans using an intravenously administered fluorescent peptide targeted against c-Met , 2015, Nature Medicine.

[37]  S. Kudo,et al.  Endoscopic Mucosal Resection of Flat and Depressed Types of Early Colorectal Cancer , 1993, Endoscopy.

[38]  Qiyin Fang,et al.  Hyperspectral imaging: comparison of acousto-optic and liquid crystal tunable filters , 2018, Medical Imaging.

[39]  Benjamin J Vakoc,et al.  Photometric stereo endoscopy , 2013, Journal of biomedical optics.

[40]  K. Caca,et al.  Endoscopic management of colorectal adenomas , 2017, Annals of gastroenterology.