Over 1000 nm Near-Infrared Multispectral Imaging System for Laparoscopic In Vivo Imaging

In this study, a laparoscopic imaging device and a light source able to select wavelengths by bandpass filters were developed to perform multispectral imaging (MSI) using over 1000 nm near-infrared (OTN-NIR) on regions under a laparoscope. Subsequently, MSI (wavelengths: 1000–1400 nm) was performed using the built device on nine live mice before and after tumor implantation. The normal and tumor pixels captured within the mice were used as teaching data sets, and the tumor-implanted mice data were classified using a neural network applied following a leave-one-out cross-validation procedure. The system provided a specificity of 89.5%, a sensitivity of 53.5%, and an accuracy of 87.8% for subcutaneous tumor discrimination. Aggregated true-positive (TP) pixels were confirmed in all tumor-implanted mice, which indicated that the laparoscopic OTN-NIR MSI could potentially be applied in vivo for classifying target lesions such as cancer in deep tissues.

[1]  E. Livingston,et al.  Characterization of a near-infrared laparoscopic hyperspectral imaging system for minimally invasive surgery. , 2007, Analytical chemistry.

[2]  B. Vojnovic,et al.  Electrically tunable fluidic lens imaging system for laparoscopic fluorescence-guided surgery. , 2017, Biomedical optics express.

[3]  Jie Chen,et al.  Feasibility Study on Hyperspectral LiDAR for Ancient Huizhou-Style Architecture Preservation , 2019, Remote. Sens..

[4]  Benno H W Hendriks,et al.  Toward assessment of resection margins using hyperspectral diffuse reflection imaging (400–1,700 nm) during tongue cancer surgery , 2020, Lasers in surgery and medicine.

[5]  K. Soga,et al.  Transparency in Biology: Making the Invisible Visible , 2021 .

[6]  Y. Kosugi,et al.  Cancer detection using infrared hyperspectral imaging , 2011, Cancer science.

[7]  Lena Maier-Hein,et al.  Surgical spectral imaging , 2020, Medical Image Anal..

[8]  Thomas Neumuth,et al.  Laparoscopic system for simultaneous high-resolution video and rapid hyperspectral imaging in the visible and near-infrared spectral range , 2020, Journal of biomedical optics.

[9]  H. Takemura,et al.  Distinction of surgically resected gastrointestinal stromal tumor by near-infrared hyperspectral imaging , 2020, Scientific Reports.

[10]  E. Livingston,et al.  Intraoperative bile duct visualization using near-infrared hyperspectral video imaging. , 2008, American Journal of Surgery.

[11]  Thomas Udelhoven,et al.  Capability of feed-forward neural networks for a chemical evaluation of sediments with diffuse reflectance spectroscopy , 2000 .

[12]  Theo J.M. Ruers,et al.  Optimizing algorithm development for tissue classification in colorectal cancer based on diffuse reflectance spectra. , 2019, Biomedical optics express.

[13]  Hongying Liu,et al.  AOTF based hyperspectral tongue imaging system and its applications in computer-aided tongue disease diagnosis , 2010, 2010 3rd International Conference on Biomedical Engineering and Informatics.

[14]  T. Oda,et al.  Computer-assisted real-time automatic prostate segmentation during TaTME: a single-center feasibility study , 2020, Surgical Endoscopy.

[15]  M. Maeda,et al.  Extra-luminal detection of assumed colonic tumor site by near-infrared laparoscopy , 2016, Surgical Endoscopy.

[16]  G. Rosman,et al.  Artificial Intelligence in Surgery: Promises and Perils , 2018, Annals of surgery.

[17]  M. C. Mancini,et al.  Bioimaging: second window for in vivo imaging. , 2009, Nature nanotechnology.

[18]  Meritxell Vilaseca,et al.  Visible and Extended Near-Infrared Multispectral Imaging for Skin Cancer Diagnosis , 2018, Sensors.

[19]  Daniel Svozil,et al.  Introduction to multi-layer feed-forward neural networks , 1997 .

[20]  Stelzer.  Contrast, resolution, pixelation, dynamic range and signal‐to‐noise ratio: fundamental limits to resolution in fluorescence light microscopy , 1998 .

[21]  Dale J Waterhouse,et al.  A clinically translatable hyperspectral endoscopy (HySE) system for imaging the gastrointestinal tract , 2019, Nature Communications.

[22]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[23]  Seong Jong Hong,et al.  Proof-of-concept of a multimodal laparoscope for simultaneous NIR/gamma/visible imaging using wavelength division multiplexing. , 2018, Optics express.

[24]  O. Minet,et al.  Synergy of Fluorescence and Near-Infrared Spectroscopy in Detection of Colorectal Cancer. , 2019, The Journal of surgical research.

[25]  Anouk L. Post,et al.  Imaging depth variations in hyperspectral imaging: Development of a method to detect tumor up to the required tumor‐free margin width , 2019, Journal of biophotonics.

[26]  Esther Kho,et al.  Hyperspectral Imaging for Resection Margin Assessment during Cancer Surgery , 2019, Clinical Cancer Research.

[27]  A. Jemal,et al.  Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries , 2021, CA: a cancer journal for clinicians.

[28]  K. Soga,et al.  Visualization of quantitative lipid distribution in mouse liver through near-infrared hyperspectral imaging. , 2021, Biomedical optics express.

[29]  H. Takemura,et al.  Wavelength Bands Reduction Method in Near-Infrared Hyperspectral Image based on Deep Neural Network for Tumor Lesion Classification , 2021 .

[30]  M. Maeda,et al.  Cancer-targeted near infrared imaging using rare earth ion-doped ceramic nanoparticles. , 2015, Biomaterials science.

[31]  Hongjun Wang,et al.  Tongue Tumor Detection in Medical Hyperspectral Images , 2011, Sensors.

[32]  Mai Kasai,et al.  In Vivo Tumor Spatial Classification using PCA and K-Means with NIR-Hyperspectral Data , 2016 .