Detection of pancreatic cancer by convolutional-neural-network-assisted spontaneous Raman spectroscopy with critical feature visualization

Pancreatic cancer is the deadliest cancer type with a five-year survival rate of less than 9%. Detection of tumor margins plays an essential role in the success of surgical resection. However, histopathological assessment is time-consuming, expensive, and labor-intensive. We constructed a lab-designed, hand-held Raman spectroscopic system that could enable intraoperative tissue diagnosis using convolutional neural network (CNN) models to efficiently distinguish between cancerous and normal pancreatic tissue. To our best knowledge, this is the first reported effort to diagnose pancreatic cancer by CNN-aided spontaneous Raman scattering with a lab-developed system designed for intraoperative applications. Classification based on the original one-dimensional (1D) Raman, two-dimensional (2D) Raman images, and the first principal component (PC1) from the principal component analysis on the 2D image, could all achieve high performance: the testing sensitivity, specificity, and accuracy were over 95%, and the area under the curve approached 0.99. Although CNN models often show great success in classification, it has always been challenging to visualize the CNN features in these models, which has never been achieved in the Raman spectroscopy application in cancer diagnosis. By studying individual Raman regions and by extracting and visualizing CNN features from max-pooling layers, we identified critical Raman peaks that could aid in the classification of cancerous and noncancerous tissues. 2D Raman PC1 yielded more critical peaks for pancreatic cancer identification than that of 1D Raman, as the Raman intensity was amplified by 2D Raman PC1. To our best knowledge, the feature visualization was achieved for the first time in the field of CNN-aided spontaneous Raman spectroscopy for cancer diagnosis. Based on these CNN feature peaks and their frequency at specific wavenumbers, pancreatic cancerous tissue was found to contain more biochemical components related to the protein contents (particularly collagen), whereas normal pancreatic tissue was found to contain more lipids and nucleic acid (particularly deoxyribonucleic acid/ribonucleic acid). Overall, the CNN model in combination with Raman spectroscopy could serve as a useful tool for the extraction of key features that can help differentiate pancreatic cancer from a normal pancreas.

[1]  Margarita Osadchy,et al.  Deep Convolutional Neural Networks for Raman Spectrum Recognition: A Unified Solution , 2017, The Analyst.

[2]  Ratna Naik,et al.  Evaluation of Pancreatic Cancer With Raman Spectroscopy in a Mouse Model , 2008, Pancreas.

[3]  B. Ramakrishna,et al.  Intraoperative Frozen Section -A Golden Tool for Diagnosis of Surgical Biopsies , 2017 .

[4]  Herman L. Offerhaus,et al.  Classifying Raman spectra of extracellular vesicles based on convolutional neural networks for prostate cancer detection , 2019, Journal of Raman Spectroscopy.

[5]  Carlos Caldas,et al.  A new genome‐driven integrated classification of breast cancer and its implications , 2013, The EMBO journal.

[6]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[7]  Yan Zhou,et al.  Human brain cancer studied by resonance Raman spectroscopy , 2012, Journal of biomedical optics.

[8]  Julius Emons,et al.  Breast Tumor Analysis Using Shifted-Excitation Raman Difference Spectroscopy (SERDS) , 2018, Technology in cancer research & treatment.

[9]  Christopher J. Frank,et al.  Raman spectroscopy of normal and diseased human breast tissues. , 1995, Analytical chemistry.

[10]  D. Mareš,et al.  Precise cancer detection via the combination of functionalized SERS surfaces and convolutional neural network with independent inputs , 2020 .

[11]  Honglak Lee,et al.  Near real-time intraoperative brain tumor diagnosis using stimulated Raman histology and deep neural networks , 2019, Nature Medicine.

[12]  Vincent Mazet,et al.  Background removal from spectra by designing and minimising a non-quadratic cost function , 2005 .

[13]  H. Lui,et al.  Raman spectroscopy for optical diagnosis in normal and cancerous tissue of the nasopharynx—preliminary findings , 2003, Lasers in surgery and medicine.

[14]  E. Casper Pancreatic cancer: how can we progress? , 1993, European journal of cancer.

[15]  Nicole M. Ralbovsky,et al.  Towards development of a novel universal medical diagnostic method: Raman spectroscopy and machine learning. , 2020, Chemical Society reviews.

[16]  Bing Zhao,et al.  Detection of Pesticide Residues in Food Using Surface-Enhanced Raman Spectroscopy: A Review. , 2017, Journal of agricultural and food chemistry.

[17]  Eliana Cordero,et al.  Evaluation of Shifted Excitation Raman Difference Spectroscopy and Comparison to Computational Background Correction Methods Applied to Biochemical Raman Spectra , 2017, Sensors.

[18]  T. Gansler,et al.  Characterization of human breast biopsy specimens with near-IR Raman spectroscopy. , 1994, Analytical chemistry.

[19]  Jean-Michel Roger,et al.  Application of independent component analysis on Raman images of a pharmaceutical drug product: pure spectra determination and spatial distribution of constituents. , 2014, Journal of pharmaceutical and biomedical analysis.

[20]  Yong Fan,et al.  A deep learning model integrating FCNNs and CRFs for brain tumor segmentation , 2017, Medical Image Anal..

[21]  A. Marcus,et al.  uPAR-targeted Optical Imaging Contrasts as Theranostic Agents for Tumor Margin Detection , 2013, Theranostics.

[22]  M. Feld,et al.  Raman Spectroscopy and Fluorescence Photon Migration for Breast Cancer Diagnosis and Imaging , 1998, Photochemistry and photobiology.

[23]  A. Gramacki,et al.  Breast cancer nuclei segmentation and classification based on a deep learning approach , 2021, Int. J. Appl. Math. Comput. Sci..

[24]  Anita Mahadevan-Jansen,et al.  Clinical instrumentation and applications of Raman spectroscopy. , 2016, Chemical Society reviews.

[25]  Nikolaos Kourkoumelis,et al.  Advances in the in Vivo Raman Spectroscopy of Malignant Skin Tumors Using Portable Instrumentation , 2015, International journal of molecular sciences.

[26]  Hugh Barr,et al.  Near‐infrared Raman spectroscopy for the classification of epithelial pre‐cancers and cancers , 2002 .

[27]  H. Barr,et al.  Raman spectroscopy for identification of epithelial cancers. , 2004, Faraday discussions.

[28]  Hartwig Schulz,et al.  Identification and quantification of valuable plant substances by IR and Raman spectroscopy , 2007 .

[29]  Yoshihiro Maruyama,et al.  Feature visualization of Raman spectrum analysis with deep convolutional neural network , 2019, Analytica chimica acta.

[30]  L L Hench,et al.  Discrimination between ricin and sulphur mustard toxicity in vitro using Raman spectroscopy , 2004, Journal of The Royal Society Interface.

[31]  Dairene Uy,et al.  Principal component analysis of Raman spectra from phosphorus-poisoned automotive exhaust-gas catalysts , 2005 .

[32]  S. Dey,et al.  Chemometric analysis of integrated FTIR and Raman spectra obtained by non-invasive exfoliative cytology for the screening of oral cancer. , 2019, The Analyst.

[33]  H. Byrne,et al.  Raman spectroscopic analysis of oral cells in the high wavenumber region. , 2017, Experimental and molecular pathology.

[34]  Hein Putter,et al.  Current and Future Intraoperative Imaging Strategies to Increase Radical Resection Rates in Pancreatic Cancer Surgery , 2014, BioMed research international.

[35]  S. Lane,et al.  Micro-Raman spectroscopy detects individual neoplastic and normal hematopoietic cells. , 2006, Biophysical journal.

[36]  Stephen T. C. Wong,et al.  Combining deep learning and coherent anti-Stokes Raman scattering imaging for automated differential diagnosis of lung cancer , 2017, Journal of biomedical optics.

[37]  Yanqing Wang,et al.  Deep convolutional neural networks combine Raman spectral signature of serum for prostate cancer bone metastases screening. , 2020, Nanomedicine : nanotechnology, biology, and medicine.

[38]  Zhonghua Deng,et al.  Single upper limb pose estimation method based on improved stacked hourglass network , 2020, ArXiv.

[39]  H. Jaafar Intra-operative frozen section consultation: concepts, applications and limitations. , 2006, The Malaysian journal of medical sciences : MJMS.

[40]  C. Frausto-Reyes,et al.  Application of principal component analysis and Raman spectroscopy in the analysis of polycrystalline BaTiO3 at high pressure. , 2007, Spectrochimica acta. Part A, Molecular and biomolecular spectroscopy.

[41]  Zhimin Zhang,et al.  Deep learning-based component identification for the Raman spectra of mixtures. , 2019, The Analyst.

[42]  Soogeun Kim,et al.  Single‐layer multiple‐kernel‐based convolutional neural network for biological Raman spectral analysis , 2020 .

[43]  Lili Zhang,et al.  Rapid histology of laryngeal squamous cell carcinoma with deep-learning based stimulated Raman scattering microscopy , 2019, Theranostics.

[44]  Wen-ting Cheng,et al.  Micro‐Raman spectroscopy used to identify and grade human skin pilomatrixoma , 2005, Microscopy research and technique.

[45]  Jean-Francois Masson,et al.  Deep learning and artificial intelligence methods for Raman and surface-enhanced Raman scattering , 2020, TrAC Trends in Analytical Chemistry.

[46]  Naif Alajlan,et al.  Deep learning approach for active classification of electrocardiogram signals , 2016, Inf. Sci..

[47]  Havva Tümay Temiz,et al.  A novel method for discrimination of beef and horsemeat using Raman spectroscopy. , 2014, Food chemistry.

[48]  C. Du,et al.  Assessment of physiological responses and growth phases of different microalgae under environmental changes by Raman spectroscopy with chemometrics. , 2018, Spectrochimica acta. Part A, Molecular and biomolecular spectroscopy.