Hyperspectral Imaging for the Detection of Glioblastoma Tumor Cells in H&E Slides Using Convolutional Neural Networks

Hyperspectral imaging (HSI) technology has demonstrated potential to provide useful information about the chemical composition of tissue and its morphological features in a single image modality. Deep learning (DL) techniques have demonstrated the ability of automatic feature extraction from data for a successful classification. In this study, we exploit HSI and DL for the automatic differentiation of glioblastoma (GB) and non-tumor tissue on hematoxylin and eosin (H&E) stained histological slides of human brain tissue. GB detection is a challenging application, showing high heterogeneity in the cellular morphology across different patients. We employed an HSI microscope, with a spectral range from 400 to 1000 nm, to collect 517 HS cubes from 13 GB patients using 20× magnification. Using a convolutional neural network (CNN), we were able to automatically detect GB within the pathological slides, achieving average sensitivity and specificity values of 88% and 77%, respectively, representing an improvement of 7% and 8% respectively, as compared to the results obtained using RGB (red, green, and blue) images. This study demonstrates that the combination of hyperspectral microscopic imaging and deep learning is a promising tool for future computational pathologies.

[1]  Baowei Fei,et al.  In-Vivo and Ex-Vivo Tissue Analysis through Hyperspectral Imaging Techniques: Revealing the Invisible Features of Cancer , 2019, Cancers.

[2]  Bai Ying Lei,et al.  Accurate Segmentation of Cervical Cytoplasm and Nuclei Based on Multiscale Convolutional Network and Graph Partitioning , 2015, IEEE Transactions on Biomedical Engineering.

[3]  George Lee,et al.  Image analysis and machine learning in digital pathology: Challenges and opportunities , 2016, Medical Image Anal..

[4]  T. Flotte,et al.  Anatomical pathology is at a crossroads. , 2018, Pathology.

[5]  G. Reifenberger,et al.  The 2016 World Health Organization Classification of Tumors of the Central Nervous System: a summary , 2016, Acta Neuropathologica.

[6]  Andrew P. Bradley,et al.  The use of the area under the ROC curve in the evaluation of machine learning algorithms , 1997, Pattern Recognit..

[7]  Masahiro Ishikawa,et al.  Detection of pancreatic tumor cell nuclei via a hyperspectral analysis of pathological slides based on stain spectra. , 2019, Biomedical optics express.

[8]  Sebastián López,et al.  Hyperspectral Push-Broom Microscope Development and Characterization , 2019, IEEE Access.

[9]  George E. Dahl,et al.  Artificial Intelligence-Based Breast Cancer Nodal Metastasis Detection: Insights Into the Black Box for Pathologists. , 2018, Archives of pathology & laboratory medicine.

[10]  Jun Li,et al.  Advanced Spectral Classifiers for Hyperspectral Images: A review , 2017, IEEE Geoscience and Remote Sensing Magazine.

[11]  Tuan Bui,et al.  Multiparametric immune profiling in HPV- oral squamous cell cancer. , 2017, JCI insight.

[12]  Mei Zhou,et al.  Melanoma and Melanocyte Identification from Hyperspectral Pathology Images Using Object-Based Multiscale Analysis , 2018, Applied spectroscopy.

[13]  Fred Godtliebsen,et al.  Recent advances in hyperspectral imaging for melanoma detection , 2019, WIREs Computational Statistics.

[14]  L. Esserman,et al.  Characterizing the immune microenvironment in high-risk ductal carcinoma in situ of the breast , 2016, Breast Cancer Research and Treatment.

[15]  Camel Tanougast,et al.  Classifications of Multispectral Colorectal Cancer Tissues Using Convolution Neural Network , 2017, Journal of pathology informatics.

[16]  Roberto Sarmiento,et al.  Detecting brain tumor in pathological slides using hyperspectral imaging. , 2018, Biomedical optics express.

[17]  Bei Zhang,et al.  Perivascular cell coverage of intratumoral vasculature is a predictor for bevacizumab efficacy in metastatic colorectal cancer , 2018, Cancer management and research.

[18]  Pinky A. Bautista,et al.  Digital Staining of Unstained Pathological Tissue Samples through Spectral Transmittance Classification , 2005 .

[19]  Jon Atli Benediktsson,et al.  Deep Learning for Hyperspectral Image Classification: An Overview , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Nassir Navab,et al.  Structure-based assessment of cancerous mitochondria using deep networks , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[21]  Hadi Rezaeilouyeh,et al.  Microscopic medical image classification framework via deep learning and shearlet transform , 2016, Journal of medical imaging.

[22]  Baowei Fei,et al.  Tumor detection of the thyroid and salivary glands using hyperspectral imaging and deep learning. , 2020, Biomedical optics express.

[23]  Ruqayya Awan,et al.  Using spectral imaging for the analysis of abnormalities for colorectal cancer: When is it helpful? , 2018, PloS one.

[24]  Janne Heikkilä,et al.  Towards Virtual H&E Staining of Hyperspectral Lung Histology Images Using Conditional Generative Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[25]  Simone L Van Es,et al.  Digital pathology: semper ad meliora. , 2019, Pathology.

[26]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[27]  Anastasios Koulaouzidis,et al.  Use of Hyperspectral/Multispectral Imaging in Gastroenterology. Shedding Some–Different–Light into the Dark , 2019, Journal of clinical medicine.

[28]  Eric Cosatto,et al.  Classification of mitotic figures with convolutional neural networks and seeded blob features , 2013, Journal of pathology informatics.