Automatic detection of head and neck squamous cell carcinoma on pathologic slides using polarized hyperspectral imaging and machine learning

The aim of this study is to incorporate polarized hyperspectral imaging (PHSI) with machine learning for automatic detection of head and neck cancer on H&E stained tissue slides. A polarized hyperspectral imaging microscope had been developed in our group. The preliminary results showed that the spectral curves of the Stokes vector parameters (S0, S1, S2, S3) on the H&E stained tissue slides with squamous cell carcinoma (SCC) from the larynx are different from normal tissue in certain wavelength range. In this paper, we imaged 20 H&E stained tissue slides from 10 patients with SCC of the larynx by the PHSI microscope. Several machine learning algorithms (support vector machine, random forest, Gaussian naive Bayes, logistic regression) were applied to the collected image data for the automatic detection of SCC on the H&E stained tissue slides. The performance of these methods was compared among the collected polarized hyperspectral imaging dataset of tissue slides, the pseudo RGB images generated from the polarized hyperspectral imaging dataset, and the principle component analysis (PCA) transformation of the polarized hyperspectral imaging dataset. The results suggest that SVM is a superior classifier for the classification task based on polarized hyperspectral data cubes compared to the other three types of classifiers. Furthermore, the incorporation of the four Stokes vector parameters improved the classification accuracy. Finally, the PCA transformed image data did not improve the accuracy as it might lose some important information from the original polarized hyperspectral data cube. Polarized hyperspectral imaging can have many potential applications in digital pathology.

[1]  R. Webster,et al.  Image-Guided Procedures, Robotic Interventions, and Modeling , 2012 .

[2]  Liang Gao,et al.  A review of snapshot multidimensional optical imaging: measuring photon tags in parallel. , 2016, Physics reports.

[3]  Angelo Pierangelo,et al.  Polarimetric imaging of uterine cervix: a case study. , 2013, Optics express.

[4]  Martin Halicek,et al.  Hyperspectral microscopic imaging for automatic detection of head and neck squamous cell carcinoma using histologic image and machine learning , 2020, Medical Imaging: Digital Pathology.

[5]  Zhiqiang Tian,et al.  Superpixel-based spectral classification for the detection of head and neck cancer with hyperspectral imaging , 2016, SPIE Medical Imaging.

[6]  A G Harris,et al.  Orthogonal polarisation spectral imaging as a new tool for the assessment of antivascular tumour treatment in vivo: a validation study , 2002, British Journal of Cancer.

[7]  Martin Halicek,et al.  Optical biopsy of head and neck cancer using hyperspectral imaging and convolutional neural networks , 2018, BiOS.

[8]  Igor Meglinski,et al.  Application of circularly polarized light for non‐invasive diagnosis of cancerous tissues and turbid tissue‐like scattering media , 2015, Journal of biophotonics.

[9]  Hui Ma,et al.  Mueller polarimetric imaging for characterizing the collagen microstructures of breast cancer tissues in different genotypes , 2019, Optics Communications.

[10]  E. Snellman,et al.  Hyperspectral imaging system in the delineation of Ill‐defined basal cell carcinomas: a pilot study , 2018, Journal of the European Academy of Dermatology and Venereology : JEADV.

[11]  Ye Wang,et al.  Division of focal plane polarimeter-based 3 × 4 Mueller matrix microscope: a potential tool for quick diagnosis of human carcinoma tissues , 2016, Journal of biomedical optics.

[12]  Baowei Fei,et al.  Hyperspectral and multispectral imaging in digital and computational pathology: a systematic review [Invited]. , 2020, Biomedical optics express.

[13]  John E. Tomaszewski,et al.  Digital Pathology , 2020, Lecture Notes in Computer Science.

[14]  Baowei Fei,et al.  Tumor detection of the thyroid and salivary glands using hyperspectral imaging and deep learning. , 2020, Biomedical optics express.

[15]  Hui Ma,et al.  Quantitatively characterizing the microstructural features of breast ductal carcinoma tissues in different progression stages by Mueller matrix microscope. , 2017, Biomedical optics express.

[16]  Jörg Bendix,et al.  Development of an image pre‐processor for operational hyperspectral laryngeal cancer detection , 2016, Journal of biophotonics.

[17]  Jörg Bendix,et al.  Hyperspectral Imaging Using Flexible Endoscopy for Laryngeal Cancer Detection , 2016, Sensors.

[18]  Dongsheng Wang,et al.  Hyperspectral imaging for cancer surgical margin delineation: registration of hyperspectral and histological images , 2014, Medical Imaging.

[19]  Xu Wang,et al.  Tumor margin classification of head and neck cancer using hyperspectral imaging and convolutional neural networks , 2018, Medical Imaging.

[20]  James V. Little,et al.  Detection of Head and Neck Cancer in Surgical Specimens Using Quantitative Hyperspectral Imaging , 2017, Clinical Cancer Research.

[21]  Martin T. Halicek,et al.  Hyperspectral Imaging of Head and Neck Squamous Cell Carcinoma for Cancer Margin Detection in Surgical Specimens from 102 Patients Using Deep Learning , 2019, Cancers.

[22]  R. Richards-Kortum,et al.  Multispectral optical imaging device for in vivo detection of oral neoplasia. , 2008, Journal of biomedical optics.

[23]  L V Wang,et al.  Light backscattering polarization patterns from turbid media: theory and experiment. , 1999, Applied optics.

[24]  I. Meglinski,et al.  Colon cancer detection by using Poincaré sphere and 2D polarimetric mapping of ex vivo colon samples , 2020, Journal of biophotonics.

[25]  R. Fisher,et al.  Head and Neck Squamous Cell Carcinoma , 2020, Definitions.

[26]  Dongsheng Wang,et al.  A Minimum Spanning Forest-Based Method for Noninvasive Cancer Detection With Hyperspectral Imaging , 2016, IEEE Transactions on Biomedical Engineering.

[27]  Guolan Lu,et al.  Spectral-spatial classification using tensor modeling for cancer detection with hyperspectral imaging , 2014, Medical Imaging.

[28]  R. Anderson Polarized light examination and photography of the skin. , 1991, Archives of dermatology.

[29]  Martin Halicek,et al.  Development of a new polarized hyperspectral imaging microscope , 2020, BiOS.

[30]  M. K. Swami,et al.  Polarized diffuse reflectance measurements on cancerous and noncancerous tissues , 2009, Journal of biophotonics.

[31]  Konstantin B Yushkov,et al.  Hyperspectral imaging acousto-optic system with spatial filtering for optical phase visualization , 2017, Journal of biomedical optics.

[32]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[33]  Dongsheng Wang,et al.  A minimum spanning forest based hyperspectral image classification method for cancerous tissue detection , 2014, Medical Imaging.

[34]  Guolan Lu,et al.  Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging , 2017, Journal of biomedical optics.

[35]  Can Ince,et al.  Orthogonal polarization spectral (OPS) imaging and topographical characteristics of oral squamous cell carcinoma. , 2006, Oral oncology.

[36]  Rolf B. Saager,et al.  Polarization-Sensitive Hyperspectral Imaging in vivo: A Multimode Dermoscope for Skin Analysis , 2014, Scientific Reports.

[37]  Guolan Lu,et al.  Estimation of tissue optical parameters with hyperspectral imaging and spectral unmixing , 2015, Medical Imaging.

[38]  Zhongping Chen,et al.  Use of polar decomposition for the diagnosis of oral precancer. , 2007, Applied optics.

[39]  Wei Zheng,et al.  Polarization-resolved hyperspectral stimulated Raman scattering microscopy for label-free biomolecular imaging of the tooth , 2016 .