Polarimetric imaging for cervical pre-cancer screening aided by machine learning: ex vivo studies

Abstract. Significance Wide-field imaging Mueller polarimetry is an optical imaging technique that has great potential to become a reliable, fast, non-contact in vivo imaging modality for the early detection of, e.g., deceases and tissue structural malformations, such as cervical intraepithelial neoplasia, in both clinical and low-resource settings. On the other hand, machine learning methods have established themselves as a superior solution in image classification and regression tasks. We combine Mueller polarimetry and machine learning, critically assess the data/classification pipeline, investigate the bias arising from training strategies, and demonstrate how higher levels of detection accuracy can be achieved. Aim We aim to automate/assist with diagnostic segmentation of polarimetric images of uterine cervix specimens. Approach A comprehensive capture-to-classification pipeline is developed in house. Specimens are acquired and measured with imaging Mueller polarimeter and undergo histopathological classification. Subsequently, a labeled dataset is created within tagged regions of either healthy or neoplastic cervical tissues. Several machine learning methods are trained utilizing different training-test-set-split strategies, and their corresponding accuracies are compared. Results Our results include robust measurements of model performance with two approaches: a 90:10 training–test-set-split and leave-one-out cross-validation. By comparing the classifier’s accuracy directly with the ground truth obtained during histology analysis, we demonstrate how conventionally used shuffled split leads to an over-estimate of true classifier performance (0.964±0.00). The leave-one-out cross-validation, however, leads to more accurate performance (0.812±0.21) with respect to newly obtained samples that were not used to train the models. Conclusions Combination of Mueller polarimetry and machine learning is a powerful tool for the task of screening for pre-cancerous conditions in cervical tissue sections. Nevertheless, there is a inherent bias with conventional processes that can be addressed using more conservative classifier training approaches. This results in overall improvements of the sensitivity and specificity of the developed techniques for “unseen” images.

[1]  T. Novikova,et al.  Is a complete Mueller matrix necessary in biomedical imaging? , 2022, Optics letters.

[2]  G. Gkoutos,et al.  Machine Learning-Based Identification of Colon Cancer Candidate Diagnostics Genes. , 2022, Biology.

[3]  Ru-Xing Wang,et al.  Analysis of potential genetic biomarkers using machine learning methods and immune infiltration regulatory mechanisms underlying atrial fibrillation , 2021, BMC Medical Genomics.

[4]  B. Seo,et al.  Machine Learning Models That Integrate Tumor Texture and Perfusion Characteristics Using Low-Dose Breast Computed Tomography Are Promising for Predicting Histological Biomarkers and Treatment Failure in Breast Cancer Patients , 2021, Cancers.

[5]  Y. Lenbury,et al.  Survival Analysis of Cervical Cancer Patients: A Case Study of Bhutan , 2021, Asian Pacific journal of cancer prevention : APJCP.

[6]  T. Novikova,et al.  Inverse problem of Mueller polarimetry for metrological applications , 2021, Journal of Inverse and Ill-posed Problems.

[7]  Zbignevs Marcinkevics,et al.  Skin Complications of Diabetes Mellitus Revealed by Polarized Hyperspectral Imaging and Machine Learning , 2021, IEEE Transactions on Medical Imaging.

[8]  Mariacarla Gonzalez,et al.  Design and implementation of a portable colposcope Mueller matrix polarimeter , 2020, Journal of biomedical optics.

[9]  Angelo Pierangelo,et al.  Visualization of White Matter Fiber Tracts of Brain Tissue Sections With Wide-Field Imaging Mueller Polarimetry , 2020, IEEE Transactions on Medical Imaging.

[10]  Igor Meglinski,et al.  Influence of blood pulsation on diagnostic volume in pulse oximetry and photoplethysmography measurements. , 2019, Applied optics.

[11]  D. Voelz,et al.  Parameter-based imaging from passive multispectral polarimetric measurements. , 2019, Optics express.

[12]  Lydia P. Howell,et al.  Artificial Intelligence and Machine Learning in Pathology: The Present Landscape of Supervised Methods , 2019, Academic pathology.

[13]  Igor Meglinski,et al.  Hyperspectral imaging of human skin aided by artificial neural networks. , 2019, Biomedical optics express.

[14]  Igor Meglinski,et al.  Propagation of Cylindrical Vector Laser Beams in Turbid Tissue-Like Scattering Media , 2019, Photonics.

[15]  Jihad Zallat,et al.  Mueller polarimetric imaging of biological tissues: classification in a decision-theoretic framework. , 2018, Journal of the Optical Society of America. A, Optics, image science, and vision.

[16]  Angelo Pierangelo,et al.  Polarimetric measurement utility for pre-cancer detection from uterine cervix specimens. , 2018, Biomedical optics express.

[17]  Chenchen Liu,et al.  How convolutional neural networks see the world - A survey of convolutional neural network visualization methods , 2018, Math. Found. Comput..

[18]  Abien Fred Agarap Deep Learning using Rectified Linear Units (ReLU) , 2018, ArXiv.

[19]  P. Vedsted,et al.  Cervical Cancer Prevalence, Incidence and Mortality in Low and Middle Income Countries: A Systematic Review , 2018, Asian Pacific journal of cancer prevention : APJCP.

[20]  Tatiana Novikova,et al.  Optical techniques for cervical neoplasia detection , 2017, Beilstein journal of nanotechnology.

[21]  Angelo Pierangelo,et al.  Tasked-based quantification of measurement utility for ex vivo multi-spectral Mueller polarimetry of the uterine cervix , 2017, European Conference on Biomedical Optics.

[22]  Osisanwo F.Y,et al.  Supervised Machine Learning Algorithms: Classification and Comparison , 2017 .

[23]  Angelo Pierangelo,et al.  In vivo imaging of uterine cervix with a Mueller polarimetric colposcope , 2017, Scientific Reports.

[24]  Ali Borji,et al.  What are the Receptive, Effective Receptive, and Projective Fields of Neurons in Convolutional Neural Networks? , 2017, ArXiv.

[25]  Ji Qi,et al.  Mueller polarimetric imaging for surgical and diagnostic applications: a review , 2017, Journal of biophotonics.

[26]  Tatiana Novikova,et al.  Ex vivo Mueller polarimetric imaging of the uterine cervix: a first statistical evaluation , 2016, Journal of biomedical optics.

[27]  Angelo Pierangelo,et al.  Multi-spectral Mueller Matrix Imaging Polarimetry for Studies of Human Tissues , 2016 .

[28]  Ying LU,et al.  Decision tree methods: applications for classification and prediction , 2015, Shanghai archives of psychiatry.

[29]  Igor Meglinski,et al.  Application of circularly polarized light for non‐invasive diagnosis of cancerous tissues and turbid tissue‐like scattering media , 2015, Journal of biophotonics.

[30]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[31]  Vadim Backman,et al.  Two electric field Monte Carlo models of coherent backscattering of polarized light. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[32]  Valery V. Tuchin,et al.  Dermal Component–Based Optical Modeling of Skin Translucency: Impact on Skin Color , 2014 .

[33]  Vipin Kumar,et al.  Feature Selection: A literature Review , 2014, Smart Comput. Rev..

[34]  Igor Meglinski,et al.  Propagation of coherent polarized light in turbid highly scattering medium , 2014, Journal of biomedical optics.

[35]  Angelo Pierangelo,et al.  The origins of polarimetric image contrast between healthy and cancerous human colon tissue , 2013 .

[36]  A. Darwish,et al.  Reliability of Unaided Naked-Eye Examination as a Screening Test for Cervical Lesions in a Developing Country Setup , 2013, Journal of lower genital tract disease.

[37]  I. Vitkin,et al.  Optimum selection of input polarization states in determining the sample Mueller matrix: a dual photoelastic polarimeter approach. , 2012, Optics express.

[38]  Vladislav V. Yakovlev,et al.  Human tissue color as viewed in high dynamic range optical spectral transmission measurements , 2012, Biomedical optics express.

[39]  Igor Meglinski,et al.  Online object oriented Monte Carlo computational tool for the needs of biomedical optics , 2011, Biomedical optics express.

[40]  Tatiana Novikova,et al.  Overlay measurements by Mueller polarimetry in the back focal plane , 2011, Advanced Lithography.

[41]  Tatiana Novikova,et al.  Sources of possible artefacts in the contrast evaluation for the backscattering polarimetric images of different targets in turbid medium. , 2009, Optics express.

[42]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[43]  E. Unger,et al.  Human Papillomavirus and Cervical Cancer , 2004, Emerging infectious diseases.

[44]  Yang Liu,et al.  An introduction to decision tree modeling , 2004 .

[45]  Tatiana Novikova,et al.  Characterization of bidimensional gratings by spectroscopic ellipsometry and angle-resolved Mueller polarimetry. , 2004, Applied optics.

[46]  Antonello De Martino,et al.  Optimized Mueller polarimeter with liquid crystals. , 2003, Optics letters.

[47]  Jessica C Ramella-Roman,et al.  Imaging skin pathology with polarized light. , 2002, Journal of biomedical optics.

[48]  G. Kattawar,et al.  Virtues of mueller matrix imaging for underwater target detection. , 1999, Applied optics.

[49]  B. Drévillon,et al.  General and self-consistent method for the calibration of polarization modulators, polarimeters, and mueller-matrix ellipsometers. , 1999, Applied optics.

[50]  R. Chipman,et al.  Interpretation of Mueller matrices based on polar decomposition , 1996 .

[51]  J. Ross Quinlan,et al.  Learning decision tree classifiers , 1996, CSUR.

[52]  J. Royston An Extension of Shapiro and Wilk's W Test for Normality to Large Samples , 1982 .

[53]  R. C. Messenger,et al.  A Modal Search Technique for Predictive Nominal Scale Multivariate Analysis , 1972 .

[54]  J. Morgan,et al.  Problems in the Analysis of Survey Data, and a Proposal , 1963 .

[55]  C. Dolea,et al.  World Health Organization , 1949, International Organization.

[56]  T. Novikova,et al.  Introduction of a 3 × 4 Mueller matrix decomposition method , 2021, Journal of Physics D: Applied Physics.

[57]  I. Meglinski,et al.  Shedding the Polarized Light on Biological Tissues , 2021 .

[58]  Suryakanthi Tangirala,et al.  Evaluating the Impact of GINI Index and Information Gain on Classification using Decision Tree Classifier Algorithm* , 2020 .

[59]  R. Evans European Centre for Disease Prevention and Control. , 2014, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[60]  A. V. Olgac,et al.  Performance Analysis of Various Activation Functions in Generalized MLP Architectures of Neural Networks , 2011 .

[61]  A. T. C. Goh,et al.  Back-propagation neural networks for modeling complex systems , 1995, Artif. Intell. Eng..

[62]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[63]  C. V. D. Malsburg,et al.  Frank Rosenblatt: Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms , 1986 .

[64]  Richard A. Olshen,et al.  CART: Classification and Regression Trees , 1984 .