Applying machine learning to optical coherence tomography images for automated tissue classification in brain metastases

A precise resection of the entire tumor tissue during surgery for brain metastases is essential to reduce local recurrence. Conventional intraoperative imaging techniques all have limitations in detecting tumor remnants. Therefore, there is a need for innovative new imaging methods such as optical coherence tomography (OCT). The purpose of this study is to discriminate brain metastases from healthy brain tissue in an ex vivo setting by applying texture analysis and machine learning algorithms for tissue classification to OCT images. Tumor and healthy tissue samples were collected during resection of brain metastases. Samples were imaged using OCT. Texture features were extracted from B-scans. Then, a machine learning algorithm using principal component analysis (PCA) and support vector machines (SVM) was applied to the OCT scans for classification. As a gold standard, an experienced pathologist examined the tissue samples histologically and determined the percentage of vital tumor, necrosis and healthy tissue of each sample. A total of 14.336 B-scans from 14 tissue samples were included in the classification analysis. We were able to discriminate vital tumor from healthy brain tissue with an accuracy of 95.75%. By comparing necrotic tissue and healthy tissue, a classification accuracy of 99.10% was obtained. A generalized classification between brain metastases (vital tumor and necrosis) and healthy tissue was achieved with an accuracy of 96.83%. An automated classification of brain metastases and healthy brain tissue is feasible using OCT imaging, extracted texture features and machine learning with PCA and SVM. The established approach can prospectively provide the surgeon with additional information about the tissue, thus optimizing the extent of tumor resection and minimizing the risk of local recurrences.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  A. Giese,et al.  Time‐domain and spectral‐domain optical coherence tomography in the analysis of brain tumor tissue , 2006, Lasers in surgery and medicine.

[3]  Wei Chang,et al.  Classification of human stomach cancer using morphological feature analysis from optical coherence tomography images , 2019, Laser Physics Letters.

[4]  Di Huang,et al.  Local Binary Patterns and Its Application to Facial Image Analysis: A Survey , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  Angelika Unterhuber,et al.  Imaging ex vivo healthy and pathological human brain tissue with ultra-high-resolution optical coherence tomography. , 2005, Journal of biomedical optics.

[6]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[7]  J. Izatt,et al.  Optical coherence microscopy in gastrointestinal tissues , 1996, Summaries of papers presented at the Conference on Lasers and Electro-Optics.

[8]  B. Devaux,et al.  Imaging of non-tumorous and tumorous human brain tissues with full-field optical coherence tomography☆ , 2013, NeuroImage: Clinical.

[9]  G. Unsgaard,et al.  Ability of navigated 3D ultrasound to delineate gliomas and metastases – comparison of image interpretations with histopathology , 2005, Acta Neurochirurgica.

[10]  Kirsten Schmieder,et al.  Automated differentiation between meningioma and healthy brain tissue based on optical coherence tomography ex vivo images using texture features , 2018, Journal of biomedical optics.

[11]  H. Steiger,et al.  Incidence of local in-brain progression after supramarginal resection of cerebral metastases , 2015, Acta Neurochirurgica.

[12]  M. Sperling,et al.  Reevaluation of Surgery for the Treatment of Brain Metastases: Review of 208 Patients with Single or Multiple Brain Metastases Treated at One Institution with Modern Neurosurgical Techniques , 2005, Neurosurgery.

[13]  H H Wolff,et al.  Changes in function and morphology of normal human skin: evaluation using optical coherence tomography , 2004, The British journal of dermatology.

[14]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[15]  Mary M. Galloway,et al.  Texture analysis using gray level run lengths , 1974 .

[16]  A. Grosu,et al.  Local control and possibility of tailored salvage after hypofractionated stereotactic radiotherapy of the cavity after brain metastases resection , 2018, Cancer medicine.

[17]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[18]  T. Tkaczyk,et al.  Texture analysis of optical coherence tomography images: feasibility for tissue classification. , 2003, Journal of biomedical optics.

[19]  T. Kiehl,et al.  Measuring the optical characteristics of medulloblastoma with optical coherence tomography. , 2015, Biomedical optics express.

[20]  M. Proescholdt,et al.  Surgical Resection of Brain Metastases—Impact on Neurological Outcome , 2013, International journal of molecular sciences.

[21]  M. Mut Surgical treatment of brain metastasis: A review , 2012, Clinical Neurology and Neurosurgery.

[22]  R. Sawaya,et al.  Management of brain metastases: the indispensable role of surgery , 2009, Journal of Neuro-Oncology.

[23]  Ton G van Leeuwen,et al.  Pilot feasibility study of in vivo intraoperative quantitative optical coherence tomography of human brain tissue during glioma resection , 2019, Journal of biophotonics.

[24]  Raymond Sawaya,et al.  Factors influencing the risk of local recurrence after resection of a single brain metastasis. , 2010, Journal of neurosurgery.

[25]  Jie Zhou,et al.  Feasibility evaluation of micro-optical coherence tomography (μOCT) for rapid brain tumor type and grade discriminations: μOCT images versus pathology , 2019, BMC Medical Imaging.

[26]  Jill S Barnholtz-Sloan,et al.  Incidence proportions of brain metastases in patients diagnosed (1973 to 2001) in the Metropolitan Detroit Cancer Surveillance System. , 2004, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[27]  James G. Fujimoto,et al.  Feasibility of optical coherence tomography for high-resolution imaging of human gastrointestinal tract malignancies , 2000, Journal of Gastroenterology.

[28]  Eva Lankenau,et al.  iOCT with surgical microscopes: a new imaging during microsurgery , 2013 .

[29]  Xingde Li,et al.  Robust and fast characterization of OCT-based optical attenuation using a novel frequency-domain algorithm for brain cancer detection , 2017, Scientific Reports.

[30]  E. Lankenau,et al.  Imaging of human brain tumor tissue by near-infrared laser coherence tomography , 2009, Acta Neurochirurgica.

[31]  E. McVeigh,et al.  Detection of human brain cancer infiltration ex vivo and in vivo using quantitative optical coherence tomography , 2015, Science Translational Medicine.

[32]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[33]  T G van Leeuwen,et al.  Optical Coherence Tomography as a Tool for In Vivo Staging and Grading of Upper Urinary Tract Urothelial Carcinoma: A Study of Diagnostic Accuracy. , 2016, The Journal of urology.

[34]  I. Vitkin,et al.  Texture analysis of optical coherence tomography speckle for characterizing biological tissues in vivo. , 2013, Optics letters.

[35]  B E Bouma,et al.  Optical coherence tomography in the gastrointestinal tract. , 2000, Endoscopy.

[36]  James D. Murphy,et al.  Cost-effectiveness of Intraoperative MRI for Treatment of High-Grade Gliomas. , 2019, Radiology.

[37]  Rudolf Fahlbusch,et al.  Reliability of intraoperative high-resolution 2D ultrasound as an alternative to high-field strength MR imaging for tumor resection control: a prospective comparative study. , 2009, Journal of neurosurgery.

[38]  L. Bernstein,et al.  Intraoperative brain cancer detection with Raman spectroscopy in humans , 2015, Science Translational Medicine.

[39]  J. Uhm Adjuvant Whole-Brain Radiotherapy Versus Observation After Radiosurgery or Surgical Resection of One to Three Cerebral Metastases: Results of the EORTC 22952-26001 Study , 2012 .

[40]  Dirk Faber,et al.  Functional optical coherence tomography : spatially resolved measurements of optical properties , 2005 .

[41]  Gang Zhao,et al.  Polarization-Sensitive Optical Coherence Tomography for Brain Tumor Characterization , 2019, IEEE Journal of Selected Topics in Quantum Electronics.

[42]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[43]  J. Posner,et al.  Brain metastases: epidemiology and pathophysiology , 2005, Journal of Neuro-Oncology.

[44]  Thilo Gambichler,et al.  Characterization of benign and malignant melanocytic skin lesions using optical coherence tomography in vivo. , 2007, Journal of the American Academy of Dermatology.

[45]  Veit Rohde,et al.  Intraoperative 3-dimensional ultrasound for resection control during brain tumour removal: preliminary results of a prospective randomized study. , 2011, Acta neurochirurgica. Supplement.

[46]  H. Liao,et al.  Optical coherence tomography for precision brain imaging, neurosurgical guidance and minimally invasive theranostics. , 2018, Bioscience trends.

[47]  Stuart K Williams,et al.  Texture analysis of speckle in optical coherence tomography images of tissue phantoms. , 2006, Physics in medicine and biology.

[48]  Derek W. Yecies,et al.  Speckle modulation enables high-resolution wide-field human brain tumor margin detection and in vivo murine neuroimaging , 2019, Scientific Reports.