Intraoperative margin assessment of human breast tissue in optical coherence tomography images using deep neural networks

Assessing the surgical margin during breast lumpectomy operations can avoid the need for additional surgery. Optical coherence tomography (OCT) is an imaging technique that has been proven to be efficient for this purpose. However, to avoid overloading the surgeon during the operation, automatic cancer detection at the surface of the removed tissue is needed. This work explores automated margin assessment on a sample of patient data collected at the Pathology Department, Severance Hospital (Seoul, South Korea). Some methods based on the spatial statistics of the images have been developed, but the obtained results are still far from human performance. In this work, we investigate the possibility to use deep neural networks (DNNs) for real time margin assessment, demonstrating performance significantly better than the reported literature and close to the level of a human expert. Since the goal is to detect the presence of cancer, a patch-based classification method is proposed, as it is sufficient for detection, and requires training data that is easier and cheaper to collect than for other approaches such as segmentation. For that purpose, we train a DNN architecture that was proved to be efficient for small images on patches extracted from images containing only cancer or only normal tissue as determined by pathologists in a university hospital. As the number of available images in all such studies is by necessity small relative to other deep network applications such as ImageNet, a good regularization method is needed. In this work, we propose to use a recently introduced function norm regularization that attempts to directly control the function complexity, in contrast to classical approaches such as weight decay and DropOut. As neither the code nor the data of previous results are publicly available, the obtained results are compared with reported results in the literature for a conservative comparison. Moreover, our method is applied to locally collected data on several data configurations. The reported results are the average over the different trials. The experimental results show that the use of DNNs yields significantly better results than other techniques when evaluated in terms of sensitivity, specificity, F1 score, G-mean and Matthews correlation coefficient. Function norm regularization yielded higher and more robust results than competing regularization methods. We have demonstrated a system that shows high promise for (partially) automated margin assessment of human breast tissue, Equal error rate (EER) is reduced from approximately 12% (the lowest reported in the literature) to 5% - a 58% reduction. The method is computationally feasible for intraoperative application (less than 2 s per image) at the only cost of a longer offline training time.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[3]  Edward Walker,et al.  The Real Cost of a CPU Hour , 2009, Computer.

[4]  J. Fujimoto,et al.  Ultrahigh-resolution ophthalmic optical coherence tomography , 2001, Nature Medicine.

[5]  Lee G. Wilke,et al.  Intraoperative Imprint Cytology and Frozen Section Pathology for Margin Assessment in Breast Conservation Surgery: A Systematic Review , 2012, Annals of Surgical Oncology.

[6]  Barry Cense,et al.  Spectral domain optical coherence tomography: ultra-high speed, ultra-high resolution ophthalmic imaging. , 2005, Archives of ophthalmology.

[7]  B. Eisenberg,et al.  Incidence of Gross and Microscopic Carcinoma in Specimens from Patients with Breast Cancer After Re‐Excision Lumpectomy , 1993, Annals of surgery.

[8]  Stanley R. Sternberg,et al.  Biomedical Image Processing , 1983, Computer.

[9]  Lixin Chin,et al.  Simplifying the assessment of human breast cancer by mapping a micro‐scale heterogeneity index in optical coherence elastography , 2017, Journal of biophotonics.

[10]  Edward Wylęgała,et al.  Optical coherence angiography , 2016, Medicine.

[11]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[12]  D. Sampson,et al.  Optical coherence elastography - OCT at work in tissue biomechanics [Invited]. , 2017, Biomedical optics express.

[13]  J. Fujimoto,et al.  Optical Coherence Tomography , 1991 .

[14]  M. Brezinski Optical Coherence Tomography: Principles and Applications , 2006 .

[15]  Freddy T. Nguyen,et al.  Intraoperative evaluation of breast tumor margins with optical coherence tomography. , 2009, Cancer research.

[16]  S. Nicosia,et al.  Touch preparation cytology of breast lumpectomy margins with histologic correlation. , 1991, Archives of surgery.

[17]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[18]  D. Mahvi,et al.  The role of frozen section analysis of margins during breast conservation surgery. , 1997, The cancer journal from Scientific American.

[19]  Vibhav Vineet,et al.  Conditional Random Fields as Recurrent Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[20]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[21]  S. Yun,et al.  High-speed spectral-domain optical coherence tomography at 1.3 mum wavelength. , 2003, Optics express.

[22]  Hanina Hibshoosh,et al.  Optical Coherence Tomography: A Novel Imaging Method for Post-lumpectomy Breast Margin Assessment-A Multi-reader Study. , 2018, Academic radiology.

[23]  J. Fujimoto,et al.  Fourier Domain Mode Locking (FDML): A new laser operating regime and applications for optical coherence tomography. , 2006, Optics express.

[24]  Dumitru Erhan,et al.  Deep Neural Networks for Object Detection , 2013, NIPS.

[25]  Yu Gan,et al.  Visualization and tissue classification of human breast cancer images using ultrahigh‐resolution OCT , 2017, Lasers in surgery and medicine.

[26]  Benjamin J Vakoc,et al.  Three-dimensional microscopy of the tumor microenvironment in vivo using optical frequency domain imaging , 2009, Nature Medicine.

[27]  Matthew B. Blaschko,et al.  Convolutional neural network transfer for automated glaucoma identification , 2017, Symposium on Medical Information Processing and Analysis.

[28]  S. Boppart,et al.  Computational methods for analysis of human breast tumor tissue in optical coherence tomography images. , 2006, Journal of biomedical optics.

[29]  J. Debus,et al.  A new noninvasive approach in breast cancer therapy using magnetic resonance imaging-guided focused ultrasound surgery. , 2001, Cancer research.

[30]  S. Yun,et al.  High-speed optical frequency-domain imaging. , 2003, Optics express.

[31]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[32]  Dan Savastru,et al.  Detection of breast surgical margins with optical coherence tomography imaging: a concept evaluation study , 2014, Journal of biomedical optics.

[33]  Matthew B. Blaschko,et al.  Stochastic Function Norm Regularization of Deep Networks , 2016, ArXiv.

[34]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[35]  T. Milner,et al.  Review of polarization sensitive optical coherence tomography and Stokes vector determination. , 2002, Journal of biomedical optics.

[36]  Radford M. Neal Slice Sampling , 2003, The Annals of Statistics.

[37]  Seetha Hari,et al.  Learning From Imbalanced Data , 2019, Advances in Computer and Electrical Engineering.

[38]  Sida I. Wang,et al.  Dropout Training as Adaptive Regularization , 2013, NIPS.

[39]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[40]  B. Matthews Comparison of the predicted and observed secondary structure of T4 phage lysozyme. , 1975, Biochimica et biophysica acta.

[41]  Y. Yagi,et al.  Imaging the Subcellular Structure of Human Coronary Atherosclerosis Using 1-μm Resolution Optical Coherence Tomography (μOCT) , 2011, Nature Medicine.

[42]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[43]  N. Kanopoulos,et al.  Design of an image edge detection filter using the Sobel operator , 1988, IEEE J. Solid State Circuits.

[44]  Yann LeCun,et al.  The mnist database of handwritten digits , 2005 .

[45]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[46]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[47]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[48]  Ernest Chang,et al.  Comparative study of texture features in OCT images at different scales for human breast tissue classification , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[49]  Harris Drucker,et al.  Learning algorithms for classification: A comparison on handwritten digit recognition , 1995 .

[50]  Scott C Davis,et al.  Topical dual-stain difference imaging for rapid intra-operative tumor identification in fresh specimens. , 2013, Optics letters.

[51]  Daniel X Hammer,et al.  Automated algorithm for breast tissue differentiation in optical coherence tomography. , 2009, Journal of biomedical optics.