Automatic cellularity assessment from post‐treated breast surgical specimens

Neoadjuvant treatment (NAT) of breast cancer (BCa) is an option for patients with the locally advanced disease. It has been compared with standard adjuvant therapy with the aim of improving prognosis and surgical outcome. Moreover, the response of the tumor to the therapy provides useful information for patient management. The pathological examination of the tissue sections after surgery is the gold‐standard to estimate the residual tumor and the assessment of cellularity is an important component of tumor burden assessment. In the current clinical practice, tumor cellularity is manually estimated by pathologists on hematoxylin and eosin (H&E) stained slides, the quality, and reliability of which might be impaired by inter‐observer variability which potentially affects prognostic power assessment in NAT trials. This procedure is also qualitative and time‐consuming. In this paper, we describe a method of automatically assessing cellularity. A pipeline to automatically segment nuclei figures and estimate residual cancer cellularity from within patches and whole slide images (WSIs) of BCa was developed. We have compared the performance of our proposed pipeline in estimating residual cancer cellularity with that of two expert pathologists. We found an intra‐class agreement coefficient (ICC) of 0.89 (95% CI of [0.70, 0.95]) between pathologists, 0.74 (95% CI of [0.70, 0.77]) between pathologist #1 and proposed method, and 0.75 (95% CI of [0.71, 0.79]) between pathologist #2 and proposed method. We have also successfully applied our proposed technique on a WSI to locate areas with high concentration of residual cancer. The main advantage of our approach is that it is fully automatic and can be used to find areas with high cellularity in WSIs. This provides a first step in developing an automatic technique for post‐NAT tumor response assessment from pathology slides. © 2017 International Society for Advancement of Cytometry

[1]  Mehrdad J. Gangeh,et al.  Triaging Diagnostically Relevant Regions from Pathology Whole Slides of Breast Cancer: A Texture Based Approach , 2016, IEEE Transactions on Medical Imaging.

[2]  A. Jemal,et al.  Cancer statistics, 2016 , 2016, CA: a cancer journal for clinicians.

[3]  Stefan M Willems,et al.  The estimation of tumor cell percentage for molecular testing by pathologists is not accurate , 2014, Modern Pathology.

[4]  Christos Hatzis,et al.  Measurement of residual breast cancer burden to predict survival after neoadjuvant chemotherapy. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[5]  A M Thompson,et al.  Neoadjuvant treatment of breast cancer. , 2012, Annals of oncology : official journal of the European Society for Medical Oncology.

[6]  Zhuowen Tu,et al.  Auto-Context and Its Application to High-Level Vision Tasks and 3D Brain Image Segmentation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  S. Pinder,et al.  An audit of residual cancer burden reproducibility in a UK context , 2017, Histopathology.

[8]  Daniel F Hayes,et al.  Defining the benefits of neoadjuvant chemotherapy for breast cancer. , 2012, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[9]  H. Irshad,et al.  Methods for Nuclei Detection, Segmentation, and Classification in Digital Histopathology: A Review—Current Status and Future Potential , 2014, IEEE Reviews in Biomedical Engineering.

[10]  Xiaobo Zhou,et al.  Nuclei Segmentation Using Marker-Controlled Watershed, Tracking Using Mean-Shift, and Kalman Filter in Time-Lapse Microscopy , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[11]  J P Vink,et al.  Efficient nucleus detector in histopathology images , 2013, Journal of microscopy.

[12]  F. Penault-Llorca,et al.  Measurement of residual disease after neoadjuvant chemotherapy. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[13]  D. Carraro,et al.  Ductal carcinoma in situ of the breast: morphological and molecular features implicated in progression , 2013, Bioscience reports.

[14]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[15]  Anant Madabhushi,et al.  Automated grading of breast cancer histopathology using spectral clustering with textural and architectural image features , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[16]  P. Hermanek,et al.  Residual tumor (R) classification and prognosis. , 1994, Seminars in surgical oncology.

[17]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[18]  V. Goh,et al.  Phase Ib trial of radiotherapy in combination with combretastatin-A4-phosphate in patients with non-small-cell lung cancer, prostate adenocarcinoma, and squamous cell carcinoma of the head and neck. , 2012, Annals of oncology : official journal of the European Society for Medical Oncology.

[19]  Bruce J. Aronow,et al.  A study on feature extraction and disease stage classification for Glioma pathology images , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[20]  P. Fasching,et al.  Definition and impact of pathologic complete response on prognosis after neoadjuvant chemotherapy in various intrinsic breast cancer subtypes. , 2012, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[21]  Gustavo K. Rohde,et al.  Detecting and segmenting cell nuclei in two-dimensional microscopy images , 2016, Journal of pathology informatics.

[22]  Anne L. Martel,et al.  Automatic cell detection and segmentation from H and E stained pathology slides using colorspace decorrelation stretching , 2016, SPIE Medical Imaging.

[23]  Brian C. Lovell,et al.  Unsupervised cell nucleus segmentation with active contours , 1998, Signal Process..

[24]  G. Hortobagyi,et al.  Ten-Year Outcomes of Patients With Breast Cancer With Cytologically Confirmed Axillary Lymph Node Metastases and Pathologic Complete Response After Primary Systemic Chemotherapy. , 2016, JAMA oncology.

[25]  Nicolas Loménie,et al.  Point set morphological filtering and semantic spatial configuration modeling: Application to microscopic image and bio-structure analysis , 2012, Pattern Recognit..

[26]  Jiawei Han,et al.  Generalized Fisher Score for Feature Selection , 2011, UAI.

[27]  Todd H. Stokes,et al.  Pathology imaging informatics for quantitative analysis of whole-slide images , 2013, Journal of the American Medical Informatics Association : JAMIA.

[28]  Z. Nahleh,et al.  Residual cancer burden in locally advanced breast cancer: a superior tool , 2008, Current oncology.

[29]  Mattias Rantalainen,et al.  Digital image analysis outperforms manual biomarker assessment in breast cancer , 2016, Modern Pathology.

[30]  N. Dubrawsky Cancer statistics , 1989, CA: a cancer journal for clinicians.

[31]  Yousef Al-Kofahi,et al.  Improved Automatic Detection and Segmentation of Cell Nuclei in Histopathology Images , 2010, IEEE Transactions on Biomedical Engineering.

[32]  N. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[33]  Daniel Heim,et al.  Detection and Segmentation of Cell Nuclei in Virtual Microscopy Images: A Minimum-Model Approach , 2012, Scientific Reports.

[34]  Nasir M. Rajpoot,et al.  A Spatially Constrained Deep Learning Framework for Detection of Epithelial Tumor Nuclei in Cancer Histology Images , 2015, Patch-MI@MICCAI.

[35]  N. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Transactions on Medical Imaging.

[36]  Roman Rouzier,et al.  Change in tumor cellularity of breast carcinoma after neoadjuvant chemotherapy as a variable in the pathologic assessment of response , 2004, Cancer.

[37]  Giorgio Roffo,et al.  Report: Feature Selection Techniques for Classification , 2016, ArXiv.

[38]  S. Singletary,et al.  Accuracy of Physical Examination, Ultrasonography, and Mammography in Predicting Residual Pathologic Tumor Size in Patients Treated With Neoadjuvant Chemotherapy , 2006, Annals of surgery.

[39]  Chanho Jung,et al.  Unsupervised Segmentation of Overlapped Nuclei Using Bayesian Classification , 2010, IEEE Transactions on Biomedical Engineering.

[40]  F. Markowetz,et al.  Quantitative Image Analysis of Cellular Heterogeneity in Breast Tumors Complements Genomic Profiling , 2012, Science Translational Medicine.

[41]  Li WangDong-Chen He,et al.  Texture classification using texture spectrum , 1990, Pattern Recognit..

[42]  Robert F Murphy,et al.  From quantitative microscopy to automated image understanding. , 2004, Journal of biomedical optics.

[43]  Hui Zhi,et al.  Ultrasonic Elastography Features of Phyllodes Tumors of the Breast: A Clinical Research , 2014, PloS one.

[44]  Anne L. Martel,et al.  Clustering Analysis for Semi-supervised Learning Improves Classification Performance of Digital Pathology , 2015, MLMI.

[45]  I Cavill,et al.  Assessment of cellularity in bone marrow fragments , 1983, Journal of clinical pathology.

[46]  H. Sagili,et al.  Study of tumour cellularity in locally advanced breast carcinoma on neo-adjuvant chemotherapy. , 2014, Journal of clinical and diagnostic research : JCDR.

[47]  S. Lester,et al.  Pathology of breast carcinomas after neoadjuvant chemotherapy: an overview with recommendations on specimen processing and reporting. , 2009, Archives of pathology & laboratory medicine.

[48]  Aymen Mouelhi,et al.  Author's Personal Copy Biomedical Signal Processing and Control Automatic Image Segmentation of Nuclear Stained Breast Tissue Sections Using Color Active Contour Model and an Improved Watershed Method , 2022 .

[49]  Christos Hatzis,et al.  Reproducibility of residual cancer burden for prognostic assessment of breast cancer after neoadjuvant chemotherapy , 2015, Modern Pathology.

[50]  Meng Wang,et al.  Novel cell segmentation and online SVM for cell cycle phase identification in automated microscopy , 2008, Bioinform..

[51]  Soo-Hong Kim,et al.  Analysis of breast cancer using data mining & statistical techniques , 2005, Sixth International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing and First ACIS International Workshop on Self-Assembling Wireless Network.

[52]  Yongming Li,et al.  Automatic cell nuclei segmentation and classification of breast cancer histopathology images , 2016, Signal Process..

[53]  B Weyn,et al.  Automated breast tumor diagnosis and grading based on wavelet chromatin texture description. , 1998, Cytometry.

[54]  Roman Monczak,et al.  Computer-Aided Breast Cancer Diagnosis Based on the Analysis of Cytological Images of Fine Needle Biopsies , 2013, IEEE Transactions on Medical Imaging.

[55]  C. Park,et al.  Pathologic Evaluation of Breast Cancer after Neoadjuvant Therapy , 2016, Journal of pathology and translational medicine.

[56]  M. J. van de Vijver,et al.  Breast cancer response to neoadjuvant chemotherapy: predictive markers and relation with outcome , 2003, British Journal of Cancer.

[57]  Constantine Katsinis,et al.  Large-scale computations on histology images reveal grade-differentiating parameters for breast cancer , 2006, BMC Medical Imaging.

[58]  Andrew Janowczyk,et al.  Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases , 2016, Journal of pathology informatics.

[59]  Andreas Makris,et al.  Recommendations from an international expert panel on the use of neoadjuvant (primary) systemic treatment of operable breast cancer: an update. , 2006, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[60]  Jagath C. Rajapakse,et al.  Segmentation of Clustered Nuclei With Shape Markers and Marking Function , 2009, IEEE Transactions on Biomedical Engineering.

[61]  Eric Cosatto,et al.  Quantitative nucleic features are effective for discrimination of intraductal proliferative lesions of the breast , 2016, Journal of pathology informatics.

[62]  Andrew Janowczyk,et al.  A deep learning based strategy for identifying and associating mitotic activity with gene expression derived risk categories in estrogen receptor positive breast cancers , 2017, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[63]  Hala H. Zayed,et al.  Remote Computer-Aided Breast Cancer Detection and Diagnosis System Based on Cytological Images , 2014, IEEE Systems Journal.

[64]  L. Esserman,et al.  Standardization of pathologic evaluation and reporting of postneoadjuvant specimens in clinical trials of breast cancer: recommendations from an international working group , 2015, Modern Pathology.

[65]  A. Huisman,et al.  Automatic Nuclei Segmentation in H&E Stained Breast Cancer Histopathology Images , 2013, PloS one.

[66]  B. S. Manjunath,et al.  Use of imperfectly segmented nuclei in the classification of histopathology images of breast cancer , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[67]  Ziba Gandomkar,et al.  Computer-based image analysis in breast pathology , 2016, Journal of pathology informatics.

[68]  M. Kaufmann,et al.  Residual cancer burden in locally advanced breast cancer: a superior tool , 2009 .

[69]  Wagner Bm The academy in 2000. , 1989 .

[70]  J. Lee,et al.  Synergistic Effect of High Charge and Energy Particle Radiation and Chronological Age on Biomarkers of Oxidative Stress and Tissue Degeneration: A Ground-Based Study Using the Vertebrate Laboratory Model Organism Oryzias latipes , 2014, PloS one.