MRF‐ANN: a machine learning approach for automated ER scoring of breast cancer immunohistochemical images

Molecular pathology, especially immunohistochemistry, plays an important role in evaluating hormone receptor status along with diagnosis of breast cancer. Time‐consumption and inter‐/intraobserver variability are major hindrances for evaluating the receptor score. In view of this, the paper proposes an automated Allred Scoring methodology for estrogen receptor (ER). White balancing is used to normalize the colour image taking into consideration colour variation during staining in different labs. Markov random field model with expectation‐maximization optimization is employed to segment the ER cells. The proposed segmentation methodology is found to have F‐measure 0.95. Artificial neural network is subsequently used to obtain intensity‐based score for ER cells, from pixel colour intensity features. Simultaneously, proportion score – percentage of ER positive cells is computed via cell counting. The final ER score is computed by adding intensity and proportion scores – a standard Allred scoring system followed by pathologists. The classification accuracy for classification of cells by classifier in terms of F‐measure is 0.9626. The problem of subjective interobserver ability is addressed by quantifying ER score from two expert pathologist and proposed methodology. The intraclass correlation achieved is greater than 0.90. The study has potential advantage of assisting pathologist in decision making over manual procedure and could evolve as a part of automated decision support system with other receptor scoring/analysis procedure.

[1]  J. Besag,et al.  On the estimation and testing of spatial interaction in Gaussian lattice processes , 1975 .

[2]  Muhammad Mahadi Abdul Jamil,et al.  Computer Aided System for Red Blood Cell Classification in Blood Smear Image , 2014 .

[3]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[4]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[5]  D. Allred,et al.  Prognostic and predictive factors in breast cancer by immunohistochemical analysis. , 1998, Modern pathology : an official journal of the United States and Canadian Academy of Pathology, Inc.

[6]  Yi-Ping Phoebe Chen,et al.  Cell morphology based classification for red cells in blood smear images , 2014, Pattern Recognit. Lett..

[7]  Pushmeet Kohli,et al.  Markov Random Fields for Vision and Image Processing , 2011 .

[8]  Osman Kalender,et al.  Automatic segmentation, counting, size determination and classification of white blood cells , 2014 .

[9]  Amelia Simó,et al.  Parameter estimation in Markov random field image modeling with imperfect observations. A comparative study , 2003, Pattern Recognit. Lett..

[10]  J. Besag Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[11]  Chun-Hung Lin,et al.  A Computer-Aided Diagnosis System of Breast Intraductal Lesion Using Histopathological Images , 2014, IVCNZ '14.

[12]  Lei Wang,et al.  MRF parameter estimation by MCMC method , 2000, Pattern Recognit..

[13]  Vilppu J Tuominen,et al.  ImmunoRatio: a publicly available web application for quantitative image analysis of estrogen receptor (ER), progesterone receptor (PR), and Ki-67 , 2010, Breast Cancer Research.

[14]  Yihua Yu,et al.  MRF parameter estimation by an accelerated method , 2003, Pattern Recognit. Lett..

[15]  Stan Szpakowicz,et al.  Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation , 2006, Australian Conference on Artificial Intelligence.

[16]  H. S. Bhadauria,et al.  White blood nucleus extraction using K-Mean clustering and mathematical morphing , 2014, 2014 5th International Conference - Confluence The Next Generation Information Technology Summit (Confluence).

[17]  Anant Madabhushi,et al.  Markov Random Field driven Region-Based Active Contour Model (MaRACel): Application to Medical Image Segmentation , 2010, MICCAI.

[18]  Carlos F. Borges On the Estimation of Markov Random Field Parameters , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[20]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[21]  Kannan,et al.  ON IMAGE SEGMENTATION TECHNIQUES , 2022 .

[22]  Sven Loncaric,et al.  Improving the white patch method by subsampling , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[23]  Xiangzeng Liu,et al.  A Fast Edge Tracking Algorithm for Image Segmentation Using a Simple Markov Random Field Model , 2012, 2012 International Conference on Computer Science and Electronics Engineering.

[24]  Hai Su,et al.  Automatic Ki-67 Counting Using Robust Cell Detection and Online Dictionary Learning , 2014, IEEE Transactions on Biomedical Engineering.

[25]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  J. Laurie Snell,et al.  Markov Random Fields and Their Applications , 1980 .

[27]  Haluk Derin,et al.  Modeling and Segmentation of Noisy and Textured Images Using Gibbs Random Fields , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Anant Madabhushi,et al.  Class-specific weighting for Markov random field estimation: Application to medical image segmentation , 2012, Medical Image Anal..

[29]  P. Sivakumar,et al.  A REVIEW ON IMAGE SEGMENTATION TECHNIQUES , 2016 .

[30]  Chanho Jung,et al.  Segmenting Clustered Nuclei Using H-minima Transform-Based Marker Extraction and Contour Parameterization , 2010, IEEE Transactions on Biomedical Engineering.