Class-Agnostic Weighted Normalization of Staining in Histopathology Images Using a Spatially Constrained Mixture Model

The colorless biopsied tissue samples are usually stained in order to visualize different microscopic structures for diagnostic purposes. But color variations associated with the process of sample preparation, usage of raw materials, diverse staining protocols, and using different slide scanners may adversely influence both visual inspection and computer-aided image analysis. As a result, many methods are proposed for histopathology image stain normalization in recent years. In this study, we introduce a novel approach for stain normalization based on learning a mixture of multivariate skew-normal distributions for stain clustering and parameter estimation alongside a stain transformation technique. The proposed method, labeled “Class-Agnostic Weighted Normalization” (short CLAW normalization), has the ability to normalize a source image by learning the color distribution of both source and target images within an expectation-maximization framework. The novelty of this approach is its flexibility to quantify the underlying both symmetric and nonsymmetric distributions of the different stain components while it is considering the spatial information. The performance of this new stain normalization scheme is tested on several publicly available digital pathology datasets to compare it against state-of-the-art normalization algorithms in terms of ability to preserve the image structure and information. All in all, our proposed method performed superior more consistently in comparison with existing methods in terms of information preservation, visual quality enhancement, and boosting computer-aided diagnosis algorithm performance.

[1]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[2]  J. S. Marron,et al.  A method for normalizing histology slides for quantitative analysis , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[3]  J. A. van der Laak,et al.  Hue-saturation-density (HSD) model for stain recognition in digital images from transmitted light microscopy. , 2000, Cytometry.

[4]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Nasir M. Rajpoot,et al.  A Nonlinear Mapping Approach to Stain Normalization in Digital Histopathology Images Using Image-Specific Color Deconvolution , 2014, IEEE Transactions on Biomedical Engineering.

[6]  Yuhui Zheng,et al.  A Rough Set Bounded Spatially Constrained Asymmetric Gaussian Mixture Model for Image Segmentation , 2017, PloS one.

[7]  Stan Z. Li,et al.  Markov Random Field Modeling in Image Analysis , 2001, Computer Science Workbench.

[8]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[9]  Surabhi Bhargava,et al.  A Dataset and a Technique for Generalized Nuclear Segmentation for Computational Pathology , 2017, IEEE Transactions on Medical Imaging.

[10]  Hui Zhang,et al.  A finite mixture model for detail-preserving image segmentation , 2013, Signal Process..

[11]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[12]  Gwendolyn R. Goss,et al.  Theory and Practice of Histological Techniques , 2009 .

[13]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[14]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[15]  Catarina Eloy,et al.  BACH: Grand Challenge on Breast Cancer Histology Images , 2018, Medical Image Anal..

[16]  Anant Madabhushi,et al.  EM-based segmentation-driven color standardization of digitized histopathology , 2013, Medical Imaging.

[17]  Gérard Govaert,et al.  Assessing a Mixture Model for Clustering with the Integrated Completed Likelihood , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Q. M. Jonathan Wu,et al.  Fast and Robust Spatially Constrained Gaussian Mixture Model for Image Segmentation , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[20]  Stanislaw Osowski,et al.  Ensemble of classifiers and wavelet transformation for improved recognition of Fuhrman grading in clear-cell renal carcinoma , 2017 .

[21]  Maria S. Kulikova,et al.  Mitosis detection in breast cancer histological images An ICPR 2012 contest , 2013, Journal of pathology informatics.

[22]  Konstantinos N. Plataniotis,et al.  A Complete Color Normalization Approach to Histopathology Images Using Color Cues Computed From Saturation-Weighted Statistics , 2015, IEEE Transactions on Biomedical Engineering.

[23]  Nasir M. Rajpoot,et al.  A Stochastic Polygons Model for Glandular Structures in Colon Histology Images , 2015, IEEE Transactions on Medical Imaging.

[24]  Nassir Navab,et al.  Structure-Preserving Color Normalization and Sparse Stain Separation for Histological Images , 2016, IEEE Transactions on Medical Imaging.

[25]  Shyam Lal,et al.  A study about color normalization methods for histopathology images. , 2018, Micron.

[26]  R Celis,et al.  Blind colour separation of H&E stained histological images by linearly transforming the colour space , 2015, Journal of microscopy.

[27]  A. R. Ansari,et al.  Rank-Sum Tests for Dispersions , 1960 .

[28]  Leandro Alves Neves,et al.  Computational normalization of H&E-stained histological images: Progress, challenges and future potential , 2019, Artif. Intell. Medicine.

[29]  Hui Zhang,et al.  A Bayesian Bounded Asymmetric Mixture Model With Segmentation Application , 2014, IEEE Journal of Biomedical and Health Informatics.

[30]  Orly Yadid-Pecht,et al.  Quaternion Structural Similarity: A New Quality Index for Color Images , 2012, IEEE Transactions on Image Processing.

[31]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[32]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[33]  M. Cugmas,et al.  On comparing partitions , 2015 .

[34]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.

[35]  Zhi-Dong Bai,et al.  On rates of convergence of efficient detection criteria in signal processing with white noise , 1989, IEEE Trans. Inf. Theory.

[36]  Thomas J. Hebert,et al.  Bayesian pixel classification using spatially variant finite mixtures and the generalized EM algorithm , 1998, IEEE Trans. Image Process..

[37]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  M. Friedman The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[39]  R. Arellano-Valle,et al.  Skew-normal Linear Mixed Models , 2005, Journal of Data Science.