Color normalization of faded H&E-stained histological images using spectral matching

Histological samples stained with hematoxylin-eosin (H&E) are commonly used by pathologists in cancer diagnoses. However, the preparation, digitization, and storage of tissue samples can lead to color variations that produce poor performance when using histological image processing techniques. Thus, normalization methods have been proposed to adjust the color of the image. This can be achieved through the use of a spectral matching technique, where it is first necessary to estimate the H&E representation and the stain concentration in the image pixels by means of the RGB model. This study presents an estimation method for H&E stain representation for the normalization of faded histological samples. This application has been explored only to a limited extent in the literature, but has the capacity to expand the use of faded samples. To achieve this, the normalized images must have a coherent color representation of the H&E stain with no introduction of noise, which was realized by applying the methodology described in this proposal. The estimation method presented here aims to normalize histological samples with different degrees of fading using a combination of fuzzy theory and the Cuckoo search algorithm, and dictionary learning with an initialization method for optimization. In visual and quantitative comparisons of estimates of H&E stain representation from the literature, our proposed method achieved very good results, with a high feature similarity between the original and normalized images.

[1]  Xuguang Zhang,et al.  A fast recursive algorithm based on fuzzy 2-partition entropy approach for threshold selection , 2011, Neurocomputing.

[2]  Xiaogang Wang,et al.  Background Subtraction via Robust Dictionary Learning , 2011, EURASIP J. Image Video Process..

[3]  Andreea Anghel,et al.  A Fast and Scalable Pipeline for Stain Normalization of Whole-Slide Images in Histopathology , 2018, ECCV Workshops.

[4]  Pradipta Maji,et al.  Rough-Fuzzy Circular Clustering for Color Normalization of Histological Images , 2019, Fundam. Informaticae.

[5]  Nassir Navab,et al.  Structure-preserved color normalization for histological images , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[6]  Scott T. Rickard,et al.  Comparing Measures of Sparsity , 2008, IEEE Transactions on Information Theory.

[7]  D. Lansing Taylor,et al.  Spatial Statistics for Segmenting Histological Structures in H&E Stained Tissue Images , 2017, IEEE Transactions on Medical Imaging.

[8]  Dan Schonfeld,et al.  Color normalization of histology slides using graph regularized sparse NMF , 2017, Medical Imaging.

[9]  Nico Karssemeijer,et al.  Stain Specific Standardization of Whole-Slide Histopathological Images , 2016, IEEE Transactions on Medical Imaging.

[10]  Leandro Alves Neves,et al.  Computational normalization of H&E-stained histological images: Progress, challenges and future potential , 2019, Artif. Intell. Medicine.

[11]  Eduardo Romero,et al.  Unsupervised color normalisation for H and E stained histopathology image analysis , 2015, Symposium on Medical Information Processing and Analysis.

[12]  Xin-She Yang,et al.  Multiobjective cuckoo search for design optimization , 2013, Comput. Oper. Res..

[13]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[14]  May D. Wang,et al.  Comparison of normalization algorithms for cross-batch color segmentation of histopathological images , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  J Rittscher,et al.  Digitally adjusting chromogenic dye proportions in brightfield microscopy images , 2012, Journal of microscopy.

[16]  J. S. Marron,et al.  Appearance Normalization of Histology Slides , 2010, MLMI.

[17]  Janusz Szymas,et al.  Quality evaluation of virtual slides using methods based on comparing common image areas , 2011, Diagnostic pathology.

[18]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[19]  Kaya Kuru,et al.  Optimization and enhancement of H&E stained microscopical images by applying bilinear interpolation method on lab color mode , 2014, Theoretical Biology and Medical Modelling.

[20]  T. Grogan,et al.  The impact of pre-analytical processing on staining quality for H&E, dual hapten, dual color in situ hybridization and fluorescent in situ hybridization assays. , 2010, Methods.

[21]  Oscar Castillo,et al.  Cuckoo Search via Lévy Flights and a Comparison with Genetic Algorithms , 2015, Fuzzy Logic Augmentation of Nature-Inspired Optimization Metaheuristics.

[22]  Zhiguo Jiang,et al.  Adaptive color deconvolution for histological WSI normalization , 2019, Comput. Methods Programs Biomed..

[23]  Nasir M. Rajpoot,et al.  A Nonlinear Mapping Approach to Stain Normalization in Digital Histopathology Images Using Image-Specific Color Deconvolution , 2014, IEEE Transactions on Biomedical Engineering.

[24]  Nico Karssemeijer,et al.  Quantitative analysis of stain variability in histology slides and an algorithm for standardization , 2014, Medical Imaging.

[25]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[26]  Nassir Navab,et al.  Structure-Preserving Color Normalization and Sparse Stain Separation for Histological Images , 2016, IEEE Transactions on Medical Imaging.

[27]  J. S. Marron,et al.  A method for normalizing histology slides for quantitative analysis , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[28]  Du-Yih Tsai,et al.  Information Entropy Measure for Evaluation of Image Quality , 2008, Journal of Digital Imaging.

[29]  Masahiro Yamaguchi,et al.  Computer-Aided Differentiation for Pathology Images , 2017 .

[30]  J. A. van der Laak,et al.  Hue-saturation-density (HSD) model for stain recognition in digital images from transmitted light microscopy. , 2000, Cytometry.

[31]  Cewu Lu,et al.  Online Robust Dictionary Learning , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Andrew Janowczyk,et al.  Stain Normalization using Sparse AutoEncoders (StaNoSA): Application to digital pathology , 2017, Comput. Medical Imaging Graph..

[33]  Metin Nafi Gürcan,et al.  A general framework for the segmentation of follicular lymphoma virtual slides , 2012, Comput. Medical Imaging Graph..

[34]  K. V. Arya,et al.  Colour normalisation of histopathological images , 2013, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[35]  Erik Cuevas,et al.  Image Segmentation Based on Differential Evolution Optimization , 2016 .

[36]  Patrick Siarry,et al.  A multilevel automatic thresholding method based on a genetic algorithm for a fast image segmentation , 2008, Comput. Vis. Image Underst..

[37]  Ashish Kumar Bhandari,et al.  Tsallis entropy based multilevel thresholding for colored satellite image segmentation using evolutionary algorithms , 2015, Expert Syst. Appl..

[38]  Kalyani Mali,et al.  Fuzzy-based artificial bee colony optimization for gray image segmentation , 2016, Signal Image Video Process..

[39]  Andrius Usinskas,et al.  A SURVEY OF GENETIC ALGORITHMS APPLICATIONS FOR IMAGE ENHANCEMENT AND SEGMENTATION , 2007 .

[40]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.

[41]  J. S. Marron,et al.  Appearance Normalization of Histology Slides , 2010, MLMI.

[42]  Konstantinos N. Plataniotis,et al.  A Complete Color Normalization Approach to Histopathology Images Using Color Cues Computed From Saturation-Weighted Statistics , 2015, IEEE Transactions on Biomedical Engineering.

[43]  Thanga Raj Chelliah,et al.  Brain tumor segmentation in MRI images using integrated modified PSO-fuzzy approach , 2015, Int. Arab J. Inf. Technol..

[44]  Nikolaos Grammalidis,et al.  Detection of centroblasts in H&E stained images of follicular lymphoma , 2014, 2014 22nd Signal Processing and Communications Applications Conference (SIU).