Stain Color Adaptive Normalization (SCAN) algorithm: Separation and standardization of histological stains in digital pathology

BACKGROUND AND OBJECTIVE The diagnosis of histopathological images is based on the visual analysis of tissue slices under a light microscope. However, the histological tissue appearance may assume different color intensities depending on the staining process, operator ability and scanner specifications. This stain variability affects the diagnosis of the pathologist and decreases the accuracy of computer-aided diagnosis systems. In this context, the stain normalization process has proved to be a powerful tool to cope with this issue, allowing to standardize the stain color appearance of a source image respect to a reference image. METHODS In this paper, novel fully automated stain separation and normalization approaches for hematoxylin and eosin stained histological slides are presented. The proposed algorithm, named SCAN (Stain Color Adaptive Normalization), is based on segmentation and clustering strategies for cellular structures detection. The SCAN algorithm is able to improve the contrast between histological tissue and background and preserve local structures without changing the color of the lumen and the background. RESULTS Both stain separation and normalization techniques were qualitatively and quantitively validated on a multi-tissue and multiscale dataset, with highly satisfactory results, outperforming the state-of-the-art approaches. SCAN was also tested on whole-slide images with high performances and low computational times. CONCLUSIONS The potential contribution of the proposed standardization approach is twofold: the improvement of visual diagnosis in digital histopathology and the development of powerful pre-processing strategies to automated classification techniques for cancer detection.

[1]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[2]  Filippo Molinari,et al.  Multi-tissue and multi-scale approach for nuclei segmentation in H&E stained images , 2018, Biomedical engineering online.

[3]  Jorge S. Marques,et al.  Improving Dermoscopy Image Classification Using Color Constancy , 2015, IEEE Journal of Biomedical and Health Informatics.

[4]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[5]  Robert F. Harrison,et al.  An automated pattern recognition system for the quantification of inflammatory cells in hepatitis-C-infected liver biopsies , 2006, Image Vis. Comput..

[6]  Johan Isaksson,et al.  Semantic segmentation of microscopic images of H&E stained prostatic tissue using CNN , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[7]  C. Loos Multiple Immunoenzyme Staining: Methods and Visualizations for the Observation With Spectral Imaging , 2008 .

[8]  D. F. Swinehart,et al.  The Beer-Lambert Law , 1962 .

[9]  Ting Chen,et al.  Group sparsity model for stain unmixing in brightfield multiplex immunohistochemistry images , 2015, Comput. Medical Imaging Graph..

[10]  Sim Heng Ong,et al.  Autofocusing for tissue microscopy , 1993, Image Vis. Comput..

[11]  Olaf Hellwich,et al.  Deep convolutional neural networks for automatic classification of gastric carcinoma using whole slide images in digital histopathology , 2017, Comput. Medical Imaging Graph..

[12]  Zhiguo Jiang,et al.  Adaptive color deconvolution for histological WSI normalization , 2019, Comput. Methods Programs Biomed..

[13]  Serge J. Belongie,et al.  Unsupervised Color Decomposition Of Histologically Stained Tissue Samples , 2003, NIPS.

[14]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[15]  J. S. Marron,et al.  A method for normalizing histology slides for quantitative analysis , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[16]  Jin Tae Kwak,et al.  Multiview boosting digital pathology analysis of prostate cancer , 2017, Comput. Methods Programs Biomed..

[17]  Filippo Molinari,et al.  Automated Segmentation of Fluorescence Microscopy Images for 3D Cell Detection in human-derived Cardiospheres , 2019, Scientific Reports.

[18]  Milind M. Mushrif,et al.  HISTOPATHOLOGICAL IMAGE ANALYSIS USING IMAGE PROCESSING TECHNIQUES : AN OVERVIEW , 2012 .

[19]  J. S. Marron,et al.  Appearance Normalization of Histology Slides , 2010, MLMI.

[20]  A. Fischer,et al.  Hematoxylin and eosin staining of tissue and cell sections. , 2008, CSH protocols.

[21]  Sergio G Veloso,et al.  Interobserver agreement of Gleason score and modified Gleason score in needle biopsy and in surgical specimen of prostate cancer. , 2007, International braz j urol : official journal of the Brazilian Society of Urology.

[22]  Zhang Yi,et al.  Cell tracking using deep neural networks with multi-task learning , 2017, Image Vis. Comput..

[23]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[24]  Nasir M. Rajpoot,et al.  A Nonlinear Mapping Approach to Stain Normalization in Digital Histopathology Images Using Image-Specific Color Deconvolution , 2014, IEEE Transactions on Biomedical Engineering.

[25]  Filippo Molinari,et al.  Automatic discrimination of neoplastic epithelium and stromal response in breast carcinoma , 2019, Comput. Biol. Medicine.

[26]  J. Bancroft,et al.  Theory and Practice of Histological Techniques , 1990 .

[27]  Joakim Lindblad,et al.  Blind Color Decomposition of Histological Images , 2013, IEEE Transactions on Medical Imaging.

[28]  Nicolai Petkov,et al.  Comparison of texture features based on Gabor filters , 2002, IEEE Trans. Image Process..

[29]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[30]  Nassir Navab,et al.  Structure-Preserving Color Normalization and Sparse Stain Separation for Histological Images , 2016, IEEE Transactions on Medical Imaging.

[31]  Aymen Mouelhi,et al.  Fast unsupervised nuclear segmentation and classification scheme for automatic allred cancer scoring in immunohistochemical breast tissue images , 2018, Comput. Methods Programs Biomed..

[32]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.