A novel computational method for automatic segmentation, quantification and comparative analysis of immunohistochemically labeled tissue sections

BackgroundIn the clinical practice, the objective quantification of histological results is essential not only to define objective and well-established protocols for diagnosis, treatment, and assessment, but also to ameliorate disease comprehension.SoftwareThe software MIAQuant_Learn presented in this work segments, quantifies and analyzes markers in histochemical and immunohistochemical images obtained by different biological procedures and imaging tools. MIAQuant_Learn employs supervised learning techniques to customize the marker segmentation process with respect to any marker color appearance. Our software expresses the location of the segmented markers with respect to regions of interest by mean-distance histograms, which are numerically compared by measuring their intersection. When contiguous tissue sections stained by different markers are available, MIAQuant_Learn aligns them and overlaps the segmented markers in a unique image enabling a visual comparative analysis of the spatial distribution of each marker (markers’ relative location). Additionally, it computes novel measures of markers’ co-existence in tissue volumes depending on their density.ConclusionsApplications of MIAQuant_Learn in clinical research studies have proven its effectiveness as a fast and efficient tool for the automatic extraction, quantification and analysis of histological sections. It is robust with respect to several deficits caused by image acquisition systems and produces objective and reproducible results. Thanks to its flexibility, MIAQuant_Learn represents an important tool to be exploited in basic research where needs are constantly changing.

[1]  Lin Yang,et al.  Automatic Image Analysis of Histopathology Specimens Using Concave Vertex Graph , 2008, MICCAI.

[2]  H. Irshad.  Automated mitosis detection in histopathology using morphological and multi-channel statistics features , 2013, Journal of pathology informatics.

[3]  V. Anari,et al.  Computer-aided detection of proliferative cells and mitosis index in immunohistichemically images of meningioma , 2010, 2010 6th Iranian Conference on Machine Vision and Image Processing.

[4]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[5]  Gary D Marty,et al.  Blank-field correction for achieving a uniform white background in brightfield digital photomicrographs. , 2007, BioTechniques.

[6]  William K. Pratt,et al.  Digital Image Processing: PIKS Inside , 2001 .

[7]  Nasir M. Rajpoot,et al.  A gamma-gaussian mixture model for detection of mitotic cells in breast cancer histopathology images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[8]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[9]  Yousef Al-Kofahi,et al.  Improved Automatic Detection and Segmentation of Cell Nuclei in Histopathology Images , 2010, IEEE Transactions on Biomedical Engineering.

[10]  David G. Stork,et al.  Pattern Classification , 1973 .

[11]  Mario Faretta,et al.  Multiplex Staining by Sequential Immunostaining and Antibody Removal on Routine Tissue Sections , 2017, bioRxiv.

[12]  Syamsiah Mashohor,et al.  Foundation and methodologies in computer-aided diagnosis systems for breast cancer detection , 2017, EXCLI journal.

[13]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[14]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[15]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[16]  Omar S. Al-Kadi,et al.  Texture measures combination for improved meningioma classification of histopathological images , 2010, Pattern Recognit..

[17]  Nassir Navab,et al.  Structure-Preserving Color Normalization and Sparse Stain Separation for Histological Images , 2016, IEEE Transactions on Medical Imaging.

[18]  Anil K. Jain,et al.  Prostate cancer detection: Fusion of cytological and textural features , 2011, Journal of pathology informatics.

[19]  Metin Nafi Gürcan,et al.  Computerized classification of intraductal breast lesions using histopathological images , 2011, IEEE Transactions on Biomedical Engineering.

[20]  J. S. Marron,et al.  A method for normalizing histology slides for quantitative analysis , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[21]  Eric Cosatto,et al.  Classification of mitotic figures with convolutional neural networks and seeded blob features , 2013, Journal of pathology informatics.

[22]  Max A. Viergever,et al.  Marker-controlled watershed segmentation of nuclei in H&E stained breast cancer biopsy images , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[23]  Chanho Jung,et al.  Segmenting Clustered Nuclei Using H-minima Transform-Based Marker Extraction and Contour Parameterization , 2010, IEEE Transactions on Biomedical Engineering.

[24]  H. Wellens,et al.  Computer-Interpreted Electrocardiograms: Benefits and Limitations. , 2017, Journal of the American College of Cardiology.

[25]  Katherine Bourzac,et al.  Software: The computer will see you now , 2013, Nature.

[26]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[27]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[28]  N. Rajpoot,et al.  HyMaP: A hybrid magnitude-phase approach to unsupervised segmentation of tumor areas in breast cancer histology images , 2013, Journal of pathology informatics.

[29]  Nikolaos Grammalidis,et al.  Detection of centroblasts in H&E stained images of follicular lymphoma , 2014, 2014 22nd Signal Processing and Communications Applications Conference (SIU).

[30]  Metin Nafi Gürcan,et al.  Automatic detection of follicular regions in H&E images using iterative shape index , 2011, Comput. Medical Imaging Graph..

[31]  Serge J. Belongie,et al.  Unsupervised Color Decomposition Of Histologically Stained Tissue Samples , 2003, NIPS.

[32]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[33]  Po-Whei Huang,et al.  Effective segmentation and classification for HCC biopsy images , 2010, Pattern Recognit..

[34]  Metin Nafi Gürcan,et al.  An Image Analysis Approach for Detecting Malignant Cells in Digitized H&E-stained Histology Images of Follicular Lymphoma , 2010, 2010 20th International Conference on Pattern Recognition.

[35]  Nasir M. Rajpoot,et al.  Multi-class stain separation using independent component analysis , 2015, Medical Imaging.

[36]  Joakim Lindblad,et al.  Blind Color Decomposition of Histological Images , 2013, IEEE Transactions on Medical Imaging.

[37]  Peter Meer,et al.  Unsupervised segmentation based on robust estimation and color active contour models , 2005, IEEE Transactions on Information Technology in Biomedicine.

[38]  A. Mouelhi,et al.  Automatic segmentation of clustered breast cancer cells using watershed and concave vertex graph , 2011, 2011 International Conference on Communications, Computing and Control Applications (CCCA).

[39]  T. A. A. Tosta,et al.  Segmentation methods of H&E-stained histological images of lymphoma: A review , 2017 .

[40]  M. Salto‐Tellez,et al.  Digital pathology and image analysis in tissue biomarker research. , 2014, Methods.

[41]  Nasir M. Rajpoot,et al.  A Nonlinear Mapping Approach to Stain Normalization in Digital Histopathology Images Using Image-Specific Color Deconvolution , 2014, IEEE Transactions on Biomedical Engineering.

[42]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[43]  J P Vink,et al.  Efficient nucleus detector in histopathology images , 2013, Journal of microscopy.

[44]  Enrico Macii,et al.  Repository ISTITUZIONALE , 2022 .

[45]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[46]  Elena Casiraghi,et al.  Liver segmentation from computed tomography scans: A survey and a new algorithm , 2009, Artif. Intell. Medicine.

[47]  Abderrahim Elmoataz,et al.  Graph-based tools for microscopic cellular image segmentation , 2009, Pattern Recognit..

[48]  Constantine Katsinis,et al.  Large-scale computations on histology images reveal grade-differentiating parameters for breast cancer , 2006, BMC Medical Imaging.

[49]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[50]  John Meyer,et al.  Grading nuclear pleomorphism on histological micrographs , 2008, 2008 19th International Conference on Pattern Recognition.

[51]  Joel H. Saltz,et al.  Histopathological Image Analysis Using Model-Based Intermediate Representations and Color Texture: Follicular Lymphoma Grading , 2009, J. Signal Process. Syst..

[52]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[53]  L. Rodney Long,et al.  Histology image analysis for carcinoma detection and grading , 2012, Comput. Methods Programs Biomed..

[54]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.

[55]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[56]  Lin Shi,et al.  Atlas-guided correction of brain histology distortion , 2011, Journal of pathology informatics.

[57]  Bram van Ginneken,et al.  Fifty years of computer analysis in chest imaging: rule-based, machine learning, deep learning , 2017, Radiological Physics and Technology.

[58]  C Wählby,et al.  Combining intensity, edge and shape information for 2D and 3D segmentation of cell nuclei in tissue sections , 2004, Journal of microscopy.

[59]  Metin Nafi Gürcan,et al.  A general framework for the segmentation of follicular lymphoma virtual slides , 2012, Comput. Medical Imaging Graph..

[60]  Chao-Hui Huang,et al.  Nuclear pleomorphism scoring by selective cell nuclei detection , 2009, WACV.

[61]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[62]  B. van Ginneken,et al.  Use of Volumetry for Lung Nodule Management: Theory and Practice. , 2017, Radiology.

[63]  Bernard A. Fox,et al.  Multispectral imaging of formalin-fixed tissue predicts ability to generate tumor-infiltrating lymphocytes from melanoma , 2015, Journal of Immunotherapy for Cancer.

[64]  Bahram Parvin,et al.  NUCLEAR SEGMENTATION IN H & E SECTIONS VIA MULTI-REFERENCE GRAPH CUT ( MRGC ) , 2011 .

[65]  Enrico Macii,et al.  Automated segmentation of tissue images for computerized IHC analysis , 2022 .

[66]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[67]  H. Irshad,et al.  Methods for Nuclei Detection, Segmentation, and Classification in Digital Histopathology: A Review—Current Status and Future Potential , 2014, IEEE Reviews in Biomedical Engineering.

[68]  Alexander Zelinsky,et al.  Fast Radial Symmetry for Detecting Points of Interest , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[69]  Elena Casiraghi,et al.  MIAQuant, a novel system for automatic segmentation, measurement, and localization comparison of different biomarkers from serialized histological slices , 2017, European journal of histochemistry : EJH.

[70]  Gyan Bhanot,et al.  Computerized Image-Based Detection and Grading of Lymphocytic Infiltration in HER2+ Breast Cancer Histopathology , 2010, IEEE Transactions on Biomedical Engineering.

[71]  F J W-M Leong,et al.  Correction of uneven illumination (vignetting) in digital microscopy images , 2003, Journal of clinical pathology.