A Multi-resolution Approach for Combining Visual Information using Nuclei Segmentation and Classification in Histopathological Images

This paper describes a multi-resolution technique to combine diagnostically important visual information at different magnifications in H&E whole slide images (WSI) of gastric cancer. The primary goal is to improve the results of nuclei segmentation method for heterogeneous histopathological datasets with variations in stain intensity and malignancy levels. A minimum-model nuclei segmentation method is first applied to tissue images at multiple resolutions, and a comparative evaluation is performed. A comprehensive set of 31 nuclei features based on color, texture and morphology are derived from the nuclei segments. AdaBoost classification method is used to classify these segments into a set of pre-defined classes. Two classification approaches are evaluated for this purpose. A relevance score is assigned to each class and a combined segmentation result is obtained consisting of objects with higher visual significance from individual magnifications, thereby preserving both coarse and fine details in the image. Quantitative and visual assessment of combination results shows that they contain comprehensive and diagnostically more relevant information than in constituent

[1]  James Diamond,et al.  The use of morphological characteristics and texture analysis in the identification of tissue composition in prostatic neoplasia. , 2004, Human pathology.

[2]  Tolga Tasdizen,et al.  Isolation and two-step classification of normal white blood cells in peripheral blood smears , 2012, Journal of pathology informatics.

[3]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[4]  Isaac Amidror,et al.  Scattered data interpolation methods for electronic imaging systems: a survey , 2002, J. Electronic Imaging.

[5]  N. Merrett,et al.  Clinicopathologic factors associated with HER2‐positive gastric cancer and its impact on survival outcomes—A systematic review , 2012, International journal of cancer.

[6]  M. Ebert,et al.  Her2/neu testing in gastric cancer: evaluating the risk of sampling errors , 2012, Annals of oncology : official journal of the European Society for Medical Oncology.

[7]  P. Bartels,et al.  Expert system support using Bayesian belief networks in the diagnosis of fine needle aspiration biopsy specimens of the breast. , 1994, Journal of clinical pathology.

[8]  Kim L. Boyer,et al.  Computer-aided evaluation of neuroblastoma on whole-slide histology images: Classifying grade of neuroblastic differentiation , 2009, Pattern Recognit..

[9]  Abbes Amira,et al.  A multispectral computer vision system for automatic grading of prostatic neoplasia , 2002, Proceedings IEEE International Symposium on Biomedical Imaging.

[10]  A. Kannammal,et al.  Multi-feature prostate cancer diagnosis of histological images using advanced image segmentation , 2010, Int. J. Medical Eng. Informatics.

[11]  Raouf N. G. Naguib,et al.  Multiresolution colour texture analysis for classifying colon cancer images , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[12]  P H Bartels,et al.  Bayesian belief networks in quantitative histopathology. , 1992, Analytical and quantitative cytology and histology.

[13]  J. Bancroft,et al.  Theory and Practice of Histological Techniques , 1990 .

[14]  Invasive Carcinomas and Fibroadenomas of the Breast: Comparison of Microvessel Distributions-Implications for Imaging Modalities , 1998 .

[15]  Raouf N. G. Naguib,et al.  Colour texture analysis using co-occurrence matrices for classification of colon cancer images , 2002, IEEE CCECE2002. Canadian Conference on Electrical and Computer Engineering. Conference Proceedings (Cat. No.02CH37373).

[16]  H. Espejo,et al.  [Gastric cancer]. , 1996, Revista de gastroenterologia del Peru : organo oficial de la Sociedad de Gastroenterologia del Peru.

[17]  Daniel Heim,et al.  Detection and Segmentation of Cell Nuclei in Virtual Microscopy Images: A Minimum-Model Approach , 2012, Scientific Reports.

[18]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[19]  Chih-Jen Lin,et al.  Combining SVMs with Various Feature Selection Strategies , 2006, Feature Extraction.

[20]  Masaru Ishii,et al.  CognitionMaster: an object-based image analysis framework , 2013, Diagnostic Pathology.

[21]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..