High-throughput histopathological image analysis via robust cell segmentation and hashing

Computer-aided diagnosis of histopathological images usually requires to examine all cells for accurate diagnosis. Traditional computational methods may have efficiency issues when performing cell-level analysis. In this paper, we propose a robust and scalable solution to enable such analysis in a real-time fashion. Specifically, a robust segmentation method is developed to delineate cells accurately using Gaussian-based hierarchical voting and repulsive balloon model. A large-scale image retrieval approach is also designed to examine and classify each cell of a testing image by comparing it with a massive database, e.g., half-million cells extracted from the training dataset. We evaluate this proposed framework on a challenging and important clinical use case, i.e., differentiation of two types of lung cancers (the adenocarcinoma and squamous carcinoma), using thousands of lung microscopic tissue images extracted from hundreds of patients. Our method has achieved promising accuracy and running time by searching among half-million cells .

[1]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Anant Madabhushi,et al.  Adaptive Energy Selective Active Contour with Shape Priors for Nuclear Segmentation and Gleason Grading of Prostate Cancer , 2011, MICCAI.

[3]  Borivoj Vojnovic,et al.  An image analysis‐based approach for automated counting of cancer cell nuclei in tissue sections , 2003, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[4]  Vincent Lepetit,et al.  A Fully Automated Approach to Segmentation of Irregularly Shaped Cellular Structures in EM Images , 2010, MICCAI.

[5]  Andrew Janowczyk,et al.  High-Throughput Biomarker Segmentation on Ovarian Cancer Tissue Microarrays via Hierarchical Normalized Cuts , 2012, IEEE Transactions on Biomedical Engineering.

[6]  Qiang Ji,et al.  A new efficient ellipse detection method , 2002, Object recognition supported by user interaction for service robots.

[7]  Gustavo K. Rohde,et al.  Accurate diagnosis of thyroid follicular lesions from nuclear morphology using supervised learning , 2014, Medical Image Anal..

[8]  W Schaafsma,et al.  Further evaluation of quantitative nuclear image features for classification of lung carcinomas. , 1992, Pathology, research and practice.

[9]  Anant Madabhushi,et al.  An Integrated Region-, Boundary-, Shape-Based Active Contour for Multiple Object Overlap Resolution in Histological Imagery , 2012, IEEE Transactions on Medical Imaging.

[10]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[11]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Yousef Al-Kofahi,et al.  Improved Automatic Detection and Segmentation of Cell Nuclei in Histopathology Images , 2010, IEEE Transactions on Biomedical Engineering.

[13]  Peng Zhao,et al.  Supervised learning-based cell image segmentation for P53 immunohistochemistry , 2006, IEEE Transactions on Biomedical Engineering.

[14]  Ullrich Köthe,et al.  Learning to segment dense cell nuclei with shape prior , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Bahram Parvin,et al.  Multireference Level Set for the Characterization of Nuclear Morphology in Glioblastoma Multiforme , 2012, IEEE Transactions on Biomedical Engineering.

[16]  Stella X. Yu,et al.  Finding dots: Segmentation as popping out regions from boundaries , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Alexandr Andoni,et al.  Near-Optimal Hashing Algorithms for Approximate Nearest Neighbor in High Dimensions , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[19]  Rasmus Larsen,et al.  Learning histopathological patterns , 2011, Journal of pathology informatics.

[20]  Masahiro Tsuboi,et al.  International Association for the Study of Lung Cancer/American Thoracic Society/European Respiratory Society International Multidisciplinary Classification of Lung Adenocarcinoma , 2011, Journal of thoracic oncology : official publication of the International Association for the Study of Lung Cancer.

[21]  Allan Hanbury,et al.  Cloud-Based Evaluation Framework for Big Data , 2013, Future Internet Assembly.

[22]  Fumin Shen,et al.  Inductive Hashing on Manifolds , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Wei Liu,et al.  Towards Large-Scale Histopathological Image Analysis: Hashing-Based Image Retrieval , 2015, IEEE Transactions on Medical Imaging.

[24]  H. Lee,et al.  Quantitative neurite outgrowth measurement based on image segmentation with topological dependence , 2009, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[25]  Joel H. Saltz,et al.  Histopathological Image Analysis Using Model-Based Intermediate Representations and Color Texture: Follicular Lymphoma Grading , 2009, J. Signal Process. Syst..

[26]  Hui Kong,et al.  Automated detection of cells from immunohistochemically-stained tissues: application to Ki-67 nuclei staining , 2012, Medical Imaging.

[27]  Carla E. Brodley,et al.  Unsupervised Feature Selection Applied to Content-Based Retrieval of Lung Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Nicole Immorlica,et al.  Locality-sensitive hashing scheme based on p-stable distributions , 2004, SCG '04.

[29]  Oliver Schmitt,et al.  Radial symmetries based decomposition of cell clusters in binary and gray level images , 2008, Pattern Recognit..

[30]  Hayit Greenspan,et al.  Medical Image Categorization and Retrieval for PACS Using the GMM-KL Framework , 2007, IEEE Transactions on Information Technology in Biomedicine.

[31]  Yu Ding,et al.  Segmentation, Inference and Classification of Partially Overlapping Nanoparticles , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  S. Osowski,et al.  New automated image analysis method for the assessment of Ki-67 labeling index in meningiomas. , 2010, Folia histochemica et cytobiologica.

[33]  Anant Madabhushi,et al.  Image Segmentation with Implicit Color Standardization Using Spatially Constrained Expectation Maximization: Detection of Nuclei , 2012, MICCAI.

[34]  Charles A Powell,et al.  International Association for the Study of Lung Cancer/American Thoracic Society/European Respiratory Society: international multidisciplinary classification of lung adenocarcinoma: executive summary. , 2011, Proceedings of the American Thoracic Society.

[35]  Xiaobo Zhou,et al.  Automatic Segmentation of High-Throughput RNAi Fluorescent Cellular Images , 2008, IEEE Transactions on Information Technology in Biomedicine.

[36]  Stanislaw Osowski,et al.  Comparative analysis of methods for accurate recognition of cells through nuclei staining of Ki-67 in neuroblastoma and estrogen/progesterone status staining in breast cancer. , 2009, Analytical and quantitative cytology and histology.

[37]  K. Kerr,et al.  Preoperative histological classification of primary lung cancer: accuracy of diagnosis and use of the non-small cell category , 2000, Journal of clinical pathology.

[38]  Allan Hanbury,et al.  VISCERAL: Towards Large Data in Medical Imaging - Challenges and Directions , 2012, MCBR-CDS.

[39]  A. Jemal,et al.  Cancer statistics, 2013 , 2013, CA: a cancer journal for clinicians.

[40]  Margrit Betke,et al.  Hierarchical Partial Matching and Segmentation of Interacting Cells , 2012, MICCAI.

[41]  Nikolas P. Galatsanos,et al.  A similarity learning approach to content-based image retrieval: application to digital mammography , 2004, IEEE Transactions on Medical Imaging.

[42]  Wei Liu,et al.  Supervised Discrete Hashing , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Carlos José Pereira de Lucena,et al.  Automatic embryonic stem cells detection and counting method in fluorescence microscopy images , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[44]  Wei Liu,et al.  Hashing with Graphs , 2011, ICML.

[45]  Lin Yang,et al.  Robust Segmentation of Overlapping Cells in Histopathology Specimens Using Parallel Seed Detection and Repulsive Level Set , 2012, IEEE Transactions on Biomedical Engineering.

[46]  Mikhail Teverovskiy,et al.  Multifeature Prostate Cancer Diagnosis and Gleason Grading of Histological Images , 2007, IEEE Transactions on Medical Imaging.

[47]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[48]  Ning Xu,et al.  Object segmentation using graph cuts based active contours , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[49]  E. Yunis,et al.  Re-examination of encephalitic brains known to contain intranuclear inclusion bodies: electron-microscopic observations following prolonged fixation in formalin. , 1970, American journal of clinical pathology.

[50]  Stephen T. C. Wong,et al.  Repulsive force based snake model to segment and track neuronal axons in 3D microscopy image stacks , 2006, NeuroImage.

[51]  H. Lee,et al.  Evolving generalized Voronoi diagrams for accurate cellular image segmentation , 2010, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[52]  Jagath C. Rajapakse,et al.  Segmentation of Clustered Nuclei With Shape Markers and Marking Function , 2009, IEEE Transactions on Biomedical Engineering.

[53]  Tony Pan,et al.  ImageMiner: a software system for comparative analysis of tissue microarrays using content-based image retrieval, high-performance computing, and grid technology , 2011, J. Am. Medical Informatics Assoc..

[54]  Antonio Torralba,et al.  Spectral Hashing , 2008, NIPS.

[55]  Vipin Chaudhary,et al.  Automating proliferation rate estimation from Ki-67 histology images , 2012, Medical Imaging.

[56]  Hui Kong,et al.  Partitioning Histopathological Images: An Integrated Framework for Supervised Color-Texture Segmentation and Cell Splitting , 2011, IEEE Transactions on Medical Imaging.

[57]  Ron Kikinis,et al.  Improved watershed transform for medical image segmentation using prior information , 2004, IEEE Transactions on Medical Imaging.

[58]  Weidong Cai,et al.  Hierarchical spatial matching for medical image retrieval , 2011, MMAR '11.

[59]  Wei Liu,et al.  Mining Histopathological Images via Composite Hashing and Online Learning , 2014, MICCAI.

[60]  Badrinath Roysam,et al.  A hybrid 3D watershed algorithm incorporating gradient cues and object models for automatic segmentation of nuclei in confocal image stacks , 2003, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[61]  Antoine Geissbühler,et al.  ImageCLEF 2004: Combining Image and Multi-lingual Search for Medical Image Retrieval , 2004, CLEF.

[62]  Tomasz Markiewicz,et al.  Automatic cell recognition in immunohistochemical gastritis stains using sequential thresholding and SVM network , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[63]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[64]  Hai Su,et al.  Automatic Ki-67 Counting Using Robust Cell Detection and Online Dictionary Learning , 2014, IEEE Transactions on Biomedical Engineering.

[65]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[66]  Shih-Fu Chang,et al.  Semi-Supervised Hashing for Large-Scale Search , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[67]  Kannappan Palaniappan,et al.  Cell Segmentation Using Coupled Level Sets and Graph-Vertex Coloring , 2006, MICCAI.

[68]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[69]  Dorin Comaniciu,et al.  Image-guided decision support system for pathology , 1999, Machine Vision and Applications.

[70]  Hai Su,et al.  Fine-grained histopathological image analysis via robust segmentation and large-scale retrieval , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[71]  Anant Madabhushi,et al.  Automated grading of breast cancer histopathology using spectral clustering with textural and architectural image features , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[72]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[73]  Stephen T. C. Wong,et al.  3D cell nuclei segmentation based on gradient flow tracking , 2007, BMC Cell Biology.

[74]  D CohenLaurent On active contour models and balloons , 1991 .

[75]  Alexandr Andoni,et al.  Near-Optimal Hashing Algorithms for Approximate Nearest Neighbor in High Dimensions , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[76]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[77]  Chanho Jung,et al.  Segmenting Clustered Nuclei Using H-minima Transform-Based Marker Extraction and Contour Parameterization , 2010, IEEE Transactions on Biomedical Engineering.

[78]  Julian Yarkony,et al.  Cell Detection and Segmentation Using Correlation Clustering , 2014, MICCAI.

[79]  Ning Xu,et al.  Object segmentation using graph cuts based active contours , 2007, Comput. Vis. Image Underst..

[80]  C Chen,et al.  Constraint factor graph cut–based active contour method for automated cellular image segmentation in RNAi screening , 2008, Journal of microscopy.

[81]  Kristen Grauman,et al.  Kernelized locality-sensitive hashing for scalable image search , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[82]  Rongrong Ji,et al.  Supervised hashing with kernels , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[83]  D. L. Freeman,et al.  Harrison's Principles of Internal Medicine , 2001 .

[84]  Jerry L. Prince,et al.  Snakes, shapes, and gradient vector flow , 1998, IEEE Trans. Image Process..

[85]  Leo Grady,et al.  Isoperimetric graph partitioning for image segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[86]  Asha Collins The Cancer Genome Atlas (TCGA) Pilot Project , 2007 .