Stacked Predictive Sparse Decomposition for Classification of Histology Sections

Image-based classification of histology sections, in terms of distinct components (e.g., tumor, stroma, normal), provides a series of indices for histology composition (e.g., the percentage of each distinct components in histology sections), and enables the study of nuclear properties within each component. Furthermore, the study of these indices, constructed from each whole slide image in a large cohort, has the potential to provide predictive models of clinical outcome. For example, correlations can be established between the constructed indices and the patients’ survival information at cohort level, which is a fundamental step towards personalized medicine. However, performance of the existing techniques is hindered as a result of large technical variations (e.g., variations of color/textures in tissue images due to non-standard experimental protocols) and biological heterogeneities (e.g., cell type, cell state) that are always present in a large cohort. We propose a system that automatically learns a series of dictionary elements for representing the underlying spatial distribution using stacked predictive sparse decomposition. The learned representation is then fed into the spatial pyramid matching framework with a linear support vector machine classifier. The system has been evaluated for classification of distinct histological components for two cohorts of tumor types. Throughput has been increased by using of graphical processing unit (GPU), and evaluation indicates a superior performance results, compared with previous research.

[1]  Eli Shechtman,et al.  In defense of Nearest-Neighbor based image classification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Andrew Zisserman,et al.  Scene Classification Using a Hybrid Generative/Discriminative Approach , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Yihong Gong,et al.  Nonlinear Learning using Local Coordinate Coding , 2009, NIPS.

[4]  Dirk R. Padfield,et al.  Color and texture based segmentation of molecular pathology images usING HSOMS , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[5]  May D. Wang,et al.  Biological interpretation of morphological patterns in histopathological whole-slide images , 2012, BCB.

[6]  Bahram Parvin,et al.  Invariant Delineation of Nuclear Architecture in Glioblastoma Multiforme for Clinical and Molecular Association , 2013, IEEE Transactions on Medical Imaging.

[7]  Bahram Parvin,et al.  Classification of Histology Sections via Multispectral Convolutional Sparse Coding , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Bahram Parvin,et al.  Characterization of Tissue Histopathology via Predictive Sparse Decomposition and Spatial Pyramid Matching , 2013, MICCAI.

[9]  Bahram Parvin,et al.  Comparison of sparse coding and kernel methods for histopathological classification of gliobastoma multiforme , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[10]  Bülent Yener,et al.  Coupled Analysis of In Vitro and Histology Tissue Samples to Quantify Structure-Function Relationship , 2012, PloS one.

[11]  Jelena Kovacevic,et al.  Automatic identification and delineation of germ layer components in H&E stained images of teratomas derived from human and nonhuman primate embryonic stem cells , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[12]  Frédéric Jurie,et al.  Randomized Clustering Forests for Image Classification , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Andrew Zisserman,et al.  Efficient Additive Kernels via Explicit Feature Maps , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Nicolas Loménie,et al.  Time-efficient sparse analysis of histopathological whole slide images , 2011, Comput. Medical Imaging Graph..

[15]  Marc'Aurelio Ranzato,et al.  Efficient Learning of Sparse Representations with an Energy-Based Model , 2006, NIPS.

[16]  Anant Madabhushi,et al.  Computer-aided prognosis of ER+ breast cancer histopathology and correlating survival outcome with Oncotype DX assay , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[17]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[18]  Honglak Lee,et al.  Sparse deep belief net model for visual area V2 , 2007, NIPS.

[19]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[20]  B. Yener,et al.  Automated cancer diagnosis based on histopathological images : a systematic survey , 2005 .

[21]  Fabio A. González,et al.  A Deep Learning Architecture for Image Representation, Visual Interpretability and Automated Basal-Cell Carcinoma Cancer Detection , 2013, MICCAI.

[22]  Jun Kong,et al.  Texture based image recognition in microscopy images of diffuse gliomas with multi-class gentle boosting mechanism , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[23]  Yann LeCun,et al.  Large-scale Learning with SVM and Convolutional for Generic Object Categorization , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[24]  Bahram Parvin,et al.  Classification of tumor histopathology via sparse feature learning , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[25]  Luc Van Gool,et al.  The 2005 PASCAL Visual Object Classes Challenge , 2005, MLCW.

[26]  Marc'Aurelio Ranzato,et al.  Fast Inference in Sparse Coding Algorithms with Applications to Object Recognition , 2010, ArXiv.

[27]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[28]  Yizhou Yu,et al.  SCaLE: Supervised and Cascaded Laplacian Eigenmaps for Visual Object Recognition Based on Nearest Neighbors , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Ronald M. Lesperance,et al.  The Gaussian derivative model for spatial-temporal vision: I. Cortical model. , 2001, Spatial vision.

[30]  Yann LeCun,et al.  What is the best multi-stage architecture for object recognition? , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[31]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[32]  Jianguo Zhang,et al.  The PASCAL Visual Object Classes Challenge , 2006 .

[33]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[34]  Anant Madabhushi,et al.  Cascaded multi-class pairwise classifier (CascaMPa) for normal, cancerous, and cancer confounder classes in prostate histology , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[35]  Ronald M. Lesperance,et al.  The Gaussian derivative model for spatial-temporal vision: II. Cortical data. , 2001, Spatial vision.

[36]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[37]  Gyan Bhanot,et al.  Expectation Maximization driven Geodesic Active Contour with Overlap Resolution (EMaGACOR): Application to Lymphocyte Segmentation on Breast Cancer Histopathology , 2009, BIBE.

[38]  B. Yener,et al.  Multiscale Feature Analysis of Salivary Gland Branching Morphogenesis , 2012, PLoS ONE.

[39]  Yuejiao Fu,et al.  Effect of Quantitative Nuclear Image Features on Recurrence of Ductal Carcinoma In Situ (DCIS) of the Breast , 2008, Cancer informatics.

[40]  Marc'Aurelio Ranzato,et al.  Sparse Feature Learning for Deep Belief Networks , 2007, NIPS.

[41]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[42]  Quoc V. Le,et al.  Learning invariant features of tumor signatures , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[43]  Yihong Gong,et al.  Linear spatial pyramid matching using sparse coding for image classification , 2009, CVPR.

[44]  Bahram Parvin,et al.  Classification of Tumor Histology via Morphometric Context , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.