Tensor-based computation and modeling in multi-resolution digital pathology imaging: application to follicular lymphoma grading

In this work, we introduce a tensor-based computation and modeling framework for the analysis of digital pathology images at different resolutions. We represent digital pathology images as a third-order tensor (a three-way array) with modes: images, features and scales, by extracting features at different scales. The constructed tensor is then analyzed using the most popular tensor factorization methods, i.e., CANDECOMP/PARAFAC and Tucker. These tensor models enable us to extract the underlying patterns in each mode (i.e. images, features and scales) and examine how these patterns are related to each other. As a motivating example, we analyzed 500 follicular lymphoma images corresponding to high power fields, evaluated by three expert hematopathologists. Numerical experiments demonstrate that (i) tensor models capture easily-interpretable patterns showing the significant features and scales, and (ii) patterns extracted by the right tensor model, which in this case is the Tucker model commonly used for exploratory analysis of higher-order tensors, perform as well as the reduced dimensions captured by matrix factorization methods on unfolded data, in terms of follicular lymphoma grading.

[1]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[2]  F. L. Hitchcock The Expression of a Tensor or a Polyadic as a Sum of Products , 1927 .

[3]  Metin Nafi Gürcan,et al.  An Image Analysis Approach for Detecting Malignant Cells in Digitized H&E-stained Histology Images of Follicular Lymphoma , 2010, 2010 20th International Conference on Pattern Recognition.

[4]  R. Bro,et al.  Centering and scaling in component analysis , 2003 .

[5]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[6]  Metin Nafi Gürcan,et al.  Automatic detection of follicular regions in H&E images using iterative shape index , 2011, Comput. Medical Imaging Graph..

[7]  Henk A L Kiers,et al.  A fast method for choosing the numbers of components in Tucker3 analysis. , 2003, The British journal of mathematical and statistical psychology.

[8]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[9]  Joel H. Saltz,et al.  Histopathological Image Analysis Using Model-Based Intermediate Representations and Color Texture: Follicular Lymphoma Grading , 2009, J. Signal Process. Syst..

[10]  Gene H. Golub,et al.  Matrix computations , 1983 .

[11]  Bülent Yener,et al.  Modeling and Multiway Analysis of Chatroom Tensors , 2005, ISI.

[12]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[13]  M. Gurcan,et al.  Computer-aided classification of centroblast cells in follicular lymphoma. , 2010, Analytical and quantitative cytology and histology.

[14]  Hui Kong,et al.  Follicular lymphoma grading using cell-graphs and multi-scale feature analysis , 2012, Medical Imaging.

[15]  Metin Nafi Gürcan,et al.  Cell nuclei segmentation for histopathological image analysis , 2011, Medical Imaging.

[16]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[17]  James Olen Armitage,et al.  A clinical evaluation of the International Lymphoma Study Group classification of non-Hodgkin's lymphoma. The Non-Hodgkin's Lymphoma Classification Project. , 1997, Blood.

[18]  R B Mann,et al.  Criteria for the cytologic subclassification of follicular lymphomas: A Proposed alternative method , 2007, Hematological oncology.

[19]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[20]  Metin Nafi Gürcan,et al.  Segmentation of follicular regions on H&E slides using a matching filter and active contour model , 2010, Medical Imaging.

[21]  Bülent Yener,et al.  Unsupervised Multiway Data Analysis: A Literature Survey , 2009, IEEE Transactions on Knowledge and Data Engineering.

[22]  Olcay Sertel,et al.  Extraction of color features in the spectral domain to recognize centroblasts in histopathology , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Kim L. Boyer,et al.  Computer-aided evaluation of neuroblastoma on whole-slide histology images: Classifying grade of neuroblastic differentiation , 2009, Pattern Recognit..

[24]  Jun Kong,et al.  Texture classification using nonlinear color quantization: Application to histopathological image analysis , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[25]  Richard A. Harshman,et al.  Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multi-model factor analysis , 1970 .

[26]  Jun Kong,et al.  Computer-aided prognosis of neuroblastoma on whole-slide images: Classification of stromal development , 2009, Pattern Recognit..

[27]  Rasmus Bro,et al.  Multiway analysis of epilepsy tensors , 2007, ISMB/ECCB.

[28]  C C Whitcomb,et al.  Morphological subclassification of follicular lymphoma: variability of diagnoses among hematopathologists, a collaborative study between the Repository Center and Pathology Panel for Lymphoma Clinical Studies. , 1985, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[29]  Qiang Zhang,et al.  Tensor methods for hyperspectral data analysis: a space object material identification study. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[30]  Hui Kong,et al.  Partitioning Histopathological Images: An Integrated Framework for Supervised Color-Texture Segmentation and Cell Splitting , 2011, IEEE Transactions on Medical Imaging.

[31]  Jun Kong,et al.  Computerized microscopic image analysis of follicular lymphoma , 2008, SPIE Medical Imaging.