An Optimal Transportation Approach for Nuclear Structure-Based Pathology

Nuclear morphology and structure as visualized from histopathology microscopy images can yield important diagnostic clues in some benign and malignant tissue lesions. Precise quantitative information about nuclear structure and morphology, however, is currently not available for many diagnostic challenges. This is due, in part, to the lack of methods to quantify these differences from image data. We describe a method to characterize and contrast the distribution of nuclear structure in different tissue classes (normal, benign, cancer, etc.). The approach is based on quantifying chromatin morphology in different groups of cells using the optimal transportation (Kantorovich-Wasserstein) metric in combination with the Fisher discriminant analysis and multidimensional scaling techniques. We show that the optimal transportation metric is able to measure relevant biological information as it enables automatic determination of the class (e.g., normal versus cancer) of a set of nuclei. We show that the classification accuracies obtained using this metric are, on average, as good or better than those obtained utilizing a set of previously described numerical features. We apply our methods to two diagnostic challenges for surgical pathology: one in the liver and one in the thyroid. Results automatically computed using this technique show potentially biologically relevant differences in nuclear structure in liver and thyroid cancers.

[1]  Chitra Sarkar,et al.  Evaluation of diagnostic efficiency of computerized image analysis based quantitative nuclear parameters in papillary and follicular thyroid tumors using paraffin-embedded tissue sections , 2009, Pathology Oncology Research.

[2]  T Misteli,et al.  Functional architecture in the cell nucleus. , 2001, The Biochemical journal.

[3]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  E. Bengtsson Fifty years of attempts to automate screening for cervical cancer , 1999 .

[5]  Z. Budimlija,et al.  Fractal dimension of hepatocytes' nuclei in normal liver vs hepatocellular carcinoma (HCC) in human subjects - preliminary results , 2000 .

[6]  F. Bookstein Size and Shape Spaces for Landmark Data in Two Dimensions , 1986 .

[7]  Tsukasa Ashihara,et al.  Detection of underlying characteristics of nuclear chromatin patterns of thyroid tumor cells using texture and factor analyses. , 2002, Cytometry.

[8]  Melamed Mr,et al.  Limitations of aspiration cytology in the diagnosis of primary neoplasms. , 1984, Acta cytologica.

[9]  Robert F Murphy,et al.  Deformation‐based nuclear morphometry: Capturing nuclear shape variation in HeLa cells , 2008, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[10]  J. S. Ploem,et al.  Clinical Cytometry and Histometry , 1988 .

[11]  C. Villani Topics in Optimal Transportation , 2003 .

[12]  Gian Luca Delzanno,et al.  An optimal robust equidistribution method for two-dimensional grid adaptation based on Monge-Kantorovich optimization , 2008, J. Comput. Phys..

[13]  M. Melamed,et al.  Limitations of aspiration cytology in the diagnosis of primary neoplasms. , 1984, Acta cytologica.

[14]  D. Sherer,et al.  Automated cervical cytology: meta-analyses of the performance of the AutoPap 300 QC System. , 1999, Obstetrical & gynecological survey.

[16]  Karl Rohr,et al.  Nonrigid Registration of 3-D Multichannel Microscopy Images of Cell Nuclei , 2008, IEEE Transactions on Image Processing.

[17]  A. Frasoldati,et al.  Computer-assisted cell morphometry and ploidy analysis in the assessment of thyroid follicular neoplasms. , 2001, Thyroid : official journal of the American Thyroid Association.

[18]  C. M. Schlotter,et al.  Review Molecular targeted therapies for breast cancer treatment , 2008 .

[19]  I Salmon,et al.  Relationship between histopathologic typing and morphonuclear assessments of 238 thyroid lesions. Digital cell image analysis performed on Feulgen-stained nuclei from formalin-fixed, paraffin-embedded materials. , 1992, American journal of clinical pathology.

[20]  Jean Gaudart,et al.  Thyroid follicular adenomas may display features of follicular carcinoma and follicular variant of papillary carcinoma. , 2004, European journal of endocrinology.

[21]  Anne Lohrli Chapman and Hall , 1985 .

[22]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[23]  Jiaquan Xu,et al.  Deaths: final data for 2005. , 2008, National vital statistics reports : from the Centers for Disease Control and Prevention, National Center for Health Statistics, National Vital Statistics System.

[24]  Kunio Doi,et al.  Usefulness of Texture Analysis for Computerized Classification of Breast Lesions on Mammograms , 2007, Journal of Digital Imaging.

[25]  M. Ikeguchi,et al.  Computerized nuclear morphometry of hepatocellular carcinoma and its relation to proliferative activity , 1998, Journal of surgical oncology.

[26]  Y. Karslıoğlu,et al.  Contribution of morphometry in the differential diagnosis of fine‐needle thyroid aspirates , 2005, Cytometry. Part B, Clinical cytometry.

[27]  Karl Rohr,et al.  Non-rigid Registration of 3D Multi-channel Microscopy Images of Cell Nuclei , 2006, MICCAI.

[28]  Louis M Weiner,et al.  Monoclonal antibodies for cancer immunotherapy , 2009, The Lancet.

[29]  Robert F. Murphy,et al.  Deformation-based nonlinear dimension reduction: Applications to nuclear morphometry , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[30]  L. Wallrath,et al.  Connections between epigenetic gene silencing and human disease. , 2007, Mutation research.

[31]  Joshua K. Hartshorne Visual Working Memory Capacity and Proactive Interference , 2008, PloS one.

[32]  Allen R. Tannenbaum,et al.  An Efficient Numerical Method for the Solution of the L2 Optimal Mass Transfer Problem , 2010, SIAM J. Sci. Comput..

[33]  M. Aizerman,et al.  Theoretical Foundations of the Potential Function Method in Pattern Recognition Learning , 1964 .

[34]  Tsai Th,et al.  Nuclear area measurements of parathyroid adenoma, parathyroid hyperplasia and thyroid follicular adenoma. A comparison. , 1997 .

[35]  Fritz Albregtsen,et al.  New texture features based on the complexity curve , 1999, Pattern Recognit..

[36]  Ann B. Lee,et al.  Diffusion maps and coarse-graining: a unified framework for dimensionality reduction, graph partitioning, and data set parameterization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[38]  Desok Kim,et al.  Java Web Start based software for automated quantitative nuclear analysis of prostate cancer and benign prostate hyperplasia , 2005, Biomedical engineering online.

[39]  Ewert Bengtsson,et al.  A Feature Set for Cytometry on Digitized Microscopic Images , 2003, Analytical cellular pathology : the journal of the European Society for Analytical Cellular Pathology.

[40]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[41]  I Salmon,et al.  Comparison of morphonuclear features in normal, benign and neoplastic thyroid tissue by digital cell image analysis. , 1992, Analytical and quantitative cytology and histology.

[42]  Alejandro F Frangi,et al.  Automatic construction of 3-D statistical deformation models of the brain using nonrigid registration , 2003, IEEE Transactions on Medical Imaging.

[43]  Thomas Gahm,et al.  Automated microscopy in diagnostic histopathology: From image processing to automated reasoning , 1997 .

[44]  Michael C. Hout,et al.  Multidimensional Scaling , 2003, Encyclopedic Dictionary of Archaeology.

[45]  Wei Wang,et al.  Detection and classification of thyroid follicular lesions based on nuclear structure from histopathology images , 2010, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[46]  Padraig Cunningham,et al.  An Assessment of Alternative Strategies for Constructing EMD-Based Kernel Functions for Use in an SVM for Image Classification , 2007, 2007 International Workshop on Content-Based Multimedia Indexing.

[47]  K. Mardia,et al.  Statistical Shape Analysis , 1998 .

[48]  Kim L. Boyer,et al.  Computer-aided evaluation of neuroblastoma on whole-slide histology images: Classifying grade of neuroblastic differentiation , 2009, Pattern Recognit..

[49]  T H Tsai,et al.  Nuclear area measurements of parathyroid adenoma, parathyroid hyperplasia and thyroid follicular adenoma. A comparison. , 1997, Analytical and quantitative cytology and histology.

[50]  U. Grenander,et al.  Computational anatomy: an emerging discipline , 1998 .

[51]  Guido Gerig,et al.  Unbiased diffeomorphic atlas construction for computational anatomy , 2004, NeuroImage.

[52]  Ulrich H.-G. Kreßel,et al.  Pairwise classification and support vector machines , 1999 .

[53]  G. Papanicolaou,et al.  New cancer diagnosis , 1973 .

[54]  Lin Yang,et al.  Virtual Microscopy and Grid-Enabled Decision Support for Large-Scale Analysis of Imaged Pathology Specimens , 2009, IEEE Transactions on Information Technology in Biomedicine.

[55]  Tsukasa Ashihara,et al.  Morphological abstraction of thyroid tumor cell nuclei using morphometry with factor analysis , 2003, Microscopy research and technique.

[56]  Mukund Desai,et al.  Performance evaluation of multiresolution texture analysis of stem cell chromatin , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[57]  Hai-Shan Wu,et al.  Applications of Image Analysis to Anatomic Pathology: Realities and Promises , 2003, Cancer investigation.

[58]  Heike Allgayer,et al.  Molecular targeted therapies for breast cancer treatment , 2008, Breast Cancer Research.

[59]  Lei Zhu,et al.  Optimal Mass Transport for Registration and Warping , 2004, International Journal of Computer Vision.

[60]  Patrick Haffner,et al.  Support vector machines for histogram-based image classification , 1999, IEEE Trans. Neural Networks.

[61]  Robert F. Murphy,et al.  Nuclear segmentation in microscope cell images: A hand-segmented dataset and comparison of algorithms , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[62]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[63]  W. Ma,et al.  Novel Agents on the Horizon for Cancer Therapy , 2009, CA: a cancer journal for clinicians.

[64]  B. Yener,et al.  Automated cancer diagnosis based on histopathological images : a systematic survey , 2005 .

[65]  P. Cavanagh,et al.  The Capacity of Visual Short-Term Memory is Set Both by Visual Information Load and by Number of Objects , 2004, Psychological science.

[66]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[67]  L. Wallrath,et al.  Linking Heterochromatin Protein 1 (HP1) to cancer progression. , 2008, Mutation research.

[68]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[69]  Daniele Zink,et al.  Nuclear structure in cancer cells , 2004, Nature Reviews Cancer.

[70]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[71]  Fritz Albregtsen,et al.  Adaptive gray level run length features from class distance matrices , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[72]  Carey E. Priebe,et al.  Collaborative computational anatomy: An MRI morphometry study of the human brain via diffeomorphic metric mapping , 2009, Human Brain Mapping.