Integrated diagnostics: a conceptual framework with examples

Abstract With the advent of digital pathology, imaging scientists have begun to develop computerized image analysis algorithms for making diagnostic (disease presence), prognostic (outcome prediction), and theragnostic (choice of therapy) predictions from high resolution images of digitized histopathology. One of the caveats to developing image analysis algorithms for digitized histopathology is the ability to deal with highly dense, information rich datasets; datasets that would overwhelm most computer vision and image processing algorithms. Over the last decade, manifold learning and non-linear dimensionality reduction schemes have emerged as popular and powerful machine learning tools for pattern recognition problems. However, these techniques have thus far been applied primarily to classification and analysis of computer vision problems (e.g., face detection). In this paper, we discuss recent work by a few groups in the application of manifold learning methods to problems in computer aided diagnosis, prognosis, and theragnosis of digitized histopathology. In addition, we discuss some exciting recent developments in the application of these methods for multi-modal data fusion and classification; specifically the building of meta-classifiers by fusion of histological image and proteomic signatures for prostate cancer outcome prediction. Clin Chem Lab Med 2010;48:989–98.

[1]  Hong Qiao,et al.  Learning an Intrinsic-Variable Preserving Manifold for Dynamic Visual Tracking , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  Gyan Bhanot,et al.  Computerized Image-Based Detection and Grading of Lymphocytic Infiltration in HER2+ Breast Cancer Histopathology , 2010, IEEE Transactions on Biomedical Engineering.

[3]  Yonghong Peng,et al.  A novel feature selection approach for biomedical data classification , 2010, J. Biomed. Informatics.

[4]  Aapo Hyvärinen,et al.  Independent component analysis of short-time Fourier transforms for spontaneous EEG/MEG analysis , 2010, NeuroImage.

[5]  Masato Okada,et al.  Applying Manifold Learning to Plotting Approximate Contour Trees , 2009, IEEE Transactions on Visualization and Computer Graphics.

[6]  Wade T. Rogers,et al.  FlowFP: A Bioconductor Package for Fingerprinting Flow Cytometric Data , 2009, Adv. Bioinformatics.

[7]  Gyan Bhanot,et al.  Expectation Maximization driven Geodesic Active Contour with Overlap Resolution (EMaGACOR): Application to Lymphocyte Segmentation on Breast Cancer Histopathology , 2009, BIBE.

[8]  Peng Zhang,et al.  Nonlinear Dimensionality Reduction by Locally Linear Inlaying , 2009, IEEE Transactions on Neural Networks.

[9]  Raviv Raich,et al.  Analysis of clinical flow cytometric immunophenotyping data by clustering on statistical manifolds: Treating flow cytometry data as high‐dimensional objects , 2009, Cytometry. Part B, Clinical cytometry.

[10]  Metin Nafi Gürcan,et al.  Adaptive Discriminant Wavelet Packet Transform and Local Binary Patterns for Meningioma Subtype Classification , 2008, MICCAI.

[11]  Hongbin Zha,et al.  Riemannian Manifold Learning , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  M. Rubin,et al.  Interobserver reproducibility of Gleason grading: evaluation using prostate cancer tissue microarrays , 2008, Journal of Cancer Research and Clinical Oncology.

[13]  Xuelong Li,et al.  Discriminant Locally Linear Embedding With High-Order Tensor Data , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  G. Bhanot,et al.  Manifold learning with graph-based features for identifying extent of lymphocytic infiltration from high grade , HER 2 + breast cancer histology , 2008 .

[15]  Gabriela Alexe,et al.  High expression of lymphocyte-associated genes in node-negative HER2+ breast cancers correlates with lower recurrence rates. , 2007, Cancer research.

[16]  Mikhail Teverovskiy,et al.  Multifeature Prostate Cancer Diagnosis and Gleason Grading of Histological Images , 2007, IEEE Transactions on Medical Imaging.

[17]  Sergio G Veloso,et al.  Interobserver agreement of Gleason score and modified Gleason score in needle biopsy and in surgical specimen of prostate cancer. , 2007, International braz j urol : official journal of the Brazilian Society of Urology.

[18]  Nasir M. Rajpoot,et al.  Comparative analysis of discriminant wavelet packet features and raw image features for classification of meningioma subtypes , 2007 .

[19]  Anant Madabhushi,et al.  AUTOMATED GRADING OF PROSTATE CANCER USING ARCHITECTURAL AND TEXTURAL IMAGE FEATURES , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[20]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Frédéric Maire,et al.  Manifold Learning for Robot Navigation , 2006, Int. J. Neural Syst..

[22]  Anant Madabhushi,et al.  A Boosting Cascade for Automated Detection of Prostate Cancer from Digitized Histology , 2006, MICCAI.

[23]  Edward R. Dougherty,et al.  What should be expected from feature selection in small-sample settings , 2006, Bioinform..

[24]  W. Finn,et al.  Unsupervised immunophenotypic profiling of chronic lymphocytic leukemia , 2006, Cytometry. Part B, Clinical cytometry.

[25]  Anil K. Jain,et al.  Incremental nonlinear dimensionality reduction by manifold learning , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  A. Madabhushi,et al.  Distinguishing Lesions from Posterior Acoustic Shadowing in Breast Ultrasound via Non-Linear Dimensionality Reduction , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Jeffrey L. Solka,et al.  Spectral embedding finds meaningful (relevant) structure in image and microarray data , 2005, BMC Bioinformatics.

[28]  Jianbo Shi,et al.  Graph Embedding to Improve Supervised Classification and Novel Class Detection: Application to Prostate Cancer , 2005, MICCAI.

[29]  Kashif Rajpoot,et al.  SVM Optimization for Hyperspectral Colon Tissue Cell Classification , 2004, MICCAI.

[30]  Josef Kittler,et al.  Fast branch & bound algorithms for optimal feature selection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  L. Egevad,et al.  Interobserver reproducibility of percent Gleason grade 4/5 in prostate biopsies. , 2004, The Journal of urology.

[32]  James Theiler,et al.  Online Feature Selection using Grafting , 2003, ICML.

[33]  P. Stadler,et al.  Centers of complex networks. , 2003, Journal of theoretical biology.

[34]  Hamid Soltanian-Zadeh,et al.  Multiwavelet grading of pathological images of prostate , 2003, IEEE Transactions on Biomedical Engineering.

[35]  Ewert Bengtsson,et al.  A Feature Set for Cytometry on Digitized Microscopic Images , 2003, Analytical cellular pathology : the journal of the European Society for Analytical Cellular Pathology.

[36]  L. Egevad,et al.  Interobserver reproducibility of percent Gleason grade 4/5 in total prostatectomy specimens. , 2002, The Journal of urology.

[37]  M. Xiong,et al.  Biomarker Identification by Feature Wrappers , 2022 .

[38]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[39]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[40]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[41]  Aapo Hyvärinen,et al.  Nonlinear independent component analysis: Existence and uniqueness results , 1999, Neural Networks.

[42]  B Weyn,et al.  Automated breast tumor diagnosis and grading based on wavelet chromatin texture description. , 1998, Cytometry.

[43]  Bayan S. Sharif,et al.  Microscopic image analysis for quantitative measurement and feature identification of normal and cancerous colonic mucosa , 1998, IEEE Transactions on Information Technology in Biomedicine.

[44]  A N Esgiar,et al.  Automated feature extraction and identification of colon carcinoma. , 1998, Analytical and quantitative cytology and histology.

[45]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[46]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[48]  L Kuncheva An aggregation of pro and con evidence for medical decision support systems. , 1993, Computers in biology and medicine.

[49]  R. Marcelpoil,et al.  Normalization of the minimum spanning tree. , 1993, Analytical cellular pathology : the journal of the European Society for Analytical Cellular Pathology.

[50]  R Albert,et al.  Three-dimensional image processing for morphometric analysis of epithelium sections. , 1992, Cytometry.

[51]  L I Kuncheva,et al.  Evaluation of computerized medical diagnostic decisions via fuzzy sets. , 1991, International journal of bio-medical computing.

[52]  L I Kuncheva,et al.  Fuzzy multi-level classifier for medical applications. , 1990, Computers in biology and medicine.

[53]  I. Jolliffe Principal Component Analysis , 2005 .