Quantitative integration of imaging and non-imaging data: application to integrating multi-parametric MRI for prostate cancer diagnosis, grading and treatment evaluation

OF THE DISSERTATION Quantitative Integration of Imaging and Non-imaging Data: Application to Integrating Multi-parametric MRI for Prostate Cancer Diagnosis, Grading and Treatment Evaluation by Pallavi Tiwari Dissertation Director: Anant Madabhushi The problem of data integration involving imaging and non-imaging modalities is largely unexplored in the biomedical field, mainly due to the challenges in quantitatively combining such heterogeneous modalities existing in different dimensions and scales. Although several methods have been proposed in the literature involving quantitative integration of multi-protocol imaging, there has been a paucity of similar biomedical tools for quantitative integration of imaging and non-imaging data. In this work, we present novel data integration schemes to overcome the aforementioned challenges limiting the integration of imaging and non-imaging modalities, and hence improve disease characterization. Our novel data integration methods are applied to integration of multi-parametric Magnetic Resonance (MR) imaging (MP-MRI)-structural MR imaging with metabolic spectroscopic information (non-imaging) for improved prostate cancer (CaP) diagnosis, grading, and treatment evaluation post-radiation therapy (RT). To this end, we have developed novel data integration schemes such as, Multimodal Wavelet Embedding Representation for data Combination (MaWERiC), and

[1]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[2]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[3]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[4]  D. Gabor,et al.  Theory of communication. Part 1: The analysis of information , 1946 .

[5]  Dennis Gabor,et al.  Theory of communication , 1946 .

[6]  Richard Bellman,et al.  Adaptive Control Processes: A Guided Tour , 1961, The Mathematical Gazette.

[7]  D. Gleason Classification of prostatic carcinomas. , 1966, Cancer chemotherapy reports.

[8]  Gleason Df Classification of prostatic carcinomas. , 1966 .

[9]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[10]  P. Luyten,et al.  Accurate quantification of in vivo 31P NMR signals using the variable projection method and prior knowledge , 1988, Magnetic resonance in medicine.

[11]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  P. Comon Independent Component Analysis , 1992 .

[14]  Ronald R. Coifman,et al.  Entropy-based algorithms for best basis selection , 1992, IEEE Trans. Inf. Theory.

[15]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[16]  John C. Russ,et al.  The Image Processing Handbook , 2016, Microscopy and Microanalysis.

[17]  M. Zweig,et al.  Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. , 1993, Clinical chemistry.

[18]  D. Bostwick Grading prostate cancer. , 1994, American journal of clinical pathology.

[19]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[20]  P. Carroll,et al.  Three-dimensional H-1 MR spectroscopic imaging of the in situ human prostate with high (0.24-0.7-cm3) spatial resolution. , 1996, Radiology.

[21]  CHRISTOPH BUSCH,et al.  Wavelet based texture segmentation of multi-modal tomographic images , 1997, Comput. Graph..

[22]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[23]  J. Kurhanewicz,et al.  Improved water and lipid suppression for 3D PRESS CSI using rf band selective inversion with gradient dephasing (basing) , 1997, Magnetic resonance in medicine.

[24]  M. van der Graaf,et al.  In vivo proton MR spectroscopy reveals altered metabolite content in malignant prostate tissue. , 1997, Anticancer research.

[25]  J. Srigley,et al.  Interobserver variation in prostate cancer Gleason scoring: are there implications for the design of clinical trials and treatment strategies? , 1997, Clinical oncology (Royal College of Radiologists (Great Britain)).

[26]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  P. Carroll,et al.  Prostate cancer: localization with three-dimensional proton MR spectroscopic imaging--clinicopathologic study. , 1999, Radiology.

[28]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[29]  Thomas G. Dietterich Ensemble Methods in Machine Learning , 2000, Multiple Classifier Systems.

[30]  J. Kurhanewicz,et al.  Very selective suppression pulses for clinical MRSI studies of brain and prostate cancer , 2000, Magnetic resonance in medicine.

[31]  Nicu Sebe,et al.  Wavelet based texture classification , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[32]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[33]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[34]  C. Amling,et al.  Extensive repeat transrectal ultrasound guided prostate biopsy in patients with previous benign sextant biopsies. , 2000, The Journal of urology.

[35]  M S Cohen,et al.  Rapid and effective correction of RF inhomogeneity for high field magnetic resonance imaging , 2000, Human brain mapping.

[36]  D. Vigneron,et al.  An automated technique for the quantitative assessment of 3D‐MRSI data from patients with glioma , 2001, Journal of magnetic resonance imaging : JMRI.

[37]  Bernhard Schölkopf,et al.  A Generalized Representer Theorem , 2001, COLT/EuroCOLT.

[38]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[39]  P. Dettmar,et al.  Limited value of endorectal magnetic resonance imaging and transrectal ultrasonography in the staging of clinically localized prostate cancer , 2001, BJU international.

[40]  A. Wunderlich,et al.  Multimodal Cranial Neuronavigation: Direct Integration of Functional Magnetic Resonance Imaging and Positron Emission Tomography Data: Technical Note , 2001, Neurosurgery.

[41]  Bernhard Schölkopf,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[42]  S. Cerutti,et al.  A wavelet packets decomposition algorithm for quantification of in vivo (1)H-MRS parameters. , 2002, Medical engineering & physics.

[43]  J. Kurhanewicz,et al.  Combined magnetic resonance imaging and spectroscopic imaging approach to molecular imaging of prostate cancer , 2002, Journal of magnetic resonance imaging : JMRI.

[44]  M. Kattan,et al.  Transition zone prostate cancer: metabolic characteristics at 1H MR spectroscopic imaging--initial results. , 2003, Radiology.

[45]  Jun Zheng,et al.  Wavelet based feature reduction method for effective classification of hyperspectral data , 2003, Proceedings ITCC 2003. International Conference on Information Technology: Coding and Computing.

[46]  J. Kurhanewicz,et al.  Magnetic Resonance Imaging and Spectroscopic Imaging of Prostate Cancer , 2001, Cancer investigation.

[47]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[48]  William Wells,et al.  Detection of prostate cancer by integration of line-scan diffusion, T2-mapping and T2-weighted magnetic resonance imaging; a multichannel statistical classifier. , 2003, Medical physics.

[49]  Nello Cristianini,et al.  Kernel-Based Data Fusion and Its Application to Protein Function Prediction in Yeast , 2003, Pacific Symposium on Biocomputing.

[50]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[51]  Nello Cristianini,et al.  A statistical framework for genomic data fusion , 2004, Bioinform..

[52]  J. Kurhanewicz,et al.  Endorectal MR imaging and MR spectroscopic imaging for locally recurrent prostate cancer after external beam radiation therapy: preliminary experience. , 2004, Radiology.

[53]  J. Kurhanewicz,et al.  Use of MRI and spectroscopy in evaluation of external beam radiotherapy for prostate cancer. , 2004, International journal of radiation oncology, biology, physics.

[54]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[55]  P. Carroll,et al.  Prostate depiction at endorectal MR spectroscopic imaging: investigation of a standardized evaluation system. , 2004, Radiology.

[56]  E. Klein What is ‘insignificant’ prostate carcinoma? , 2004, Cancer.

[57]  J. Stanford,et al.  Five-year outcomes after prostatectomy or radiotherapy for prostate cancer: the prostate cancer outcomes study. , 2004, Journal of the National Cancer Institute.

[58]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[59]  Zhuowen Tu,et al.  Probabilistic boosting-tree: learning discriminative models for classification, recognition, and clustering , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[60]  M. Sdika,et al.  Time‐domain semi‐parametric estimation based on a metabolite basis set , 2005, NMR in biomedicine.

[61]  Dimitris N. Metaxas,et al.  Automated detection of prostatic adenocarcinoma from high-resolution ex vivo MRI , 2005, IEEE Transactions on Medical Imaging.

[62]  Pramod K. Varshney,et al.  An adaptive multimodal biometric management algorithm , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[63]  M. Kattan,et al.  Correlation of proton MR spectroscopic imaging with gleason score based on step-section pathologic analysis after radical prostatectomy. , 2005, Radiology.

[64]  Ramón Díaz-Uriarte,et al.  Gene selection and classification of microarray data using random forest , 2006, BMC Bioinformatics.

[65]  Torsten Rohlfing,et al.  Information Fusion in Biomedical Image Analysis: Combination of Data vs. Combination of Interpretations , 2005, IPMI.

[66]  E. Squillaci,et al.  MR spectroscopy of prostate cancer. Initial clinical experience. , 2005, Journal of experimental & clinical cancer research : CR.

[67]  L. Klotz Active surveillance for prostate cancer: for whom? , 2005, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[68]  Arend Heerschap,et al.  Combination of feature‐reduced MR spectroscopic and MR imaging data for improved brain tumor classification , 2005, NMR in biomedicine.

[69]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[70]  P. Carroll,et al.  Magnetic resonance imaging and spectroscopy of prostate cancer. , 2006, Reviews in urology.

[71]  A. Wetter,et al.  Combined MRI and MR spectroscopy of the prostate before radical prostatectomy. , 2006, AJR. American journal of roentgenology.

[72]  John C. Russ The Image Processing Handbook, Fifth Edition (Image Processing Handbook) , 2006 .

[73]  C. Floyd,et al.  Optimized approach to decision fusion of heterogeneous data for breast cancer diagnosis. , 2006, Medical physics.

[74]  C. Kim,et al.  Localization of Prostate Cancer Using 3T MRI: Comparison of T2-Weighted and Dynamic Contrast-Enhanced Imaging , 2006, Journal of computer assisted tomography.

[75]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[76]  M. Kattan,et al.  Prediction of organ-confined prostate cancer: incremental value of MR imaging and MR spectroscopic imaging to staging nomograms. , 2006, Radiology.

[77]  Haitao Zhao Combining labeled and unlabeled data with graph embedding , 2006, Neurocomputing.

[78]  Shekhar Verma,et al.  Feature selection using Haar wavelet power spectrum , 2006, BMC Bioinformatics.

[79]  H. Huisman,et al.  Prostate cancer localization with dynamic contrast-enhanced MR imaging and proton MR spectroscopic imaging. , 2006, Radiology.

[80]  Jarkko Venna,et al.  Local multidimensional scaling , 2006, Neural Networks.

[81]  B Michael Kelm,et al.  Automated estimation of tumor probability in prostate magnetic resonance spectroscopic imaging: Pattern recognition vs quantification , 2007, Magnetic resonance in medicine.

[82]  P. Baraldi,et al.  Multimodal MRI in the characterization of glial neoplasms: the combined role of single-voxel MR spectroscopy, diffusion imaging and echo-planar perfusion imaging , 2007, Neuroradiology.

[83]  Matilde Santos Peñas,et al.  Classification of Biomedical Signals Using a Haar 4 Wavelet Transform and a Hamming Neural Network , 2007, IWINAC.

[84]  M. Roach,et al.  Current role and future perspectives of magnetic resonance spectroscopy in radiation oncology for prostate cancer. , 2007, Neoplasia.

[85]  M. Barry,et al.  Detection of prostate cancer via biopsy in the Medicare-SEER population during the PSA era. , 2007, Journal of the National Cancer Institute.

[86]  M. Kattan,et al.  The utility of magnetic resonance imaging and spectroscopy for predicting insignificant prostate cancer: an initial analysis , 2007, BJU international.

[87]  Yuxiao Hu,et al.  Learning a Spatially Smooth Subspace for Face Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[88]  T. Scheenen,et al.  Three-dimensional proton MR spectroscopy of human prostate at 3 T without endorectal coil: feasibility. , 2007, Radiology.

[89]  Theodoros Damoulas,et al.  Probabilistic multi-class multi-kernel learning: on protein fold recognition and remote homology detection , 2008, Bioinform..

[90]  D. Pucar,et al.  The role of imaging in the detection of prostate cancer local recurrence after radiation therapy and surgery , 2008, Current opinion in urology.

[91]  Shinichi Nakajima,et al.  Semi-Supervised Local Fisher Discriminant Analysis for Dimensionality Reduction , 2008, PAKDD.

[92]  K. Berberidis,et al.  A computer-aided system for the detection of prostate cancer based on magnetic resonance image analysis , 2008, 2008 3rd International Symposium on Communications, Control and Signal Processing.

[93]  Gustavo Carneiro,et al.  Detection and Measurement of Fetal Anatomies from Ultrasound Images using a Constrained Probabilistic Boosting Tree , 2008, IEEE Transactions on Medical Imaging.

[94]  Hongmin Cai,et al.  Multiparametric tissue characterization of brain neoplasms and their recurrence using pattern classification of MR images. , 2008, Academic radiology.

[95]  H. Hricak,et al.  Assessment of biologic aggressiveness of prostate cancer: correlation of MR signal intensity with Gleason grade after radical prostatectomy. , 2008, Radiology.

[96]  A. Madabhushi,et al.  Investigating the Efficacy of Nonlinear Dimensionality Reduction Schemes in Classifying Gene and Protein Expression Studies , 2008, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[97]  Hongbin Zha,et al.  Riemannian Manifold Learning , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[98]  P. Carroll,et al.  Multiparametric magnetic resonance imaging in prostate cancer: present and future , 2008, Current opinion in urology.

[99]  Anant Madabhushi,et al.  A Comprehensive Segmentation, Registration, and Cancer Detection Scheme on 3 Tesla In VivoProstate DCE-MRI , 2008, MICCAI.

[100]  Dirk Van den Poel,et al.  FACULTEIT ECONOMIE , 2007 .

[101]  Yun Zhang,et al.  Comparison and improvement of wavelet‐based image fusion , 2008 .

[102]  Anant Madabhushi,et al.  Consensus-Locally Linear Embedding (C-LLE): Application to Prostate Cancer Detection on Magnetic Resonance Spectroscopy , 2008, MICCAI.

[103]  Anant Madabhushi,et al.  Spectral Embedding Based Probabilistic Boosting Tree (ScEPTre): Classifying High Dimensional Heterogeneous Biomedical Data , 2009, MICCAI.

[104]  I. Hsu,et al.  T2-Weighted endorectal magnetic resonance imaging of prostate cancer after external beam radiation therapy. , 2009, International braz j urol : official journal of the Brazilian Society of Urology.

[105]  A. Evans,et al.  Prostate cancer detection with multi‐parametric MRI: Logistic regression analysis of quantitative T2, diffusion‐weighted imaging, and dynamic contrast‐enhanced MRI , 2009, Journal of magnetic resonance imaging : JMRI.

[106]  Daoqiang Zhang,et al.  A New Discriminant Principal Component Analysis Method with Partial Supervision , 2009, Neural Processing Letters.

[107]  Sabine Van Huffel,et al.  Nosologic imaging of the brain: segmentation and classification using MRI and MRSI , 2009, NMR in biomedicine.

[108]  Anant Madabhushi,et al.  A hierarchical spectral clustering and nonlinear dimensionality reduction scheme for detection of prostate cancer from magnetic resonance spectroscopy (MRS). , 2009, Medical physics.

[109]  H. Hricak,et al.  Correlation of MR imaging and MR spectroscopic imaging findings with Ki-67, phospho-Akt, and androgen receptor expression in prostate cancer. , 2009, Radiology.

[110]  C. Kim,et al.  Prediction of locally recurrent prostate cancer after radiation therapy: Incremental value of 3T diffusion‐weighted MRI , 2009, Journal of magnetic resonance imaging : JMRI.

[111]  Xin Liu,et al.  Prostate Cancer Segmentation With Simultaneous Estimation of Markov Random Field Parameters and Class , 2009, IEEE Transactions on Medical Imaging.

[112]  George Lee,et al.  A knowledge representation framework for integration, classification of multi-scale imaging and non-imaging data: Preliminary results in predicting prostate cancer recurrence by fusing mass spectrometry and histology , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[113]  C. Barceló-Vidal,et al.  Peripheral zone prostate cancer in patients with elevated PSA levels and low free-to-total PSA ratio: detection with MR imaging and MR spectroscopy. , 2009, Radiology.

[114]  Purang Abolmaesumi,et al.  High-throughput detection of prostate cancer in histological sections using probabilistic pairwise Markov models , 2010, Medical Image Anal..

[115]  J. Epstein An update of the Gleason grading system. , 2010, The Journal of urology.

[116]  J. Kurhanewicz,et al.  Post‐processing correction of the endorectal coil reception effects in MR spectroscopic imaging of the prostate , 2010, Journal of magnetic resonance imaging : JMRI.

[117]  G. De Meerleer,et al.  A qualitative approach to combined magnetic resonance imaging and spectroscopy in the diagnosis of prostate cancer. , 2010, European journal of radiology.

[118]  Yongyi Yang,et al.  Supervised and unsupervised methods for prostate cancer segmentation with multispectral MRI. , 2010, Medical physics.

[119]  Thomas Hambrock,et al.  Computer-assisted analysis of peripheral zone prostate lesions using T2-weighted and dynamic contrast enhanced T1-weighted MRI , 2010, Physics in medicine and biology.

[120]  A. Madabhushi,et al.  Integrated diagnostics: a conceptual framework with examples , 2010, Clinical chemistry and laboratory medicine.

[121]  C. Kim,et al.  Assessment of response to radiotherapy for prostate cancer: value of diffusion-weighted MRI at 3 T. , 2010, AJR. American journal of roentgenology.

[122]  A. Evans,et al.  Prostate tissue composition and MR measurements: investigating the relationships between ADC, T2, K(trans), v(e), and corresponding histologic features. , 2010, Radiology.

[123]  Johan A. K. Suykens,et al.  L2-norm multiple kernel learning and its application to biomedical data fusion , 2010, BMC Bioinformatics.

[124]  P. Choyke,et al.  Prostate cancer: value of multiparametric MR imaging at 3 T for detection--histopathologic correlation. , 2010, Radiology.

[125]  C. McCulloch,et al.  Locally recurrent prostate cancer after external beam radiation therapy: diagnostic performance of 1.5-T endorectal MR imaging and MR spectroscopic imaging for detection. , 2010, Radiology.

[126]  Anant Madabhushi,et al.  Semi Supervised Multi Kernel (SeSMiK) Graph Embedding: Identifying Aggressive Prostate Cancer via Magnetic Resonance Imaging and Spectroscopy , 2010, MICCAI.

[127]  Derya Yakar,et al.  Initial Results of 3-Dimensional 1H-Magnetic Resonance Spectroscopic Imaging in the Localization of Prostate Cancer at 3 Tesla: Should We Use an Endorectal Coil? , 2011, Investigative radiology.

[128]  George Lee,et al.  Multi-modal data fusion schemes for integrated classification of imaging and non-imaging biomedical data , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[129]  Anant Madabhushi,et al.  Weighted Combination of Multi-Parametric MR Imaging Markers for Evaluating Radiation Therapy Related Changes in the Prostate , 2011, Prostate Cancer Imaging.

[130]  Anant Madabhushi,et al.  Determining histology-MRI slice correspondences for defining MRI-based disease signatures of prostate cancer , 2011, Comput. Medical Imaging Graph..

[131]  Anant Madabhushi,et al.  A magnetic resonance spectroscopy driven initialization scheme for active shape model based prostate segmentation , 2011, Medical Image Anal..

[132]  Chiou-Shann Fuh,et al.  Multiple Kernel Learning for Dimensionality Reduction , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[133]  R. Lenkinski,et al.  Elastic registration of multimodal prostate MRI and histology via multiattribute combined mutual information. , 2011, Medical physics.

[134]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[135]  Hongyuan Zha,et al.  Adaptive Manifold Learning , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[136]  P Tiwari,et al.  Multimodal wavelet embedding representation for data combination (MaWERiC): integrating magnetic resonance imaging and spectroscopy for prostate cancer detection , 2012, NMR in biomedicine.

[137]  Mario Marchand,et al.  Feature Selection with Conjunctions of Decision Stumps and Learning from Microarray Data , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.