Practical applications of machine learning in imaging trials

Machine learning and deep learning are ubiquitous across a wide variety of scientific disciplines, including medical imaging. An overview of multiple application areas along the imaging chain where deep learning methods are utilized in discovery and clinical quantitative imaging trials is presented. Example application areas along the imaging chain include quality control, preprocessing, segmentation, and scoring. Within each area, one or more specific applications is demonstrated, such as automated structural brain MRI quality control assessment in a core lab environment, super-resolution MRI preprocessing for neurodegenerative disease quantification in translational clinical trials, and multimodal PET/CT tumor segmentation in prostate cancer trials. The quantitative output of these algorithms is described, including their impact on decision making and relationship to traditional read-based methods. Development and deployment of these techniques for use in quantitative imaging trials presents unique challenges. The interplay between technical and scientific domain knowledge required for algorithm development is highlighted. The infrastructure surrounding algorithm deployment is critical, given regulatory, method robustness, computational, and performance considerations. The sensitivity of a given technique to these considerations and thus complexity of deployment is task- and phase-dependent. Context is provided for the infrastructure surrounding these methods, including common strategies for data flow, storage, access, and dissemination as well as application-specific considerations for individual use cases.

[1]  Paul H Yi,et al.  Artificial Intelligence and Radiology: Collaboration Is Key. , 2018, Journal of the American College of Radiology : JACR.

[2]  D. Murphy,et al.  Prognostic biomarkers in men with metastatic castration-resistant prostate cancer receiving [177Lu]-PSMA-617 , 2020, European Journal of Nuclear Medicine and Molecular Imaging.

[3]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  A. Buck,et al.  Prognostic implications of dual tracer PET/CT: PSMA ligand and [18F]FDG PET/CT in patients undergoing [177Lu]PSMA radioligand therapy , 2020, European Journal of Nuclear Medicine and Molecular Imaging.

[5]  K. Rahbar,et al.  PSMA PET total tumor volume predicts outcome of patients with advanced prostate cancer receiving [177Lu]Lu-PSMA-617 radioligand therapy in a bicentric analysis , 2020, European Journal of Nuclear Medicine and Molecular Imaging.

[6]  T. Wong,et al.  AI for medical imaging goes deep , 2018, Nature Medicine.

[7]  W. Segars,et al.  4D XCAT phantom for multimodality imaging research. , 2010, Medical physics.

[8]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[9]  Gregory Shakhnarovich,et al.  Deep Back-Projection Networks for Super-Resolution , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Gabriel A. Devenyi,et al.  ANTsX: A dynamic ecosystem for quantitative biological and medical imaging , 2020, medRxiv.

[11]  Baris Turkbey,et al.  The Kinetics and Reproducibility of 18F-Sodium Fluoride for Oncology Using Current PET Camera Technology , 2012, The Journal of Nuclear Medicine.

[12]  M. Mazurowski Artificial Intelligence May Cause a Significant Disruption to the Radiology Workforce. , 2019, Journal of the American College of Radiology : JACR.

[13]  Krzysztof J. Gorgolewski,et al.  MRIQC: Advancing the automatic prediction of image quality in MRI from unseen sites , 2016, bioRxiv.

[14]  P. Swain,et al.  Wireless capsule endoscopy. , 2002, The Israel Medical Association journal : IMAJ.

[15]  Curtis P. Langlotz,et al.  Will Artificial Intelligence Replace Radiologists? , 2019, Radiology. Artificial intelligence.

[16]  W. Segars,et al.  4D XCAT phantom for multimodality imaging research. , 2010, Medical physics.

[17]  F. Sardanelli,et al.  Artificial intelligence in medical imaging: threat or opportunity? Radiologists again at the forefront of innovation in medicine , 2018, European Radiology Experimental.

[18]  Russell A. Poldrack,et al.  Crowdsourced MRI quality metrics and expert quality annotations for training of humans and machines , 2018 .

[19]  P. Choyke,et al.  Novel PET imaging methods for prostate cancer , 2020, World Journal of Urology.

[20]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[21]  K. Rahbar,et al.  Analysis of PSMA expression and outcome in patients with advanced Prostate Cancer receiving 177Lu-PSMA-617 Radioligand Therapy , 2020, Theranostics.