Applications of Deep Learning to Neuro-Imaging Techniques

Many clinical applications based on deep learning and pertaining to radiology have been proposed and studied in radiology for classification, risk assessment, segmentation tasks, diagnosis, prognosis, and even prediction of therapy responses. There are many other innovative applications of AI in various technical aspects of medical imaging, particularly applied to the acquisition of images, ranging from removing image artifacts, normalizing/harmonizing images, improving image quality, lowering radiation and contrast dose, and shortening the duration of imaging studies. This article will address this topic and will seek to present an overview of deep learning applied to neuroimaging techniques.

[1]  Shigeru Furui,et al.  Gadolinium deposition in the brain. , 2016, Magnetic resonance imaging.

[2]  John M Pauly,et al.  Ultra-Low-Dose 18F-Florbetaben Amyloid PET Imaging Using Deep Learning with Multi-Contrast MRI Inputs. , 2019, Radiology.

[3]  Jin Keun Seo,et al.  Deep learning for undersampled MRI reconstruction , 2017, Physics in medicine and biology.

[4]  Jin Liu,et al.  Artifact Removal using Improved GoogLeNet for Sparse-view CT Reconstruction , 2018, Scientific Reports.

[5]  Roland Kreis,et al.  Deep learning approaches for detection and removal of ghosting artifacts in MR spectroscopy , 2018, Magnetic resonance in medicine.

[6]  Richard Kijowski,et al.  A deep learning approach for 18F-FDG PET attenuation correction , 2018, EJNMMI Physics.

[7]  Yang-Ming Zhu,et al.  Full-Dose PET Image Estimation from Low-Dose PET Image Using Deep Learning: a Pilot Study , 2018, Journal of Digital Imaging.

[8]  Vince D. Calhoun,et al.  Deep learning for neuroimaging: a validation study , 2013, Front. Neurosci..

[9]  Junshen Xu,et al.  200x Low-dose PET Reconstruction using Deep Learning , 2017, ArXiv.

[10]  Jonathan I. Tamir,et al.  Variable-Density Single-Shot Fast Spin-Echo MRI with Deep Learning Reconstruction by Using Variational Networks. , 2018, Radiology.

[11]  Mannudeep K. Kalra,et al.  Low-Dose CT with a Residual Encoder-Decoder Convolutional Neural Network (RED-CNN) , 2017, ArXiv.

[12]  Mizuho Nishio,et al.  Convolutional auto-encoder for image denoising of ultra-low-dose CT , 2017, Heliyon.

[13]  Dinggang Shen,et al.  Scalable High-Performance Image Registration Framework by Unsupervised Deep Feature Representations Learning , 2016, IEEE Transactions on Biomedical Engineering.

[14]  Daniel A Low,et al.  A neural network approach for fast, automated quantification of DIR performance , 2017, Medical physics.

[15]  Alan C. Evans,et al.  Structural neuroimaging as clinical predictor: A review of machine learning applications , 2018, NeuroImage: Clinical.

[16]  N Toki,et al.  Purification and characterization of kallikrein from plasma of patients with acute pancreatitis. , 1981, Clinical science.

[17]  James A. Nichols,et al.  Machine learning: applications of artificial intelligence to imaging and diagnosis , 2018, Biophysical Reviews.

[18]  Praneeth Sadda,et al.  Real-Time Medical Video Denoising with Deep Learning: Application to Angiography. , 2018, International journal of applied information systems.

[19]  C. Langlotz,et al.  Deep Learning in Neuroradiology , 2018, American Journal of Neuroradiology.

[20]  Sunil A. Sheth,et al.  Machine Learning in Acute Ischemic Stroke Neuroimaging , 2018, Front. Neurol..

[21]  Andrew P. Leynes,et al.  Zero-Echo-Time and Dixon Deep Pseudo-CT (ZeDD CT): Direct Generation of Pseudo-CT Images for Pelvic PET/MRI Attenuation Correction Using Deep Convolutional Neural Networks with Multiparametric MRI , 2017, The Journal of Nuclear Medicine.

[22]  Dinggang Shen,et al.  Convolutional Neural Network for Reconstruction of 7T-like Images from 3T MRI Using Appearance and Anatomical Features , 2016, LABELS/DLMIA@MICCAI.

[23]  Ekaba Bisong,et al.  Regularization for Deep Learning , 2019, Building Machine Learning and Deep Learning Models on Google Cloud Platform.

[24]  Sébastien Ourselin,et al.  Deep Convolutional Filtering for Spatio-Temporal Denoising and Artifact Removal in Arterial Spin Labelling MRI , 2018, MICCAI.

[25]  D. Holdstock Past, present--and future? , 2005, Medicine, conflict, and survival.

[26]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[27]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[28]  Shaohua Kevin Zhou,et al.  Deep Networks and Mutual Information Maximization for Cross-Modal Medical Image Synthesis , 2017, Deep Learning for Medical Image Analysis.

[29]  Won-Ki Jeong,et al.  Compressed Sensing MRI Reconstruction Using a Generative Adversarial Network With a Cyclic Loss , 2017, IEEE Transactions on Medical Imaging.

[30]  S. Choi,et al.  Improving Arterial Spin Labeling by Using Deep Learning. , 2017, Radiology.

[31]  Pierrick Coupé,et al.  MRI Denoising Using Deep Learning , 2018, Patch-MI@MICCAI.

[32]  Oleg S. Pianykh,et al.  Current Applications and Future Impact of Machine Learning in Radiology. , 2018, Radiology.

[33]  Marcus A. Badgeley,et al.  Deep learning guided stroke management: a review of clinical applications , 2017, Journal of NeuroInterventional Surgery.

[34]  Daniel Cremers,et al.  q-Space Deep Learning: Twelve-Fold Shorter and Model-Free Diffusion MRI Scans , 2016, IEEE Transactions on Medical Imaging.

[35]  P. Batchelor,et al.  International Society for Magnetic Resonance in Medicine , 1997 .

[36]  Yi Zhang,et al.  Denoising of 3-D Magnetic Resonance Images Using a Residual Encoder-Decoder Wasserstein Generative Adversarial Network , 2018, Medical Image Anal..

[37]  Dinggang Shen,et al.  Deep Learning Based Imaging Data Completion for Improved Brain Disease Diagnosis , 2014, MICCAI.

[38]  J. van Leeuwen,et al.  Neural Networks: Tricks of the Trade , 2002, Lecture Notes in Computer Science.

[39]  Ge Wang,et al.  Super-resolution MRI through Deep Learning , 2018, 1810.06776.

[40]  Jaime S. Cardoso,et al.  Deep Learning and Data Labeling for Medical Applications , 2016, Lecture Notes in Computer Science.

[41]  Srini Tridandapani,et al.  Deep Learning in Radiology. , 2018, Academic radiology.

[42]  Max A. Viergever,et al.  Generative Adversarial Networks for Noise Reduction in Low-Dose CT , 2017, IEEE Transactions on Medical Imaging.

[43]  Nicholas Ayache,et al.  Proceedings of the 10th international conference on Medical image computing and computer-assisted intervention , 2007 .

[44]  Michael Unser,et al.  CNN-Based Projected Gradient Descent for Consistent CT Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[45]  Dong Soo Lee,et al.  Generation of Structural MR Images from Amyloid PET: Application to MR-Less Quantification , 2017, The Journal of Nuclear Medicine.

[46]  Ahmed Hosny,et al.  Artificial intelligence in radiology , 2018, Nature Reviews Cancer.

[47]  Benoit M. Dawant,et al.  Medical Imaging 2010: Physics of Medical Imaging , 2010 .

[48]  Jaron J. R. Chong,et al.  Demystification of AI-driven medical image interpretation: past, present and future , 2018, European Radiology.

[49]  Daniel Rueckert,et al.  A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[50]  Hu Chen,et al.  Low-dose CT via convolutional neural network. , 2017, Biomedical optics express.

[51]  Arthur W. Toga,et al.  Retrospective correction of motion artifact affected structural MRI images using deep learning of simulated motion , 2018 .

[52]  A. McMillan,et al.  Deep learning Mr imaging–based attenuation correction for PeT/Mr imaging 1 , 2017 .

[53]  Eduard Schreibmann,et al.  A convolutional neural network to filter artifacts in spectroscopic MRI , 2018, Magnetic resonance in medicine.

[54]  Yuko Nakamura,et al.  Improvement of image quality at CT and MRI using deep learning , 2018, Japanese Journal of Radiology.

[55]  J. Pauly,et al.  Deep learning enables reduced gadolinium dose for contrast‐enhanced brain MRI , 2018, Journal of magnetic resonance imaging : JMRI.

[56]  F. Sardanelli,et al.  Artificial intelligence as a medical device in radiology: ethical and regulatory issues in Europe and the United States , 2018, Insights into Imaging.

[57]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[58]  Snehashis Roy,et al.  Synthesizing CT from Ultrashort Echo-Time MR Images via Convolutional Neural Networks , 2017, SASHIMI@MICCAI.

[59]  Habib Zaidi,et al.  Classification and evaluation strategies of auto‐segmentation approaches for PET: Report of AAPM task group No. 211 , 2017, Medical physics.

[60]  Z. Jane Wang,et al.  A CNN Regression Approach for Real-Time 2D/3D Registration , 2016, IEEE Transactions on Medical Imaging.

[61]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  Daniel Rueckert,et al.  2013 IEEE 10TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI) , 2013, ISBI 2013.

[63]  C. Pal,et al.  Deep Learning: A Primer for Radiologists. , 2017, Radiographics : a review publication of the Radiological Society of North America, Inc.

[64]  Dinggang Shen,et al.  Machine Learning in Medical Imaging , 2012, Lecture Notes in Computer Science.

[65]  Xiao Han,et al.  MR‐based synthetic CT generation using a deep convolutional neural network method , 2017, Medical physics.

[66]  Leslie Ying,et al.  Accelerating magnetic resonance imaging via deep learning , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[67]  Leonid Churilov,et al.  Advanced imaging improves prediction of hemorrhage after stroke thrombolysis , 2013, Annals of neurology.

[68]  C. Waltz Validation study. , 1988, NLN publications.

[69]  K. Hynynen,et al.  Focused ultrasound-mediated drug delivery through the blood–brain barrier , 2015, Expert review of neurotherapeutics.

[70]  Angshul Majumdar,et al.  Real-time Dynamic MRI Reconstruction using Stacked Denoising Autoencoder , 2015, ArXiv.

[71]  Alejandro F. Frangi,et al.  Simulation and Synthesis in Medical Imaging , 2018, IEEE Trans. Medical Imaging.

[72]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[73]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[74]  Jeff Wood,et al.  Super‐resolution musculoskeletal MRI using deep learning , 2018, Magnetic resonance in medicine.

[75]  Jaron J. R. Chong,et al.  Canadian Association of Radiologists White Paper on Artificial Intelligence in Radiology , 2018, Canadian Association of Radiologists journal = Journal l'Association canadienne des radiologistes.

[76]  Joana Ramalho,et al.  Gadolinium Deposition and Chronic Toxicity. , 2017, Magnetic resonance imaging clinics of North America.

[77]  C. Rowe,et al.  Amyloid Imaging with 18F-Florbetaben in Alzheimer Disease and Other Dementias , 2011, The Journal of Nuclear Medicine.

[78]  Bruno De Man,et al.  Deep learning methods for CT image-domain metal artifact reduction , 2017, Optical Engineering + Applications.

[79]  Dinggang Shen,et al.  Deep auto-context convolutional neural networks for standard-dose PET image estimation from low-dose PET/MRI , 2017, Neurocomputing.

[80]  Charlene Liew The future of radiology augmented with Artificial Intelligence: A strategy for success. , 2018, European journal of radiology.

[81]  Jaejun Yoo,et al.  Deep Residual Learning for Accelerated MRI Using Magnitude and Phase Networks , 2018, IEEE Transactions on Biomedical Engineering.

[82]  Lei Wang,et al.  Regional disparities in warm season rainfall changes over arid eastern–central Asia , 2018, Scientific Reports.

[83]  Hayit Greenspan,et al.  Virtual PET Images from CT Data Using Deep Convolutional Networks: Initial Results , 2017, SASHIMI@MICCAI.

[84]  Dong Ni,et al.  FUIQA: Fetal Ultrasound Image Quality Assessment With Deep Convolutional Networks , 2017, IEEE Transactions on Cybernetics.

[85]  Jian Sun,et al.  Deep ADMM-Net for Compressive Sensing MRI , 2016, NIPS.

[86]  C. Caplan A strategy for success. , 1988, Dental economics - oral hygiene.

[87]  Ingrid Reiser,et al.  Assessment of diagnostic image quality of computed tomography (CT) images of the lung using deep learning , 2018, Medical Imaging.

[88]  Jong Chul Ye,et al.  Cycle‐consistent adversarial denoising network for multiphase coronary CT angiography , 2018, Medical physics.

[89]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[90]  Lutz Prechelt,et al.  Early Stopping - But When? , 2012, Neural Networks: Tricks of the Trade.

[91]  Jelmer M. Wolterink,et al.  Deep MR to CT Synthesis Using Unpaired Data , 2017, SASHIMI@MICCAI.

[92]  Jae Sung Lee,et al.  Improving the Accuracy of Simultaneously Reconstructed Activity and Attenuation Maps Using Deep Learning , 2018, The Journal of Nuclear Medicine.

[93]  Y. Sitoh,et al.  Neuroimaging in epilepsy , 1998, Journal of magnetic resonance imaging : JMRI.

[94]  Morteza Mardani,et al.  Deep Generative Adversarial Neural Networks for Compressive Sensing MRI , 2019, IEEE Transactions on Medical Imaging.

[95]  Hu Chen,et al.  LEARN: Learned Experts’ Assessment-Based Reconstruction Network for Sparse-Data CT , 2017, IEEE Transactions on Medical Imaging.

[96]  Cagdas Ulas,et al.  DeepASL: Kinetic Model Incorporated Loss for Denoising Arterial Spin Labeled MRI via Deep Residual Learning , 2018, MICCAI.

[97]  A. Soricelli,et al.  Dixon-VIBE Deep Learning (DIVIDE) Pseudo-CT Synthesis for Pelvis PET/MR Attenuation Correction , 2018, The Journal of Nuclear Medicine.

[98]  J. Leung,et al.  Artificial intelligence and deep learning - Radiology's next frontier? , 2018, Clinical imaging.

[99]  Paul Babyn,et al.  Sharpness-Aware Low-Dose CT Denoising Using Conditional Generative Adversarial Network , 2017, Journal of Digital Imaging.

[100]  Steve B. Jiang,et al.  Z-Index Parameterization for Volumetric CT Image Reconstruction via 3-D Dictionary Learning , 2017, IEEE Transactions on Medical Imaging.

[101]  Shu Liao,et al.  Unsupervised Deep Feature Learning for Deformable Registration of MR Brain Images , 2013, MICCAI.

[102]  Tao Tan,et al.  Denoising of 3D magnetic resonance images with multi-channel residual learning of convolutional neural network , 2017, Japanese Journal of Radiology.

[103]  Haipeng Shen,et al.  Artificial intelligence in healthcare: past, present and future , 2017, Stroke and Vascular Neurology.

[104]  Zachary Chase Lipton The mythos of model interpretability , 2016, ACM Queue.

[105]  M. Fazal,et al.  The past, present and future role of artificial intelligence in imaging. , 2018, European journal of radiology.

[106]  C. Baird,et al.  The pilot study. , 2000, Orthopedic nursing.

[107]  Christos Davatzikos,et al.  Machine learning in neuroimaging: Progress and challenges , 2019, NeuroImage.

[108]  Fernando Calamante,et al.  Gadolinium deposition in the brain: summary of evidence and recommendations , 2017, The Lancet Neurology.

[109]  Thomas Pock,et al.  Learning a variational network for reconstruction of accelerated MRI data , 2017, Magnetic resonance in medicine.

[110]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[111]  N. Hattori,et al.  Improving the Quality of Synthetic FLAIR Images with Deep Learning Using a Conditional Generative Adversarial Network for Pixel-by-Pixel Image Translation , 2019, American Journal of Neuroradiology.

[112]  Parminder Kaur,et al.  A Review of Denoising Medical Images Using Machine Learning 
Approaches , 2017, Current medical imaging reviews.

[113]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[114]  John Seibyl,et al.  Florbetaben PET imaging to detect amyloid beta plaques in Alzheimer's disease: Phase 3 study , 2015, Alzheimer's & Dementia.

[115]  Deirdre B. Cassidy,et al.  Revisiting the risks of MRI with Gadolinium based contrast agents—review of literature and guidelines , 2015, Insights into Imaging.

[116]  Marc Niethammer,et al.  Quicksilver: Fast predictive image registration – A deep learning approach , 2017, NeuroImage.

[117]  Qian Wang,et al.  Deep embedding convolutional neural network for synthesizing CT image from T1‐Weighted MR image , 2018, Medical Image Anal..

[118]  Konstantin Nikolaou,et al.  Automated reference-free detection of motion artifacts in magnetic resonance images , 2018, Magnetic Resonance Materials in Physics, Biology and Medicine.

[119]  David L. Wilson,et al.  Computational and human observer image quality evaluation of low dose, knowledge-based CT iterative reconstruction. , 2015, Medical physics.

[120]  Dinggang Shen,et al.  Medical Image Synthesis with Deep Convolutional Adversarial Networks , 2018, IEEE Transactions on Biomedical Engineering.

[121]  Lovedeep Gondara,et al.  Medical Image Denoising Using Convolutional Denoising Autoencoders , 2016, 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW).