A 3D Deep Residual Convolutional Neural Network for Differential Diagnosis of Parkinsonian Syndromes on 18F-FDG PET Images

Idiopathic Parkinsons disease and atypical parkinsonian syndromes have similar symptoms at early disease stages, which makes the early differential diagnosis difficult. Positron emission tomography with 18F-FDG shows the ability to assess early neuronal dysfunction of neurodegenerative diseases and is well established for clinical use. In the past decades, machine learning methods have been widely used for the differential diagnosis of parkinsonism based on metabolic patterns. Unlike these conventional machine learning methods relying on hand-crafted features, the deep convolutional neural networks, which have achieved significant success in medical applications recently, have the advantage of learning salient feature representations automatically and effectively. This advantage may offer more appropriate invisible features extracted from data for the enhancement of the diagnosis accuracy. Therefore, this paper develops a 3D deep convolutional neural network on 18F-FDG PET images for the automated early diagnosis. Furthermore, we depicted in saliency maps the decision mechanism of the deep learning method to assist the physiological interpretation of deep learning performance. The proposed method was evaluated on a dataset with 920 patients. In addition to improving the accuracy in the differential diagnosis of parkinsonism compared to state-of-the-art approaches, the deep learning methods also discovered saliency features in a number of critical regions (e.g., midbrain), which are widely accepted as characteristic pathological regions for movement disorders but were ignored in the conventional analysis of FDG PET images.

[1]  James Ralph Moeller,et al.  Highly automated computer-aided diagnosis of neurological disorders using functional brain imaging , 2006, SPIE Medical Imaging.

[2]  Anne Corbett,et al.  Latest treatment options for Alzheimer’s disease, Parkinson’s disease dementia and dementia with Lewy bodies , 2014, Expert opinion on pharmacotherapy.

[3]  Ronald M. Summers,et al.  Improving Computer-Aided Detection Using Convolutional Neural Networks and Random View Aggregation , 2015, IEEE Transactions on Medical Imaging.

[4]  V Lambrecq,et al.  [Deep-brain stimulation of the internal pallidum in multiple system atrophy]. , 2008, Revue neurologique.

[5]  A. Lees,et al.  What features improve the accuracy of clinical diagnosis in Parkinson's disease , 1992, Neurology.

[6]  D. Shen,et al.  Computer-Aided Diagnosis with Deep Learning Architecture: Applications to Breast Lesions in US Images and Pulmonary Nodules in CT Scans , 2016, Scientific Reports.

[7]  Ronald M. Summers,et al.  Machine learning and radiology , 2012, Medical Image Anal..

[8]  David Eidelberg,et al.  Metabolic brain networks in translational neurology: Concepts and applications , 2012, Annals of neurology.

[9]  Kevin Waugh,et al.  DeepStack: Expert-level artificial intelligence in heads-up no-limit poker , 2017, Science.

[10]  Andrea Vedaldi,et al.  Instance Normalization: The Missing Ingredient for Fast Stylization , 2016, ArXiv.

[11]  Chris C. Tang,et al.  Differential diagnosis of parkinsonism: a metabolic imaging study using pattern analysis , 2010, The Lancet Neurology.

[12]  Seong-Whan Lee,et al.  Latent feature representation with stacked auto-encoder for AD/MCI diagnosis , 2013, Brain Structure and Function.

[13]  Nassir Navab,et al.  Deep Learning on 18F-FDG PET Imaging for Differential Diagnosis of Parkinsonian Syndromes , 2018 .

[14]  Alan C. Evans,et al.  Early brain development in infants at high risk for autism spectrum disorder , 2017, Nature.

[15]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[16]  Thomas Brox,et al.  Striving for Simplicity: The All Convolutional Net , 2014, ICLR.

[17]  Yoav Ben-Shlomo,et al.  The accuracy of diagnosis of parkinsonian syndromes in a specialist movement disorder service. , 2002, Brain : a journal of neurology.

[18]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[19]  P Sandroni,et al.  Second consensus statement on the diagnosis of multiple system atrophy , 2008, Neurology.

[20]  Vonck Kristl,et al.  Deep brain stimulation of the internal pallidum in multiple system atrophy. , 2006 .

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[23]  Gordon H Baltuch,et al.  Subthalamic nucleus deep brain stimulation in a patient with levodopa-responsive multiple system atrophy. Case report. , 2004, Journal of neurosurgery.