Deep-MEG: spatiotemporal CNN features and multiband ensemble classification for predicting the early signs of Alzheimer’s disease with magnetoencephalography

In this paper, we present the novel Deep-MEG approach in which image-based representations of magnetoencephalography (MEG) data are combined with ensemble classifiers based on deep convolutional neural networks. For the scope of predicting the early signs of Alzheimer’s disease (AD), functional connectivity (FC) measures between the brain bio-magnetic signals originated from spatially separated brain regions are used as MEG data representations for the analysis. After stacking the FC indicators relative to different frequency bands into multiple images, a deep transfer learning model is used to extract different sets of deep features and to derive improved classification ensembles. The proposed Deep-MEG architectures were tested on a set of resting-state MEG recordings and their corresponding magnetic resonance imaging scans, from a longitudinal study involving 87 subjects. Accuracy values of 89% and 87% were obtained, respectively, for the early prediction of AD conversion in a sample of 54 mild cognitive impairment subjects and in a sample of 87 subjects, including 33 healthy controls. These results indicate that the proposed Deep-MEG approach is a powerful tool for detecting early alterations in the spectral–temporal connectivity profiles and in their spatial relationships.

[1]  Saúl J. Ruiz-Gómez,et al.  Alterations of Effective Connectivity Patterns in Mild Cognitive Impairment: An MEG Study. , 2017, Journal of Alzheimer's disease : JAD.

[2]  C. Christopher Columbus,et al.  Multiscale-based multimodal image classification of brain tumor using deep learning method , 2020, Neural Computing and Applications.

[3]  Haruhiko Kishima,et al.  Automatic diagnosis of neurological diseases using MEG signals with a deep neural network , 2019, Scientific Reports.

[4]  N. Draper,et al.  Applied Regression Analysis: Draper/Applied Regression Analysis , 1998 .

[5]  Filippo Zappasodi,et al.  Deep Convolutional Neural Networks for Feature-Less Automatic Classification of Independent Components in Multi-Channel Electrophysiological Brain Recordings , 2019, IEEE Transactions on Biomedical Engineering.

[6]  Yongtian He,et al.  Deep learning for electroencephalogram (EEG) classification tasks: a review , 2019, Journal of neural engineering.

[7]  Arianna Mencattini,et al.  A deep CNN‐based approach for predicting MCI to AD conversion , 2020 .

[8]  Sterling C. Johnson,et al.  Multimodal and Multiscale Deep Neural Networks for the Early Diagnosis of Alzheimer's Disease using structural MR and FDG-PET images , 2017, ArXiv.

[9]  T. Ohshima,et al.  Magnetically sensitive nanodiamond-doped tellurite glass fibers , 2018, Scientific Reports.

[10]  E. Zorita,et al.  Variability of wind direction statistics of mean and extreme wind events over the Baltic Sea region , 2015 .

[11]  Kyong Hwan Jin,et al.  Predicting cognitive decline with deep learning of brain metabolism and amyloid imaging , 2017, Behavioural Brain Research.

[12]  Hovagim Bakardjian,et al.  EEG EVIDENCE OF COMPENSATORY MECHANISMS IN PRECLINICAL ALZHEIMER’S DISEASE , 2019, Alzheimer's & Dementia.

[13]  G. Nolte The magnetic lead field theorem in the quasi-static approximation and its use for magnetoencephalography forward calculation in realistic volume conductors. , 2003, Physics in medicine and biology.

[14]  Zhao Fan,et al.  Classification of Alzheimer’s disease based on brain MRI and machine learning , 2019, Neural Computing and Applications.

[15]  H. Storch,et al.  Statistical Analysis in Climate Research , 2000 .

[16]  N. Draper,et al.  Applied Regression Analysis. , 1967 .

[17]  Tatsuya Harada,et al.  Learning environmental sounds with end-to-end convolutional neural network , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[19]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[20]  S. Taulu,et al.  Spatiotemporal signal space separation method for rejecting nearby interference in MEG measurements , 2006, Physics in medicine and biology.

[21]  E. Olsson,et al.  Motor Function in Subjects with Mild Cognitive Impairment and Early Alzheimer’s Disease , 2005, Dementia and Geriatric Cognitive Disorders.

[22]  U. Raghavendra,et al.  A deep learning approach for Parkinson’s disease diagnosis from EEG signals , 2018, Neural Computing and Applications.

[23]  Bo Wang,et al.  When Ensemble Learning Meets Deep Learning: a New Deep Support Vector Machine for Classification , 2016, Knowl. Based Syst..

[24]  Chengjin Qin,et al.  Automated heartbeat classification based on deep neural network with multiple input layers , 2020, Knowl. Based Syst..

[25]  Nick C Fox,et al.  The Diagnosis of Mild Cognitive Impairment due to Alzheimer’s Disease: Recommendations from the National Institute on Aging-Alzheimer’s Association Workgroups on Diagnostic Guidelines for Alzheimer’s Disease , 2011 .

[26]  A. Engel,et al.  Beta-band oscillations—signalling the status quo? , 2010, Current Opinion in Neurobiology.

[27]  Jeffrey M. Hausdorff,et al.  Influence of Executive Function on Locomotor Function: Divided Attention Increases Gait Variability in Alzheimer's Disease , 2003, Journal of the American Geriatrics Society.

[28]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[29]  Seong-Whan Lee,et al.  Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis , 2014, NeuroImage.

[30]  U. Rajendra Acharya,et al.  A deep convolutional neural network model for automated identification of abnormal EEG signals , 2018, Neural Computing and Applications.

[31]  Manuel López Martín,et al.  Detection of early stages of Alzheimer's disease based on MEG activity with a randomized convolutional neural network , 2020, Artif. Intell. Medicine.

[32]  L. Schneider,et al.  Defeating Alzheimer's disease and other dementias: a priority for European science and society , 2016, The Lancet Neurology.

[33]  W. Drongelen,et al.  Localization of brain electrical activity via linearly constrained minimum variance spatial filtering , 1997, IEEE Transactions on Biomedical Engineering.

[34]  Yingchun Zhang,et al.  Functional Network Alterations in Patients With Amnestic Mild Cognitive Impairment Characterized Using Functional Near-Infrared Spectroscopy , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  J. Morris,et al.  The diagnosis of dementia due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer's disease , 2011, Alzheimer's & Dementia.

[36]  V. Calhoun,et al.  Default mode network connectivity in stable vs progressive mild cognitive impairment , 2011, Neurology.

[37]  Cornelis J. Stam,et al.  Selective impairment of hippocampus and posterior hub areas in Alzheimer’s disease: an MEG-based multiplex network study , 2017, Brain : a journal of neurology.

[38]  Roliana Ibrahim,et al.  Feature Reduction Using Standard Deviation with Different Subsets Selection in Sentiment Analysis , 2014, ACIIDS.

[39]  Niall Holmes,et al.  Moving magnetoencephalography towards real-world applications with a wearable system , 2018, Nature.

[40]  D. Gabor,et al.  Theory of communication. Part 1: The analysis of information , 1946 .

[41]  Philip Scheltens,et al.  Integrative EEG biomarkers predict progression to Alzheimer's disease at the MCI stage , 2013, Front. Aging Neurosci..

[42]  Robinson Se,et al.  Localization of event-related activity by SAM(erf). , 2004 .

[43]  M. Albert,et al.  Amnestic MCI or prodromal Alzheimer's disease? , 2004, The Lancet Neurology.

[44]  Olaf Sporns,et al.  The Human Connectome: A Structural Description of the Human Brain , 2005, PLoS Comput. Biol..

[45]  N. Castellanos,et al.  Synchronization during an internally directed cognitive state in healthy aging and mild cognitive impairment: a MEG study , 2014, AGE.

[46]  Damon B. Lesmeister,et al.  Three-dimensional partitioning of resources by congeneric forest predators with recent sympatry , 2019, Scientific Reports.

[47]  Juan P. Amezquita-Sanchez,et al.  A new methodology for automated diagnosis of mild cognitive impairment (MCI) using magnetoencephalography (MEG) , 2016, Behavioural Brain Research.

[48]  Ricardo Bruña,et al.  Alpha-Band Hypersynchronization in Progressive Mild Cognitive Impairment: A Magnetoencephalography Study , 2014, The Journal of Neuroscience.

[49]  O. Hansson,et al.  Cerebrospinal fluid analysis detects cerebral amyloid-β accumulation earlier than positron emission tomography , 2016, Brain : a journal of neurology.

[50]  Qiao Liu,et al.  MSST-ResNet: Deep multi-scale spatiotemporal features for robust visual object tracking , 2019, Knowl. Based Syst..

[51]  Bruce Fischl,et al.  FreeSurfer , 2012, NeuroImage.

[52]  R. Bajo,et al.  MEG spectral analysis in subtypes of mild cognitive impairment , 2014, AGE.

[53]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[54]  Nick C Fox,et al.  The diagnosis of mild cognitive impairment due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer's disease , 2011, Alzheimer's & Dementia.

[55]  Limin Sun,et al.  A prospective, randomized, single-blinded trial on the effect of early rehabilitation on daily activities and motor function of patients with hemorrhagic stroke , 2012, Journal of Clinical Neuroscience.

[56]  Massimo Filippi,et al.  Functional network connectivity in the behavioral variant of frontotemporal dementia , 2013, Cortex.

[57]  J Marshall,et al.  Cerebral blood flow in dementia. , 1975, Archives of neurology.

[58]  Andrew J. Saykin,et al.  Deep Learning in Alzheimer's Disease: Diagnostic Classification and Prognostic Prediction Using Neuroimaging Data , 2019, Front. Aging Neurosci..

[59]  C. Stam,et al.  Phase lag index: Assessment of functional connectivity from multi channel EEG and MEG with diminished bias from common sources , 2007, Human brain mapping.

[60]  Ricardo Bruña,et al.  Hypersynchronization in mild cognitive impairment: the 'X' model. , 2019, Brain : a journal of neurology.

[61]  John Q. Trojanowski,et al.  Multisite assessment of NIA-AA guidelines for the neuropathologic evaluation of Alzheimer's disease , 2016, Alzheimer's & Dementia.

[62]  Fernando Maestú,et al.  The Role of Magnetoencephalography in the Early Stages of Alzheimer’s Disease , 2018, Front. Neurosci..

[63]  F. Varela,et al.  Measuring phase synchrony in brain signals , 1999, Human brain mapping.

[64]  Arianna Mencattini,et al.  Robust classification of biological samples in atomic force microscopy images via multiple filtering cooperation , 2017, Knowl. Based Syst..

[65]  Sayak Paul,et al.  A review of deep learning with special emphasis on architectures, applications and recent trends , 2020, Knowl. Based Syst..

[66]  R. Petersen Mild cognitive impairment as a diagnostic entity , 2004, Journal of internal medicine.

[67]  Stavros Dimitriadis,et al.  Aberrant MEG multi-frequency phase temporal synchronization predicts conversion from mild cognitive impairment-to-Alzheimer's disease , 2019, NeuroImage: Clinical.

[68]  Hanna-Leena Halme,et al.  Adaptive neural network classifier for decoding MEG signals , 2018, NeuroImage.

[69]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[70]  S. H. Hojjati,et al.  Predicting conversion from MCI to AD using resting-state fMRI, graph theoretical approach and SVM , 2017, Journal of Neuroscience Methods.

[71]  Chen-Yi Lee,et al.  Convolutional neural networks for classification of music-listening EEG: comparing 1D convolutional kernels with 2D kernels and cerebral laterality of musical influence , 2019, Neural Computing and Applications.

[72]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.