Characterization Multimodal Connectivity of Brain Network by Hypergraph GAN for Alzheimer's Disease Analysis

Using multimodal neuroimaging data to characterize brain network is currently an advanced technique for Alzheimer’s disease(AD) Analysis. Over recent years the neuroimaging community has made tremendous progress in the study of resting-state functional magnetic resonance imaging (rs-fMRI) derived from blood-oxygen-level-dependent (BOLD) signals and Diffusion Tensor Imaging (DTI) derived from white matter fiber tractography. However, Due to the heterogeneity and complexity between BOLD signals and fiber tractography, Most existing multimodal data fusion algorithms can not sufficiently take advantage of the complementary information between rs-fMRI and DTI. To overcome this problem, a novel Hypergraph Generative Adversarial Networks(HGGAN) is proposed in this paper, which utilizes Interactive Hyperedge Neurons module (IHEN) and Optimal Hypergraph Homomorphism algorithm(OHGH) to generate multimodal connectivity of Brain Network from rs-fMRI combination with DTI. To evaluate the performance of this model, We use publicly available data from the ADNI database to demonstrate that the proposed model not only can identify discriminative brain regions of AD but also can effectively improve classification performance.

[1]  Xiangyu Wang,et al.  Ensemble of 3D densely connected convolutional network for diagnosis of mild cognitive impairment and Alzheimer's disease , 2019, Neurocomputing.

[2]  Yong Hu,et al.  Classification of Diffusion Tensor Metrics for the Diagnosis of a Myelopathic Cord Using Machine Learning , 2017, Int. J. Neural Syst..

[3]  K. Luk,et al.  Prediction of myelopathic level in cervical spondylotic myelopathy using diffusion tensor imaging , 2015, Journal of magnetic resonance imaging : JMRI.

[4]  Daniel Cremers,et al.  q-Space Deep Learning: Twelve-Fold Shorter and Model-Free Diffusion MRI Scans , 2016, IEEE Transactions on Medical Imaging.

[5]  Chaogan Yan,et al.  DPARSF: A MATLAB Toolbox for “Pipeline” Data Analysis of Resting-State fMRI , 2010, Front. Syst. Neurosci..

[6]  Zhile Yang,et al.  Diabetic Retinopathy Diagnosis Using Multichannel Generative Adversarial Network With Semisupervision , 2020, IEEE Transactions on Automation Science and Engineering.

[7]  Michael K. Ng,et al.  Tensorizing GAN With High-Order Pooling for Alzheimer’s Disease Assessment , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[9]  Pengfei Xu,et al.  PANDA: a pipeline toolbox for analyzing brain diffusion images , 2013, Front. Hum. Neurosci..

[10]  Heung-Il Suk,et al.  Enriched Representation Learning in Resting-State fMRI for Early MCI Diagnosis , 2020, MICCAI.

[11]  王书强.  基于3D卷积神经网络的区域降雨量预报3D Convolutional Neural Network for Regional Precipitation Nowcasting , 2018 .

[12]  Xiangyu Wang,et al.  Automatic Recognition of Mild Cognitive Impairment and Alzheimers Disease Using Ensemble based 3D Densely Connected Convolutional Networks , 2018, 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA).

[13]  Shuqiang Wang,et al.  Cross-modality Synthesis from MRI to PET Using Adversarial U-Net with Different Normalization , 2019, 2019 International Conference on Medical Imaging Physics and Engineering (ICMIPE).

[14]  Shuqiang Wang,et al.  A GA-based feature selection and parameter optimization for support tucker machine , 2017 .

[15]  Yue Gao,et al.  Dynamic Hypergraph Neural Networks , 2019, IJCAI.

[16]  Daniel Rueckert,et al.  Random forest-based similarity measures for multi-modal classification of Alzheimer's disease , 2013, NeuroImage.

[17]  L. Shah,et al.  Functional magnetic resonance imaging. , 2010, Seminars in roentgenology.

[18]  Martin Styner,et al.  Identifying Relationships in Functional and Structural Connectome Data Using a Hypergraph Learning Method , 2016, MICCAI.

[19]  A variational approach to nonlinear two-point boundary value problems , 2009 .

[20]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[21]  J. Morris,et al.  Understanding disease progression and improving Alzheimer's disease clinical trials: Recent highlights from the Alzheimer's Disease Neuroimaging Initiative , 2018, Alzheimer's & Dementia.

[22]  Shu-Qiang Wang,et al.  A variational approach to nonlinear two-point boundary value problems , 2009, Comput. Math. Appl..

[23]  Ji-Huan He,et al.  Variational Iteration Method for a Nonlinear Reaction-Diffusion Process , 2008 .

[24]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[25]  Dazhe Zhao,et al.  Generalized fused group lasso regularized multi-task feature learning for predicting cognitive outcomes in Alzheimers disease , 2018, Comput. Methods Programs Biomed..

[26]  D. Louis Collins,et al.  Validation of a Regression Technique for Segmentation of White Matter Hyperintensities in Alzheimer’s Disease , 2017, IEEE Transactions on Medical Imaging.

[27]  Shuangzhi Yu,et al.  Multi-scale Enhanced Graph Convolutional Network for Early Mild Cognitive Impairment Detection , 2020, MICCAI.

[28]  Feng Zhou,et al.  Deep and joint learning of longitudinal data for Alzheimer's disease prediction , 2020, Pattern Recognit..

[29]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[30]  Yong He,et al.  GRETNA: a graph theoretical network analysis toolbox for imaging connectomics , 2015, Front. Hum. Neurosci..

[31]  Shuqiang Wang,et al.  Medical Image Reconstruction Using Generative Adversarial Network for Alzheimer Disease Assessment with Class-Imbalance Problem , 2020, 2020 IEEE 6th International Conference on Computer and Communications (ICCC).

[32]  Juan Yang,et al.  Work Stress and Depressive Symptoms in Fishermen With a Smoking Habit: A Mediator Role of Nicotine Dependence and Possible Moderator Role of Expressive Suppression and Cognitive Reappraisal , 2018, Front. Psychol..

[33]  Yoshua Bengio,et al.  HNHN: Hypergraph Networks with Hyperedge Neurons , 2020, ArXiv.

[34]  Wei Chen,et al.  Automatic Recognition of Mild Cognitive Impairment from MRI Images Using Expedited Convolutional Neural Networks , 2017, ICANN.

[35]  Ee-Leng Tan,et al.  Self-calibrated brain network estimation and joint non-convex multi-task learning for identification of early Alzheimer's disease , 2020, Medical Image Anal..

[36]  Daoqiang Zhang,et al.  Multi-modal multi-task learning for joint prediction of multiple regression and classification variables in Alzheimer's disease , 2012, NeuroImage.

[37]  A. Dale,et al.  Life-span changes of the human brain white matter: diffusion tensor imaging (DTI) and volumetry. , 2010, Cerebral cortex.

[38]  Bing He,et al.  An Ensemble-Based Densely-Connected Deep Learning System for Assessment of Skeletal Maturity , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[39]  Alzheimer’s Association.  2018 Alzheimer's disease facts and figures , 2018, Alzheimer's & Dementia.

[40]  Shuqiang Wang,et al.  Brain MR to PET Synthesis via Bidirectional Generative Adversarial Network , 2020, MICCAI.

[41]  Yong Hu,et al.  Skeletal Maturity Recognition Using a Fully Automated System With Convolutional Neural Networks , 2018, IEEE Access.

[42]  Yong Hu,et al.  Bone age assessment using convolutional neural networks , 2018, 2018 International Conference on Artificial Intelligence and Big Data (ICAIBD).

[43]  J. Shimony,et al.  Resting-State fMRI: A Review of Methods and Clinical Applications , 2013, American Journal of Neuroradiology.

[44]  Jing Qin,et al.  Skin lesion segmentation via generative adversarial networks with dual discriminators , 2020, Medical Image Anal..