Machine learning methods for brain network classification: Application to autism diagnosis using cortical morphological networks

BACKGROUND Autism spectrum disorder (ASD) affects the brain connectivity at different levels. Nonetheless, non-invasively distinguishing such effects using magnetic resonance imaging (MRI) remains very challenging to machine learning diagnostic frameworks due to ASD heterogeneity. So far, existing network neuroscience works mainly focused on functional (derived from functional MRI) and structural (derived from diffusion MRI) brain connectivity, which might not directly capture relational morphological changes between brain regions. Indeed, machine learning (ML) studies for ASD diagnosis using morphological brain networks derived from conventional T1-weighted MRI are very scarce. NEW METHOD To fill this gap, we leverage crowdsourcing by organizing a Kaggle competition to build a pool of machine learning pipelines for neurological disorder diagnosis with application to ASD diagnosis using cortical morphological networks derived from T1-weighted MRI. RESULTS During the competition, participants were provided with a training dataset and only allowed to check their performance on a public test data. The final evaluation was performed on both public and hidden test datasets based on accuracy, sensitivity, and specificity metrics. Teams were ranked using each performance metric separately and the final ranking was determined based on the mean of all rankings. The first-ranked team achieved 70% accuracy, 72.5% sensitivity, and 67.5% specificity, where the second-ranked team achieved 63.8%, 62.5%, 65% respectively. CONCLUSION Leveraging participants to design ML diagnostic methods within a competitive machine learning setting has allowed the exploration and benchmarking of wide spectrum of ML methods for ASD diagnosis using cortical morphological networks.

[1]  Z. Warren,et al.  Prevalence of autism spectrum disorder among children aged 8 years - autism and developmental disabilities monitoring network, 11 sites, United States, 2010. , 2014, Morbidity and mortality weekly report. Surveillance summaries.

[2]  Vladimir Fonov,et al.  Standardized evaluation of algorithms for computer-aided diagnosis of dementia based on structural MRI: The CADDementia challenge , 2015, NeuroImage.

[3]  Andrei Irimia,et al.  Resting-State Functional Connectivity in Autism Spectrum Disorders: A Review , 2017, Front. Psychiatry.

[4]  L. Hooft,et al.  Diagnostic tests for autism spectrum disorder (ASD) in preschool children. , 2011, The Cochrane database of systematic reviews.

[5]  Margot J. Taylor,et al.  Altered structural brain asymmetry in autism spectrum disorder in a study of 54 datasets , 2019, Nature Communications.

[6]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Vince D. Calhoun,et al.  Classification and Prediction of Brain Disorders Using Functional Connectivity: Promising but Challenging , 2018, Front. Neurosci..

[8]  Panos M. Pardalos,et al.  High-Dimensional Data Classification , 2014 .

[9]  K. Pelphrey,et al.  Cortical morphological markers in children with autism: a structural magnetic resonance imaging study of thickness, area, volume, and gyrification , 2016, Molecular Autism.

[10]  Alzheimer's Disease Neuroimaging Initiative,et al.  Identifying the best data-driven feature selection method for boosting reproducibility in classification tasks , 2020, Pattern Recognit..

[11]  Islem Rekik,et al.  Multi-view learning-based data proliferator for boosting classification using highly imbalanced classes , 2019, Journal of Neuroscience Methods.

[12]  Islem Rekik,et al.  Cooperative Correlational and Discriminative Ensemble Classifier Learning for Early Dementia Diagnosis Using Morphological Brain Multiplexes , 2018, IEEE Access.

[13]  Aixia Guo,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2014 .

[14]  Alvis Cheuk M. Fong,et al.  ASD-DiagNet: A Hybrid Learning Approach for Detection of Autism Spectrum Disorder Using fMRI Data , 2019, Front. Neuroinform..

[15]  Leif E. Peterson K-nearest neighbor , 2009, Scholarpedia.

[16]  Leo Breiman,et al.  Pasting Small Votes for Classification in Large Databases and On-Line , 1999, Machine Learning.

[17]  D. Geschwind,et al.  Autism spectrum disorders: developmental disconnection syndromes , 2007, Current Opinion in Neurobiology.

[18]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[19]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[20]  Islem Rekik,et al.  Estimation of connectional brain templates using selective multi-view network normalization , 2020, Medical Image Anal..

[21]  A. Estes,et al.  Early Identification of Autism Spectrum Disorder: Recommendations for Practice and Research , 2015, Pediatrics.

[22]  Aurélien Géron,et al.  Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems , 2017 .

[23]  Islem Rekik,et al.  Brain multiplexes reveal morphological connectional biomarkers fingerprinting late brain dementia states , 2018, Scientific Reports.

[24]  Islem Rekik,et al.  Unsupervised Manifold Learning Using High-Order Morphological Brain Networks Derived From T1-w MRI for Autism Diagnosis , 2018, Front. Neuroinform..

[25]  Jared A. Nielsen,et al.  Functional connectivity magnetic resonance imaging classification of autism. , 2011, Brain : a journal of neurology.

[26]  Daniel P. Kennedy,et al.  The Autism Brain Imaging Data Exchange: Towards Large-Scale Evaluation of the Intrinsic Brain Architecture in Autism , 2013, Molecular Psychiatry.

[27]  Mahmudul Hassan Ashik,et al.  Auto-Encoder Based Nonlinear Dimensionality Reduction of ECG data and Classification of Cardiac Arrhythmia Groups Using Deep Neural Network , 2018, 2018 4th International Conference on Electrical Engineering and Information & Communication Technology (iCEEiCT).

[28]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[29]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[30]  Islem Rekik,et al.  Adversarial Connectome Embedding for Mild Cognitive Impairment Identification Using Cortical Morphological Networks , 2019, CNI@MICCAI.

[31]  A. Franco,et al.  NeuroImage: Clinical , 2022 .

[32]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Pierre Vandergheynst,et al.  Geometric Deep Learning: Going beyond Euclidean data , 2016, IEEE Signal Process. Mag..

[34]  Diogo M. Camacho,et al.  Wisdom of crowds for robust gene network inference , 2012, Nature Methods.

[35]  Bo Wang,et al.  Visualization and analysis of single-cell RNA-seq data by kernel-based similarity learning , 2016, Nature Methods.

[36]  Lonnie Zwaigenbaum,et al.  Early identification of autism spectrum disorders , 2013, Behavioural Brain Research.

[37]  Zhi-Hua Zhou,et al.  Isolation Forest , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[38]  Takashi Yamada,et al.  Linked alterations in gray and white matter morphology in adults with high-functioning autism spectrum disorder: A multimodal brain imaging study , 2014, NeuroImage: Clinical.

[39]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[40]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[41]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[42]  M. Breakspear,et al.  The connectomics of brain disorders , 2015, Nature Reviews Neuroscience.

[43]  Z. Warren,et al.  Prevalence of Autism Spectrum Disorder Among Children Aged 8 Years — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2014 , 2018, Morbidity and mortality weekly report. Surveillance summaries.

[44]  Islem Rekik,et al.  Joint Pairing and Structured Mapping of Convolutional Brain Morphological Multiplexes for Early Dementia Diagnosis , 2019, Brain Connect..

[45]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[46]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[47]  O. Sporns,et al.  Network neuroscience , 2017, Nature Neuroscience.

[48]  Xiao-Lei Zhang,et al.  Nonlinear Dimensionality Reduction of Data by Deep Distributed Random Samplings , 2014, ACML.

[49]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[50]  Dinggang Shen,et al.  Diagnosis of Autism Spectrum Disorders Using Multi-Level High-Order Functional Networks Derived From Resting-State Functional MRI , 2018, Front. Hum. Neurosci..

[51]  Ayman El-Baz,et al.  A Personalized Autism Diagnosis CAD System Using a Fusion of Structural MRI and Resting-State Functional MRI Data , 2019, Front. Psychiatry.

[52]  Wenwu Zhu,et al.  Deep Learning on Graphs: A Survey , 2018, IEEE Transactions on Knowledge and Data Engineering.

[53]  Bruce Fischl,et al.  FreeSurfer , 2012, NeuroImage.

[54]  Wilfried N. Gansterer,et al.  On the Relationship Between Feature Selection and Classification Accuracy , 2008, FSDM.

[55]  S. Friend,et al.  Crowdsourcing biomedical research: leveraging communities as innovation engines , 2016, Nature Reviews Genetics.

[56]  Islem Rekik,et al.  Hierarchical Adversarial Connectomic Domain Alignment for Target Brain Graph Prediction and Classification from a Source Graph , 2019, PRIME@MICCAI.

[57]  Islem Rekik,et al.  High-order Connectomic Manifold Learning for Autistic Brain State Identification , 2017, CNI@MICCAI.

[58]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[59]  Carine Poussin,et al.  The sbv IMPROVER Systems Toxicology Computational Challenge: Identification of Human and Species-Independent Blood Response Markers as Predictors of Smoking Exposure and Cessation Status. , 2017, Computational toxicology.

[60]  Islem Rekik,et al.  Autism Spectrum Disorder Diagnosis Using Sparse Graph Embedding of Morphological Brain Networks , 2017, GRAIL/MFCA/MICGen@MICCAI.

[61]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[62]  Cha Zhang,et al.  Ensemble Machine Learning: Methods and Applications , 2012 .

[63]  Ali Adibi,et al.  Deep learning approach based on dimensionality reduction for designing electromagnetic nanostructures , 2019, npj Computational Materials.

[64]  Nirbhay N. Singh,et al.  Early Intervention for Young Children with Autism Spectrum Disorder , 2016 .

[65]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[66]  Ghassan Hamarneh,et al.  Machine Learning on Human Connectome Data from MRI , 2016, ArXiv.