Integrating machining learning and multimodal neuroimaging to detect schizophrenia at the level of the individual

Schizophrenia is a severe psychiatric disorder associated with both structural and functional brain abnormalities. In the past few years, there has been growing interest in the application of machine learning techniques to neuroimaging data for the diagnostic and prognostic assessment of this disorder. However, the vast majority of studies published so far have used either structural or functional neuroimaging data, without accounting for the multimodal nature of the disorder. Structural MRI and resting‐state functional MRI data were acquired from a total of 295 patients with schizophrenia and 452 healthy controls at five research centers. We extracted features from the data including gray matter volume, white matter volume, amplitude of low‐frequency fluctuation, regional homogeneity and two connectome‐wide based metrics: structural covariance matrices and functional connectivity matrices. A support vector machine classifier was trained on each dataset separately to distinguish the subjects at individual level using each of the single feature as well as their combination, and 10‐fold cross‐validation was used to assess the performance of the model. Functional data allow higher accuracy of classification than structural data (mean 82.75% vs. 75.84%). Within each modality, the combination of images and matrices improves performance, resulting in mean accuracies of 81.63% for structural data and 87.59% for functional data. The use of all combined structural and functional measures allows the highest accuracy of classification (90.83%). We conclude that combining multimodal measures within a single model is a promising direction for developing biologically informed diagnostic tools in schizophrenia.

[1]  D. Goldstein,et al.  Schizophrenia: From genetics to physiology at last , 2016, Nature.

[2]  Simon B. Eickhoff,et al.  An improved framework for confound regression and filtering for control of motion artifact in the preprocessing of resting-state functional connectivity data , 2013, NeuroImage.

[3]  Tyrone D. Cannon,et al.  Structural and Functional Brain Abnormalities in Schizophrenia , 2010, Current directions in psychological science.

[4]  Hiroshi Imamizu,et al.  Harmonization of resting-state functional MRI data across multiple imaging sites via the separation of site differences into sampling bias and measurement bias , 2018 .

[5]  J. Mann,et al.  A Review of the Functional and Anatomical Default Mode Network in Schizophrenia , 2017, Neuroscience Bulletin.

[6]  C. Stam,et al.  Alzheimer's disease: connecting findings from graph theoretical studies of brain networks , 2013, Neurobiology of Aging.

[7]  Yulia Worbe,et al.  Neuroimaging signature of neuropsychiatric disorders. , 2015, Current opinion in neurology.

[8]  Stefan Klöppel,et al.  Correction of inter-scanner and within-subject variance in structural MRI based automated diagnosing , 2014, NeuroImage.

[9]  Jia Liu,et al.  Measuring individual morphological relationship of cortical regions , 2014, Journal of Neuroscience Methods.

[10]  Allen Frances,et al.  DSM-IV-TR Guidebook , 2004 .

[11]  N. Koutsouleris,et al.  Classifying individuals at high-risk for psychosis based on functional brain activity during working memory processing , 2015, NeuroImage: Clinical.

[12]  Vince D. Calhoun,et al.  Altered Small-World Brain Networks in Temporal Lobe in Patients with Schizophrenia Performing an Auditory Oddball Task , 2011, Front. Syst. Neurosci..

[13]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[14]  Teruhiko Higuchi,et al.  Discrimination between schizophrenia and major depressive disorder by magnetic resonance imaging of the female brain. , 2013, Journal of psychiatric research.

[15]  Saori C. Tanaka,et al.  Harmonization of resting-state functional MRI data across multiple imaging sites via the separation of site differences into sampling bias and measurement bias , 2018, bioRxiv.

[16]  M. Kubicki,et al.  Review of functional and anatomical brain connectivity findings in schizophrenia , 2013, Current opinion in psychiatry.

[17]  E. Walker,et al.  Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[18]  S. Kapur,et al.  Predicting clinical response in people at ultra-high risk of psychosis: a systematic and quantitative review. , 2015, Drug discovery today.

[19]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[20]  S. Charles Schulz,et al.  Classification of adolescent psychotic disorders using linear discriminant analysis , 2006, Schizophrenia Research.

[21]  R. Kahn,et al.  Aberrant Frontal and Temporal Complex Network Structure in Schizophrenia: A Graph Theoretical Analysis , 2010, The Journal of Neuroscience.

[22]  D. Willshaw,et al.  Cerebral Cortex doi:10.1093/cercor/bhr221 Cerebral Cortex Advance Access published September 21, 2011 Similarity-Based Extraction of Individual Networks from Gray Matter MRI Scans , 2022 .

[23]  Vince D. Calhoun,et al.  Accurate classification of schizophrenia patients based on novel resting-state fMRI features , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[24]  A. Mechelli,et al.  Using Support Vector Machine to identify imaging biomarkers of neurological and psychiatric disease: A critical review , 2012, Neuroscience & Biobehavioral Reviews.

[25]  D. W. Johnson,et al.  Treatment of Chronic Schizophrenia , 1977, Drugs.

[26]  Olivier Salvado,et al.  Statistical machine learning to identify traumatic brain injury (TBI) from structural disconnections of white matter networks , 2016, NeuroImage.

[27]  Timothy O. Laumann,et al.  Generation and Evaluation of a Cortical Area Parcellation from Resting-State Correlations. , 2016, Cerebral cortex.

[28]  Steven C. R. Williams,et al.  Using genetic, cognitive and multi-modal neuroimaging data to identify ultra-high-risk and first-episode psychosis at the individual level , 2013, Psychological Medicine.

[29]  Ronald Pierson,et al.  Long-term antipsychotic treatment and brain volumes: a longitudinal study of first-episode schizophrenia. , 2011, Archives of general psychiatry.

[30]  V. Calhoun,et al.  High Classification Accuracy for Schizophrenia with Rest and Task fMRI Data , 2012, Front. Hum. Neurosci..

[31]  H. Möller,et al.  Use of neuroanatomical pattern classification to identify subjects in at-risk mental states of psychosis and predict disease transition. , 2009, Archives of general psychiatry.

[32]  Stephan Heckers,et al.  Mapping Thalamocortical Functional Connectivity in Chronic and Early Stages of Psychotic Disorders , 2016, Biological Psychiatry.

[33]  Wenbin Guo,et al.  Abnormal regional homogeneity as potential imaging biomarker for psychosis risk syndrome: a resting-state fMRI study and support vector machine analysis , 2016, Scientific Reports.

[34]  Cornelis J. Stam,et al.  Single-Subject Gray Matter Graph Properties and Their Relationship with Cognitive Impairment in Early- and Late-Onset Alzheimer's Disease , 2014, Brain Connect..

[35]  C. Stam,et al.  Small-world networks and disturbed functional connectivity in schizophrenia , 2006, Schizophrenia Research.

[36]  Umberto Castellani,et al.  Classification of first-episode psychosis in a large cohort of patients using support vector machine and multiple kernel learning techniques , 2017, NeuroImage.

[37]  R. Murray,et al.  Pattern of neural responses to verbal fluency shows diagnostic specificity for schizophrenia and bipolar disorder , 2011, BMC psychiatry.

[38]  M. Anczewska,et al.  Disability and recovery in schizophrenia: a systematic review of cognitive behavioral therapy interventions , 2016, BMC Psychiatry.

[39]  H. Yamasue,et al.  Classification of First-Episode Schizophrenia Patients and Healthy Subjects by Automated MRI Measures of Regional Brain Volume and Cortical Thickness , 2011, PloS one.

[40]  Abraham Z. Snyder,et al.  Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion , 2012, NeuroImage.

[41]  Rachel M. Brouwer,et al.  Can structural MRI aid in clinical classification? A machine learning study in two independent samples of patients with schizophrenia, bipolar disorder and healthy subjects , 2014, NeuroImage.

[42]  Daniel H Mathalon,et al.  Use of Machine Learning to Determine Deviance in Neuroanatomical Maturity Associated With Future Psychosis in Youths at Clinically High Risk , 2018, JAMA psychiatry.

[43]  J. Ballenger Middle and Inferior Temporal Gyrus Gray Matter Volume Abnormalities in First-Episode Schizophrenia: An MRI Study , 2008 .

[44]  S. Borgwardt,et al.  Increased superior frontal gyrus activation during working memory processing in psychosis: Significant relation to cumulative antipsychotic medication and to negative symptoms , 2016, Schizophrenia Research.

[45]  Yong He,et al.  Disrupted small-world networks in schizophrenia. , 2008, Brain : a journal of neurology.

[46]  Edward T. Bullmore,et al.  Connectomics: A new paradigm for understanding brain disease , 2015, European Neuropsychopharmacology.

[47]  Hang Joon Jo,et al.  Multimodal Discrimination of Schizophrenia Using Hybrid Weighted Feature Concatenation of Brain Functional Connectivity and Anatomical Features with an Extreme Learning Machine , 2017, Front. Neuroinform..

[48]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[49]  Dewen Hu,et al.  Discriminative analysis of resting-state functional connectivity patterns of schizophrenia using low dimensional embedding of fMRI , 2010, NeuroImage.

[50]  Yong He,et al.  Graph-based network analysis of resting-state functional MRI. , 2010 .

[51]  Frederik Barkhof,et al.  Gray matter network disruptions and amyloid beta in cognitively normal adults , 2016, Neurobiology of Aging.

[52]  Tomer Fekete,et al.  Combining Classification with fMRI-Derived Complex Network Measures for Potential Neurodiagnostics , 2013, PloS one.

[53]  D. Kong,et al.  Automatic Classification of Early Parkinson's Disease with Multi-Modal MR Imaging , 2012, PloS one.

[54]  Bakhtyar Ahmed Mohammed,et al.  using Deep Learning , 2020 .

[55]  Vince D. Calhoun,et al.  Deep neural network with weight sparsity control and pre-training extracts hierarchical features and enhances classification performance: Evidence from whole-brain resting-state functional connectivity patterns of schizophrenia , 2016, NeuroImage.

[56]  Stephan Heckers,et al.  Thalamocortical dysconnectivity in schizophrenia. , 2012, The American journal of psychiatry.

[57]  Nikolaos Koutsouleris,et al.  Distinguishing prodromal from first-episode psychosis using neuroanatomical single-subject pattern recognition. , 2013, Schizophrenia bulletin.

[58]  Irina Rish,et al.  Functional Network Disruptions in Schizophrenia. , 2017, Methods in molecular biology.

[59]  Timothy O. Laumann,et al.  Methods to detect, characterize, and remove motion artifact in resting state fMRI , 2014, NeuroImage.

[60]  C. Jack,et al.  Alzheimer's Disease Neuroimaging Initiative , 2008 .

[61]  W. M. van der Flier,et al.  Single-Subject Grey Matter Graphs in Alzheimer's Disease , 2013, PloS one.

[62]  Junran Zhang,et al.  Multimodal MRI-Based Classification of Trauma Survivors with and without Post-Traumatic Stress Disorder , 2016, Front. Neurosci..

[63]  Daoqiang Zhang,et al.  Multimodal classification of Alzheimer's disease and mild cognitive impairment , 2011, NeuroImage.

[64]  Eve C. Johnstone,et al.  Grey matter networks in people at increased familial risk for schizophrenia , 2015, Schizophrenia Research.

[65]  V. Calhoun,et al.  Classifying Schizophrenia Using Multimodal Multivariate Pattern Recognition Analysis: Evaluating the Impact of Individual Clinical Profiles on the Neurodiagnostic Performance. , 2016, Schizophrenia bulletin.

[66]  Manuel Graña,et al.  Discrimination of Schizophrenia Auditory Hallucinators by Machine Learning of Resting-State Functional MRI , 2015, Int. J. Neural Syst..

[67]  E. Bullmore,et al.  Behavioral / Systems / Cognitive Functional Connectivity and Brain Networks in Schizophrenia , 2010 .

[68]  B. Mulsant,et al.  Cognition, Function, and Disability in Patients with Schizophrenia: A Review of Longitudinal Studies , 2014, Canadian journal of psychiatry. Revue canadienne de psychiatrie.

[69]  Jack C. Rogers,et al.  Combination of Resting State fMRI, DTI, and sMRI Data to Discriminate Schizophrenia by N-way MCCA + jICA , 2013, Front. Hum. Neurosci..

[70]  Yong He,et al.  GRETNA: a graph theoretical network analysis toolbox for imaging connectomics , 2015, Front. Hum. Neurosci..

[71]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[72]  H. Möller,et al.  Individualized differential diagnosis of schizophrenia and mood disorders using neuroanatomical biomarkers. , 2015, Brain : a journal of neurology.

[73]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[74]  Danielle S Bassett,et al.  Brain graphs: graphical models of the human brain connectome. , 2011, Annual review of clinical psychology.

[75]  Boreom Lee,et al.  Aberrant neural networks for the recognition memory of socially relevant information in patients with schizophrenia , 2016, Brain and behavior.

[76]  Yong He,et al.  Understanding Structural-Functional Relationships in the Human Brain , 2015, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[77]  Yong He,et al.  Addressing head motion dependencies for small-world topologies in functional connectomics , 2013, Front. Hum. Neurosci..

[78]  Andre F. Marquand,et al.  An empirical comparison of different approaches for combining multimodal neuroimaging data with support vector machine , 2014, Front. Neurosci..

[79]  S. Lawrie,et al.  Towards the identification of imaging biomarkers in schizophrenia, using multivariate pattern classification at a single-subject level , 2013, NeuroImage: Clinical.

[80]  R. Murray,et al.  Schizophrenia: an integrated sociodevelopmental-cognitive model , 2014, The Lancet.

[81]  P. Golland,et al.  Whole brain resting state functional connectivity abnormalities in schizophrenia , 2012, Schizophrenia Research.

[82]  M. Fox,et al.  The global signal and observed anticorrelated resting state brain networks. , 2009, Journal of neurophysiology.

[83]  A. Mechelli,et al.  Identifying Individuals at High Risk of Psychosis: Predictive Utility of Support Vector Machine using Structural and Functional MRI Data , 2016, Front. Psychiatry.

[84]  Qing Ma,et al.  Reproducibility of functional brain alterations in major depressive disorder: Evidence from a multisite resting-state functional MRI study with 1,434 individuals , 2019, NeuroImage.

[85]  N C Andreasen,et al.  The Comprehensive Assessment of Symptoms and History (CASH). An instrument for assessing diagnosis and psychopathology. , 1992, Archives of general psychiatry.

[86]  Krzysztof J. Gorgolewski,et al.  A phenome-wide examination of neural and cognitive function , 2016, Scientific Data.

[87]  A. Mechelli,et al.  Using deep learning to investigate the neuroimaging correlates of psychiatric and neurological disorders: Methods and applications , 2017, Neuroscience & Biobehavioral Reviews.

[88]  Yong He,et al.  Discriminative analysis of early Alzheimer's disease using multi-modal imaging and multi-level characterization with multi-classifier (M3) , 2012, NeuroImage.

[89]  Tyrone D. Cannon,et al.  Association of Thalamic Dysconnectivity and Conversion to Psychosis in Youth and Young Adults at Elevated Clinical Risk. , 2015, JAMA psychiatry.

[90]  Jinhui Wang,et al.  Single‐subject morphological brain networks: connectivity mapping, topological characterization and test–retest reliability , 2016, Brain and behavior.

[91]  Yi Pan,et al.  Classification of Schizophrenia Based on Individual Hierarchical Brain Networks Constructed From Structural MRI Images , 2017, IEEE Transactions on NanoBioscience.

[92]  Hae-Jeong Park,et al.  The neural basis of a deficit in abstract thinking in patients with schizophrenia , 2015, Psychiatry Research: Neuroimaging.

[93]  Chaogan Yan,et al.  DPARSF: A MATLAB Toolbox for “Pipeline” Data Analysis of Resting-State fMRI , 2010, Front. Syst. Neurosci..

[94]  R. Kikinis,et al.  Middle and inferior temporal gyrus gray matter volume abnormalities in first-episode schizophrenia: an MRI study. , 2006, The American journal of psychiatry.