Prediction of estimated risk for bipolar disorder using machine learning and structural MRI features.

BACKGROUND Individuals with bipolar disorder are commonly correctly diagnosed a decade after symptom onset. Machine learning techniques may aid in early recognition and reduce the disease burden. As both individuals at risk and those with a manifest disease display structural brain markers, structural magnetic resonance imaging may provide relevant classification features. METHODS Following a pre-registered protocol, we trained linear support vector machine (SVM) to classify individuals according to their estimated risk for bipolar disorder using regional cortical thickness of help-seeking individuals from seven study sites (N = 276). We estimated the risk using three state-of-the-art assessment instruments (BPSS-P, BARS, EPIbipolar). RESULTS For BPSS-P, SVM achieved a fair performance of Cohen's κ of 0.235 (95% CI 0.11-0.361) and a balanced accuracy of 63.1% (95% CI 55.9-70.3) in the 10-fold cross-validation. In the leave-one-site-out cross-validation, the model performed with a Cohen's κ of 0.128 (95% CI -0.069 to 0.325) and a balanced accuracy of 56.2% (95% CI 44.6-67.8). BARS and EPIbipolar could not be predicted. In post hoc analyses, regional surface area, subcortical volumes as well as hyperparameter optimization did not improve the performance. CONCLUSIONS Individuals at risk for bipolar disorder, as assessed by BPSS-P, display brain structural alterations that can be detected using machine learning. The achieved performance is comparable to previous studies which attempted to classify patients with manifest disease and healthy controls. Unlike previous studies of bipolar risk, our multicenter design permitted a leave-one-site-out cross-validation. Whole-brain cortical thickness seems to be superior to other structural brain features.

[1]  Erick Jorge Canales-Rodríguez,et al.  Diagnosis of bipolar disorders and body mass index predict clustering based on similarities in cortical thickness—ENIGMA study in 2436 individuals , 2021, Bipolar disorders.

[2]  Kamyar Keramatian,et al.  Transitioning to bipolar disorder: A systematic review of prospective high-risk studies , 2021, Current opinion in psychiatry.

[3]  Barbara Brito Vega,et al.  Reliability of structural MRI measurements: The effects of scan session, head tilt, inter-scan interval, acquisition sequence, FreeSurfer version and processing stream , 2021, NeuroImage.

[4]  G. Juckel,et al.  Individuals at increased risk for development of bipolar disorder display structural alterations similar to people with manifest disease , 2021, Translational Psychiatry.

[5]  A. Carvalho,et al.  Route map for machine learning in psychiatry: Absence of bias, reproducibility, and utility , 2021, European Neuropsychopharmacology.

[6]  Tilo Kircher,et al.  The German research consortium for the study of bipolar disorder (BipoLife): a magnetic resonance imaging study protocol , 2021, International Journal of Bipolar Disorders.

[7]  K. Heekeren,et al.  Multimodal Machine Learning Workflows for Prediction of Psychosis in Patients With Clinical High-Risk Syndromes and Recent-Onset Depression , 2020, JAMA psychiatry.

[8]  Erick Jorge Canales-Rodríguez,et al.  What we learn about bipolar disorder from large‐scale neuroimaging: Findings and future directions from the ENIGMA Bipolar Disorder Working Group , 2020, Human brain mapping.

[9]  E. Duchesnay,et al.  Will machine learning applied to neuroimaging in bipolar disorder help the clinician? A critical review and methodological suggestions , 2020, Bipolar disorders.

[10]  Sarah L Bergen,et al.  Longitudinal Cortical Thickness Changes in Bipolar Disorder and the Relationship to Genetic Risk, Mania, and Lithium Use , 2020, Biological Psychiatry.

[11]  G. Juckel,et al.  Improving early recognition and intervention in people at increased risk for the development of bipolar disorder: study protocol of a prospective-longitudinal, naturalistic cohort study (Early-BipoLife) , 2019, International Journal of Bipolar Disorders.

[12]  V. Arolt,et al.  Systematic misestimation of machine learning performance in neuroimaging studies of depression , 2019, Neuropsychopharmacology.

[13]  M. DelBello,et al.  An International Society of Bipolar Disorders task force report: Precursors and prodromes of bipolar disorder , 2019, Bipolar disorders.

[14]  S. Frangou Neuroimaging Markers of Risk, Disease Expression, and Resilience to Bipolar Disorder , 2019, Current Psychiatry Reports.

[15]  Martin Weygandt,et al.  Visualizing evidence for Alzheimer's disease in deep neural networks trained on structural MRI data , 2019, 1903.07317.

[16]  P. Falkai,et al.  Prediction Models of Functional Outcomes for Individuals in the Clinical High-Risk State for Psychosis or With Recent-Onset Depression: A Multimodal, Multisite Machine Learning Analysis , 2018, JAMA psychiatry.

[17]  X. Geng,et al.  Illness, at-risk and resilience neural markers of early-stage bipolar disorder. , 2018, Journal of affective disorders.

[18]  Erick Jorge Canales-Rodríguez,et al.  Using structural MRI to identify bipolar disorders – 13 site machine learning study in 3020 individuals from the ENIGMA Bipolar Disorders Working Group , 2018, Molecular Psychiatry.

[19]  T. Suppes,et al.  Multigenerational transmission of liability to psychiatric illness in offspring of parents with bipolar disorder , 2018, Bipolar disorders.

[20]  P. McGuire,et al.  Transdiagnostic Risk Calculator for the Automatic Detection of Individuals at Risk and the Prediction of Psychosis: Second Replication in an Independent National Health Service Trust , 2018, Schizophrenia bulletin.

[21]  I. Falkenberg,et al.  Semistructured Interview for Bipolar At Risk States (SIBARS) , 2018, Psychiatry Research.

[22]  P. Falkai,et al.  Machine Learning Approaches for Clinical Psychology and Psychiatry. , 2018, Annual review of clinical psychology.

[23]  Krzysztof J. Gorgolewski,et al.  MRIQC: Advancing the automatic prediction of image quality in MRI from unseen sites , 2016, bioRxiv.

[24]  D. Kupfer,et al.  Assessment of a Person-Level Risk Calculator to Predict New-Onset Bipolar Spectrum Disorder in Youth at Familial Risk , 2017, JAMA psychiatry.

[25]  Erick Jorge Canales-Rodríguez,et al.  Cortical abnormalities in bipolar disorder: an MRI analysis of 6503 individuals from the ENIGMA Bipolar Disorder Working Group , 2017, Molecular Psychiatry.

[26]  Paolo Fusar-Poli,et al.  Development and Validation of a Clinically Based Risk Calculator for the Transdiagnostic Prediction of Psychosis , 2017, JAMA psychiatry.

[27]  Michael Breakspear,et al.  Functional Dysconnection of the Inferior Frontal Gyrus in Young People With Bipolar Disorder or at Genetic High Risk , 2017, Biological Psychiatry.

[28]  T. Schulze,et al.  Aims and structure of the German Research Consortium BipoLife for the study of bipolar disorder , 2016, International Journal of Bipolar Disorders.

[29]  R. Kahn,et al.  Multisite prediction of 4-week and 52-week treatment outcomes in patients with first-episode psychosis: a machine learning approach. , 2016, The lancet. Psychiatry.

[30]  H. Möller,et al.  Prediction of outcome in the psychosis prodrome using neuroanatomical pattern classification , 2016, Schizophrenia Research.

[31]  Lachlan T. Strike,et al.  Cortical abnormalities in adults and adolescents with major depression based on brain scans from 20 cohorts worldwide in the ENIGMA Major Depressive Disorder Working Group , 2016, Molecular Psychiatry.

[32]  Tomas Hajek,et al.  Using structural MRI to identify individuals at genetic risk for bipolar disorders: a 2-cohort, machine learning study. , 2015, Journal of psychiatry & neuroscience : JPN.

[33]  P. Falkai,et al.  Detecting the psychosis prodrome across high-risk populations using neuroanatomical biomarkers. , 2015, Schizophrenia bulletin.

[34]  T. Kishimoto,et al.  The Bipolar Prodrome Symptom Interview and Scale–Prospective (BPSS‐P): description and validation in a psychiatric sample and healthy controls , 2014, Bipolar disorders.

[35]  M. Berk,et al.  The predictive validity of bipolar at‐risk (prodromal) criteria in help‐seeking adolescents and young adults: a prospective study , 2014, Bipolar disorders.

[36]  Stefan Haufe,et al.  On the interpretation of weight vectors of linear models in multivariate neuroimaging , 2014, NeuroImage.

[37]  Michael Breakspear,et al.  Reduced Inferior Frontal Gyrus Activation During Response Inhibition to Emotional Stimuli in Youth at High Risk of Bipolar Disorder , 2013, Biological Psychiatry.

[38]  Yunqian Ma,et al.  Imbalanced Learning: Foundations, Algorithms, and Applications , 2013 .

[39]  P. Falkai,et al.  The diagnosis and treatment of bipolar disorder: recommendations from the current s3 guideline. , 2013, Deutsches Arzteblatt international.

[40]  M. Alda,et al.  Brain Structural Signature of Familial Predisposition for Bipolar Disorder: Replicable Evidence For Involvement of the Right Inferior Frontal Gyrus , 2013, Biological Psychiatry.

[41]  Hilleke E. Hulshoff Pol,et al.  Classification of schizophrenia patients and healthy controls from structural MRI scans in two large independent samples , 2012, NeuroImage.

[42]  M. Phillips,et al.  Pattern recognition analyses of brain activation elicited by happy and neutral faces in unipolar and bipolar depression , 2012, Bipolar disorders.

[43]  G. Juckel,et al.  Risk constellations prior to the development of bipolar disorders: rationale of a new risk assessment tool. , 2012, Journal of affective disorders.

[44]  R. Kessler,et al.  Prevalence and correlates of bipolar spectrum disorder in the world mental health survey initiative. , 2011, Archives of general psychiatry.

[45]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[46]  N. Craddock,et al.  Genetics of bipolar disorder. , 2010, Journal of medical genetics.

[47]  Tom M. Mitchell,et al.  Machine learning classifiers and fMRI: A tutorial overview , 2009, NeuroImage.

[48]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[49]  Olga V. Demler,et al.  Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. , 2005, Archives of general psychiatry.

[50]  Anders M. Dale,et al.  Sequence-independent segmentation of magnetic resonance images , 2004, NeuroImage.

[51]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[52]  G. Juckel,et al.  [Mental health of children, adolescents and young adults--part 1: prevalence, illness persistence, adversities, service use, treatment delay and consequences]. , 2013, Fortschritte der Neurologie-Psychiatrie.

[53]  A. Pfennig,et al.  Versorgungserfahrungen bipolarer Patienten in Deutschland , 2011, Nervenheilkunde.

[54]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..