Can structural MRI aid in clinical classification? A machine learning study in two independent samples of patients with schizophrenia, bipolar disorder and healthy subjects

Although structural magnetic resonance imaging (MRI) has revealed partly non-overlapping brain abnormalities in schizophrenia and bipolar disorder, it is unknown whether structural MRI scans can be used to separate individuals with schizophrenia from those with bipolar disorder. An algorithm capable of discriminating between these two disorders could become a diagnostic aid for psychiatrists. Here, we scanned 66 schizophrenia patients, 66 patients with bipolar disorder and 66 healthy subjects on a 1.5T MRI scanner. Three support vector machines were trained to separate patients with schizophrenia from healthy subjects, patients with schizophrenia from those with bipolar disorder, and patients with bipolar disorder from healthy subjects, respectively, based on their gray matter density images. The predictive power of the models was tested using cross-validation and in an independent validation set of 46 schizophrenia patients, 47 patients with bipolar disorder and 43 healthy subjects scanned on a 3T MRI scanner. Schizophrenia patients could be separated from healthy subjects with an average accuracy of 90%. Additionally, schizophrenia patients and patients with bipolar disorder could be distinguished with an average accuracy of 88%.The model delineating bipolar patients from healthy subjects was less accurate, correctly classifying 67% of the healthy subjects and only 53% of the patients with bipolar disorder. In the latter group, lithium and antipsychotics use had no influence on the classification results. Application of the 1.5T models on the 3T validation set yielded average classification accuracies of 76% (healthy vs schizophrenia), 66% (bipolar vs schizophrenia) and 61% (healthy vs bipolar). In conclusion, the accurate separation of schizophrenia from bipolar patients on the basis of structural MRI scans, as demonstrated here, could be of added value in the differential diagnosis of these two disorders. The results also suggest that gray matter pathology in schizophrenia and bipolar disorder differs to such an extent that they can be reliably differentiated using machine learning paradigms.

[1]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[2]  Timothy P. L. Roberts,et al.  DTI Based Diagnostic Prediction of a Disease via Pattern Classification , 2010, MICCAI.

[3]  J. Tebes,et al.  A Comparison of the Structured Clinical Interview for DSM‐III-R and Clinical Diagnoses , 1995, The Journal of nervous and mental disease.

[4]  Anders M. Dale,et al.  CORTICAL THICKNESS AND SUBCORTICAL VOLUMES IN SCHIZOPHRENIA AND BIPOLAR DISORDER , 2010, Schizophrenia Research.

[5]  D. Louis Collins,et al.  Automatic 3‐D model‐based neuroanatomical segmentation , 1995 .

[6]  Rachel M. Brouwer,et al.  Segmentation of MRI brain scans using non-uniform partial volume densities , 2010, NeuroImage.

[7]  B. Turetsky,et al.  Whole-brain morphometric study of schizophrenia revealing a spatially complex set of focal abnormalities. , 2005, Archives of general psychiatry.

[8]  R. Kahn,et al.  Brain volumes in schizophrenia: a meta-analysis in over 18 000 subjects. , 2013, Schizophrenia bulletin.

[9]  M. Miller,et al.  Region‐of‐interest‐based analysis with application of cortical thickness variation of left planum temporale in schizophrenia and psychotic bipolar disorder , 2008, Human brain mapping.

[10]  Gérard Dreyfus,et al.  Single-layer learning revisited: a stepwise procedure for building and training a neural network , 1989, NATO Neurocomputing.

[11]  Raymond Salvador,et al.  Validity of modulation and optimal settings for advanced voxel-based morphometry , 2014, NeuroImage.

[12]  Steven C. R. Williams,et al.  Meta-analysis, database, and meta-regression of 98 structural imaging studies in bipolar disorder. , 2008, Archives of general psychiatry.

[13]  C. Leonard,et al.  Cumulative effect of anatomical risk factors for schizophrenia: an MRI study , 1999, Biological Psychiatry.

[14]  Randy L. Gollub,et al.  Neuropsychological Testing and Structural Magnetic Resonance Imaging as Diagnostic Biomarkers Early in the Course of Schizophrenia and Related Psychoses , 2011, Neuroinformatics.

[15]  Koji Yamashita,et al.  Alzheimer's disease: diagnosis by different methods of voxel-based morphometry. , 2012, Fukuoka igaku zasshi = Hukuoka acta medica.

[16]  Alan C. Evans,et al.  Overlapping and segregating structural brain abnormalities in twins with schizophrenia or bipolar disorder. , 2012, Archives of general psychiatry.

[17]  Yanxi Liu,et al.  Discriminative MR Image Feature Analysis for Automatic Schizophrenia and Alzheimer's Disease Classification , 2004, MICCAI.

[18]  Nancy C. Andreasen,et al.  Long-term Antipsychotic Treatment and Brain Volumes A Longitudinal Study of First-Episode Schizophrenia , 2011 .

[19]  N C Andreasen,et al.  The Comprehensive Assessment of Symptoms and History (CASH). An instrument for assessing diagnosis and psychopathology. , 1992, Archives of general psychiatry.

[20]  S. Charles Schulz,et al.  Classification of adolescent psychotic disorders using linear discriminant analysis , 2006, Schizophrenia Research.

[21]  Dorret I Boomsma,et al.  Genetic and environmental influences on focal brain density in bipolar disorder. , 2010, Brain : a journal of neurology.

[22]  Sophia Rabe-Hesketh,et al.  Meta-analysis of magnetic resonance imaging brain morphometry studies in bipolar disorder , 2004, Biological Psychiatry.

[23]  I. Melle,et al.  Cortical Volume, Surface Area, and Thickness in Schizophrenia and Bipolar Disorder , 2012, Biological Psychiatry.

[24]  I. Skre,et al.  High interrater reliability for the Structured Clinical Interview for DSM‐III‐R Axis I (SCID‐I) , 1991, Acta psychiatrica Scandinavica.

[25]  James J Levitt,et al.  A cross-sectional and longitudinal magnetic resonance imaging study of cingulate gyrus gray matter volume abnormalities in first-episode schizophrenia and first-episode affective psychosis. , 2008, Archives of general psychiatry.

[26]  Klaus P. Ebmeier,et al.  Magnetic resonance imaging studies in bipolar disorder and schizophrenia: meta-analysis. , 2009, The British journal of psychiatry : the journal of mental science.

[27]  Vaughan J. Carr,et al.  Systematic meta-review and quality assessment of the structural brain alterations in schizophrenia , 2012, Neuroscience & Biobehavioral Reviews.

[28]  G. Moore,et al.  Lithium-induced increase in human brain grey matter , 2000, The Lancet.

[29]  H. Möller,et al.  Use of neuroanatomical pattern classification to identify subjects in at-risk mental states of psychosis and predict disease transition. , 2009, Archives of general psychiatry.

[30]  M. Phillips,et al.  Grey matter differences in bipolar disorder: a meta‐analysis of voxel‐based morphometry studies , 2012, Bipolar disorders.

[31]  M. Yücel,et al.  Mapping grey matter reductions in schizophrenia: An anatomical likelihood estimation analysis of voxel-based morphometry studies , 2009, Schizophrenia Research.

[32]  Hilleke E. Hulshoff Pol,et al.  Classification of schizophrenia patients and healthy controls from structural MRI scans in two large independent samples , 2012, NeuroImage.

[33]  J. Endicott,et al.  A diagnostic interview: the schedule for affective disorders and schizophrenia. , 1978, Archives of general psychiatry.

[34]  P. Mcguire,et al.  The effects of antipsychotics on the brain: what have we learnt from structural imaging of schizophrenia?--a systematic review. , 2009, Current pharmaceutical design.

[35]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[36]  R. Gur,et al.  Unaffected Family Members and Schizophrenia Patients Share Brain Structure Patterns: A High-Dimensional Pattern Classification Study , 2008, Biological Psychiatry.

[37]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[38]  Muriel Walshe,et al.  Regional volume deviations of brain structure in schizophrenia and psychotic bipolar disorder , 2005, British Journal of Psychiatry.

[39]  Alan C. Evans,et al.  Focal gray matter density changes in schizophrenia. , 2001, Archives of general psychiatry.

[40]  J. Ballenger,et al.  Are There Progressive Brain Changes in Schizophrenia? A Meta-Analysis of Structural Magnetic Resonance Imaging Studies , 2012 .

[41]  Stefan Klöppel,et al.  Estimating the age of healthy subjects from T1-weighted MRI scans using kernel methods: Exploring the influence of various parameters , 2010, NeuroImage.

[42]  H. Yamasue,et al.  Classification of First-Episode Schizophrenia Patients and Healthy Subjects by Automated MRI Measures of Regional Brain Volume and Cortical Thickness , 2011, PloS one.

[43]  Rachel M. Brouwer,et al.  Exercise therapy, cardiorespiratory fitness and their effect on brain volumes: A randomised controlled trial in patients with schizophrenia and healthy controls , 2013, European Neuropsychopharmacology.

[44]  Yasuhiro Kawasaki,et al.  Multiple structural brain measures obtained by three-dimensional magnetic resonance imaging to distinguish between schizophrenia patients and normal subjects. , 2004, Schizophrenia bulletin.

[45]  Mert R. Sabuncu,et al.  A Unified Framework for MR Based Disease Classification , 2009, IPMI.

[46]  E. Bullmore,et al.  Anatomy of bipolar disorder and schizophrenia: A meta-analysis , 2010, Schizophrenia Research.

[47]  E. Robins,et al.  Research diagnostic criteria: rationale and reliability. , 1978, Archives of general psychiatry.

[48]  Daniel Schwarz,et al.  Maximum-uncertainty linear discrimination analysis of first-episode schizophrenia subjects , 2011, Psychiatry Research: Neuroimaging.

[49]  Joaquín Goñi,et al.  Abnormal rich club organization and functional brain dynamics in schizophrenia. , 2013, JAMA psychiatry.