Methods and Challenges for Assessing Heterogeneity

The widely acknowledged homogeneity assumption limits progress in refining clinical diagnosis, understanding mechanisms, and developing new treatments for mental health disorders. This homogeneity assumption drives both a comorbidity and a heterogeneity problem, where two different approaches tackle the problems. One, a unifying approach, tackles the comorbidity problem by assuming that a single general psychopathology factor underlies multiple disorders. Another, a multifactorial approach, tackles the heterogeneity problem by assuming that disorders comprise multiple subtypes driven by multiple discrete factors. We show how each of these approaches can make useful contributions to mental health-related research and clinical practice. For example, the unifying approach can develop a rapid assessment tool that may be clinically valuable for triaging cases. The multifactorial approach can reveal subtypes that are differentially responsive to treatments and highlight distinct mechanisms leading to similar phenotypes. Because both approaches tackle different problems, both have different limitations. We describe the statistical frameworks that incorporate and adjudicate between both approaches (e.g., the bifactor model, normative modeling, and the functional random forest). Such frameworks can identify whether sets of disorders are more affected by heterogeneity or comorbidity. Therefore, future studies that incorporate such frameworks can provide further insight into the nature of psychopathology.

[1]  L. Appel The Effects of Dietary Factors on Blood Pressure. , 2017, Cardiology clinics.

[2]  S. Senn,et al.  Does evidence support the high expectations placed in precision medicine? A bibliographic review , 2018, F1000Research.

[3]  G. Ceolotto,et al.  Genetic screening in arterial hypertension , 2017, Nature Reviews Endocrinology.

[4]  P. Szatmari,et al.  "P" and "DP:" Examining Symptom-Level Bifactor Models of Psychopathology and Dysregulation in Clinically Referred Children and Adolescents. , 2018, Journal of the American Academy of Child and Adolescent Psychiatry.

[5]  Adon F. G. Rosen,et al.  Development of a computerized adaptive screening tool for overall psychopathology ("p"). , 2019, Journal of psychiatric research.

[6]  Eiko I. Fried,et al.  Problematic assumptions have slowed down depression research: why symptoms, not syndromes are the way forward , 2015, Front. Psychol..

[7]  A. Murray,et al.  The Development of the General Factor of Psychopathology ‘p Factor’ Through Childhood and Adolescence , 2016, Journal of abnormal child psychology.

[8]  Emily A. Kuhl,et al.  DSM-5 field trials in the United States and Canada, Part II: test-retest reliability of selected categorical diagnoses. , 2013, The American journal of psychiatry.

[9]  Russell Greiner,et al.  A general prediction model for the detection of ADHD and Autism using structural and functional MRI , 2018, PloS one.

[10]  Andrew T. Drysdale,et al.  Resting-state connectivity biomarkers define neurophysiological subtypes of depression , 2016, Nature Medicine.

[11]  E. Feczko,et al.  Subtyping cognitive profiles in Autism Spectrum Disorder using a Functional Random Forest algorithm , 2017, NeuroImage.

[12]  Ralph-Axel Müller,et al.  Diagnostic classification of intrinsic functional connectivity highlights somatosensory, default mode, and visual regions in autism , 2015, NeuroImage: Clinical.

[13]  Avshalom Caspi,et al.  All for One and One for All: Mental Disorders in One Dimension. , 2018, The American journal of psychiatry.

[14]  D. Povinelli,et al.  Commentary – Autism Spectrum Disorder: Spectrum or Cluster? , 2016, Autism research : official journal of the International Society for Autism Research.

[15]  P. Lichtenstein,et al.  The contribution of common genetic risk variants for ADHD to a general factor of childhood psychopathology , 2017, bioRxiv.

[16]  Eiko I. Fried,et al.  Are fit indices used to test psychopathology structure biased? A simulation study. , 2019, Journal of abnormal psychology.

[17]  Swathi P. Iyer,et al.  Subtyping attention-deficit/hyperactivity disorder using temperament dimensions: toward biologically based nosologic criteria. , 2014, JAMA psychiatry.

[18]  M. Daly,et al.  Identification of risk loci with shared effects on five major psychiatric disorders: a genome-wide analysis , 2013, The Lancet.

[19]  Andrew M Michael,et al.  Divide and Conquer: Sub-Grouping of ASD Improves ASD Detection Based on Brain Morphometry , 2016, PloS one.

[20]  C. Beckmann,et al.  Conceptualizing mental disorders as deviations from normative functioning , 2019, Molecular Psychiatry.

[21]  Vince D. Calhoun,et al.  Single subject prediction of brain disorders in neuroimaging: Promises and pitfalls , 2017, NeuroImage.

[22]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[23]  Richie Poulton,et al.  Depression and Generalized Anxiety Disorder: Cumulative and Sequential Comorbidity in a Birth Cohort Followed Prospectively to Age 32 Years , 2009 .

[24]  E. Costello,et al.  Cumulative prevalence of psychiatric disorders by young adulthood: a prospective cohort analysis from the Great Smoky Mountains Study. , 2011, Journal of the American Academy of Child and Adolescent Psychiatry.

[25]  V. Cornelissen,et al.  Exercise Training for Blood Pressure: A Systematic Review and Meta‐analysis , 2013, Journal of the American Heart Association.

[26]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[27]  William A. Li,et al.  Association between psychosocial stress and hypertension: a systematic review and meta-analysis , 2017, Neurological research.

[28]  I. Melle,et al.  Mapping the Heterogeneous Phenotype of Schizophrenia and Bipolar Disorder Using Normative Models , 2018, JAMA psychiatry.

[29]  S. Hamrahian Management of Hypertension in Patients with Chronic Kidney Disease , 2017, Current Hypertension Reports.

[30]  Efstathios D. Gennatas,et al.  Common and Dissociable Mechanisms of Executive System Dysfunction Across Psychiatric Disorders in Youth. , 2016, The American journal of psychiatry.

[31]  S. Oparil,et al.  New approaches in the treatment of hypertension. , 2015, Circulation research.

[32]  Mert R. Sabuncu,et al.  Clinical Prediction from Structural Brain MRI Scans: A Large-Scale Empirical Study , 2014, Neuroinformatics.

[33]  A. McIntosh,et al.  Functional connectivity-based subtypes of individuals with and without autism spectrum disorder , 2019, Network Neuroscience.

[34]  Kathryn Roeder,et al.  Most genetic risk for autism resides with common variation , 2014, Nature Genetics.

[35]  S. Bölte,et al.  Dissecting the Heterogeneous Cortical Anatomy of Autism Spectrum Disorder Using Normative Models , 2018, bioRxiv.

[36]  N. Martin,et al.  Common genetic contributions to alcohol and cannabis use and dependence symptomatology. , 2010, Alcoholism, clinical and experimental research.

[37]  Dina R. Dajani,et al.  Progress and roadblocks in the search for brain-based biomarkers of autism and attention-deficit/hyperactivity disorder , 2017, Translational Psychiatry.

[38]  Stephen Senn,et al.  Measurement in clinical trials: A neglected issue for statisticians? , 2009, Statistics in medicine.

[39]  H. Hsin,et al.  ‘A more perfect arrangement of plants’: the botanical model in psychiatric nosology, 1676 to the present day , 2018, History of psychiatry.

[40]  Russell T. Shinohara,et al.  Common and Dissociable Regional Cerebral Blood Flow Differences Associate with Dimensions of Psychopathology Across Categorical Diagnoses , 2017, Molecular Psychiatry.

[41]  Tianzi Jiang,et al.  Polygenic risk for five psychiatric disorders and cross-disorder and disorder-specific neural connectivity in two independent populations , 2017, NeuroImage: Clinical.

[42]  Dan J Stein,et al.  Development of lifetime comorbidity in the World Health Organization world mental health surveys. , 2011, Archives of general psychiatry.

[43]  T. Moffitt,et al.  Single Nucleotide Polymorphism Heritability of a General Psychopathology Factor in Children. , 2016, Journal of the American Academy of Child and Adolescent Psychiatry.

[44]  I. Rezek,et al.  Understanding Heterogeneity in Clinical Cohorts Using Normative Models: Beyond Case-Control Studies , 2016, Biological Psychiatry.

[45]  Tim Ramsay,et al.  Spline smoothing over difficult regions , 2002 .

[46]  K. Kendler,et al.  An historical framework for psychiatric nosology , 2009, Psychological Medicine.

[47]  Sandhya Ramrakha,et al.  The p Factor , 2014, Clinical psychological science : a journal of the Association for Psychological Science.

[48]  David Watson,et al.  The Hierarchical Taxonomy of Psychopathology (HiTOP): A Dimensional Alternative to Traditional Nosologies , 2017, Journal of abnormal psychology.

[49]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[50]  J. Nigg,et al.  Temperament and developmental psychopathology. , 2006, Journal of child psychology and psychiatry, and allied disciplines.

[51]  Peter B. Jones,et al.  Investigating the genetic architecture of general and specific psychopathology in adolescence , 2018, Translational Psychiatry.

[52]  Tony Charman,et al.  Diagnosis of autism spectrum disorder: reconciling the syndrome, its diverse origins, and variation in expression , 2016, The Lancet Neurology.

[53]  Adon F. G. Rosen,et al.  Evidence for Dissociable Linkage of Dimensions of Psychopathology to Brain Structure in Youths. , 2019, The American journal of psychiatry.

[54]  R. Krueger,et al.  Common genetic influences on negative emotionality and a general psychopathology factor in childhood and adolescence. , 2013, Journal of abnormal psychology.

[55]  S. Senn Mastering variation: variance components and personalised medicine , 2015, Statistics in medicine.

[56]  Damien A. Fair,et al.  Characterizing heterogeneity in children with and without ADHD based on reward system connectivity , 2015, Developmental Cognitive Neuroscience.

[57]  Tyrone D. Cannon,et al.  Common genetic determinants of schizophrenia and bipolar disorder in Swedish families: a population-based study , 2009, The Lancet.

[58]  Nick C Fox,et al.  Analysis of shared heritability in common disorders of the brain , 2018, Science.

[59]  M. Mennes,et al.  Evaluating the evidence for biotypes of depression: Methodological replication and extension of , 2019, NeuroImage: Clinical.

[60]  A. Hariri,et al.  Is there a general factor of prevalent psychopathology during adulthood? , 2012, Journal of abnormal psychology.

[61]  B. Greenberg,et al.  Polygenic risk score and heritability estimates reveals a genetic relationship between ASD and OCD , 2017, European Neuropsychopharmacology.

[62]  Helen S Mayberg,et al.  Functional Connectivity of the Subcallosal Cingulate Cortex And Differential Outcomes to Treatment With Cognitive-Behavioral Therapy or Antidepressant Medication for Major Depressive Disorder. , 2017, The American journal of psychiatry.

[63]  E. Feczko,et al.  The Heterogeneity Problem: Approaches to Identify Psychiatric Subtypes , 2019, Trends in Cognitive Sciences.

[64]  E. Wagenmakers,et al.  AIC model selection using Akaike weights , 2004, Psychonomic bulletin & review.

[65]  T. Insel The NIMH Research Domain Criteria (RDoC) Project: precision medicine for psychiatry. , 2014, The American journal of psychiatry.

[66]  Karl J. Friston,et al.  Computational Nosology and Precision Psychiatry , 2017, Computational Psychiatry.

[67]  S. Mostofsky,et al.  Data-driven identification of subtypes of executive function across typical development, attention deficit hyperactivity disorder, and autism spectrum disorders. , 2019, Journal of child psychology and psychiatry, and allied disciplines.

[68]  G. McDougall,et al.  A review of screening instruments for assessing cognition and mental status in older adults. , 1990, The Nurse practitioner.