Social Cognition Psychometric Evaluation: Results of the Final Validation Study

Social cognition is increasingly recognized as an important treatment target in schizophrenia; however, the dearth of well-validated measures that are suitable for use in clinical trials remains a significant limitation. The Social Cognition Psychometric Evaluation (SCOPE) study addresses this need by systematically evaluating the psychometric properties of promising measures. In this final phase of SCOPE, eight new or modified tasks were evaluated. Stable outpatients with schizophrenia (n = 218) and healthy controls (n = 154) completed the battery at baseline and 2-4 weeks later across three sites. Tasks included the Bell Lysaker Emotion Recognition Task (BLERT), Penn Emotion Recognition Task (ER-40), Reading the Mind in the Eyes Task (Eyes), The Awareness of Social Inferences Test (TASIT), Hinting Task, Mini Profile of Nonverbal Sensitivity (MiniPONS), Social Attribution Task-Multiple Choice (SAT-MC), and Intentionality Bias Task (IBT). BLERT and ER-40 modifications included response time and confidence ratings. The Eyes task was modified to include definitions of terms and TASIT to include response time. Hinting was scored with more stringent criteria. MiniPONS, SAT-MC, and IBT were new to this phase. Tasks were evaluated on (1) test-retest reliability, (2) utility as a repeated measure, (3) relationship to functional outcome, (4) practicality and tolerability, (5) sensitivity to group differences, and (6) internal consistency. Hinting, BLERT, and ER-40 showed the strongest psychometric properties and are recommended for use in clinical trials. Eyes, TASIT, and IBT showed somewhat weaker psychometric properties and require further study. MiniPONS and SAT-MC showed poorer psychometric properties that suggest caution for their use in clinical trials.

[1]  Helena Chmura Kraemer,et al.  DSM-5: how reliable is reliable enough? , 2012, The American journal of psychiatry.

[2]  Michael F. Green,et al.  Adapting social neuroscience measures for schizophrenia clinical trials, part 3: fathoming external validity. , 2013, Schizophrenia bulletin.

[3]  Philip D. Harvey,et al.  Assessing everyday functioning in schizophrenia: Not all informants seem equally informative , 2011, Schizophrenia Research.

[4]  T. Patterson,et al.  Social skills performance assessment among older patients with schizophrenia , 2001, Schizophrenia Research.

[5]  Michael F. Green,et al.  Adapting social neuroscience measures for schizophrenia clinical trials, Part 2: trolling the depths of psychometric properties. , 2013, Schizophrenia bulletin.

[6]  D. Penn,et al.  Social cognition and interaction training (SCIT) for outpatients with schizophrenia: A preliminary study , 2009, Psychiatry Research.

[7]  Michael F. Green,et al.  Social Cognition Psychometric Evaluation: Results of the Initial Psychometric Study. , 2015, Schizophrenia bulletin.

[8]  D. Penn,et al.  Neurocognitive and social cognitive predictors of interpersonal skill in schizophrenia , 2006, Psychiatry Research.

[9]  Judith A. Hall,et al.  Introducing the MiniPONS: A Short Multichannel Version of the Profile of Nonverbal Sensitivity (PONS) , 2011 .

[10]  S. Baron-Cohen,et al.  The "Reading the Mind in the Eyes" Test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. , 2001, Journal of child psychology and psychiatry, and allied disciplines.

[11]  R. Gur,et al.  Facial emotion recognition in schizophrenia: intensity effects and error pattern. , 2003, The American journal of psychiatry.

[12]  Philip D. Harvey,et al.  Social cognition psychometric evaluation (SCOPE) in people with early psychosis: A preliminary study , 2017, Schizophrenia Research.

[13]  Evelyn Rosset It’s no accident: Our bias for intentional explanations , 2008, Cognition.

[14]  Michael F. Green,et al.  The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity. , 2008, The American journal of psychiatry.

[15]  M. Egan,et al.  Cognitive impairments in patients with schizophrenia displaying preserved and compromised intellect. , 2000, Archives of general psychiatry.

[16]  D. Penn,et al.  Social cognition in schizophrenia: factor structure, clinical and functional correlates , 2016, Journal of mental health.

[17]  Philip D. Harvey,et al.  Revisiting the validity of measures of social cognitive bias in schizophrenia: Additional results from the Social Cognition Psychometric Evaluation (SCOPE) study. , 2016, The British journal of clinical psychology.

[18]  Brent Strickland,et al.  The intentionality bias in schizophrenia , 2014, Psychiatry Research.

[19]  Michael F. Green,et al.  Going from social neuroscience to schizophrenia clinical trials. , 2013, Schizophrenia bulletin.

[20]  B. Mausbach,et al.  Development of a brief scale of everyday functioning in persons with serious mental illness. , 2006, Schizophrenia bulletin.

[21]  Michael F. Green,et al.  Approaching a consensus cognitive battery for clinical trials in schizophrenia: The NIMH-MATRICS conference to select cognitive domains and test criteria , 2004, Biological Psychiatry.

[22]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[23]  E. Struening,et al.  SLOF: a behavioral rating scale for assessing the mentally ill. , 1983, Social work research & abstracts.

[24]  G. Dimaggio,et al.  Metacognitive capacities for reflection in schizophrenia: implications for developing treatments. , 2014, Schizophrenia bulletin.

[25]  W. Strik,et al.  Nonverbal social communication and gesture control in schizophrenia. , 2015, Schizophrenia bulletin.

[26]  H. Kraemer Toward sound objective evaluation of clinical measures. , 2013, The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry.

[27]  Eve C. Johnstone,et al.  A neuropsychological investigation into ‘Theory of Mind’ and enhanced risk of schizophrenia , 2006, Psychiatry Research.

[28]  Philip D. Harvey,et al.  Self-assessment of social cognitive ability in individuals with schizophrenia: Appraising task difficulty and allocation of effort , 2017, Schizophrenia Research.

[29]  Skye McDonald,et al.  TASIT: A New Clinical Tool for Assessing Social Perception After Traumatic Brain Injury , 2003, The Journal of head trauma rehabilitation.

[30]  J. Os,et al.  Evidence for a relationship between mentalising deficits and paranoia over the psychosis continuum , 2008, Schizophrenia Research.

[31]  John O. Willis,et al.  Wechsler Abbreviated Scale of Intelligence , 2014 .

[32]  A. Klin Attributing social meaning to ambiguous visual stimuli in higher-functioning autism and Asperger syndrome: The Social Attribution Task. , 2000, Journal of child psychology and psychiatry, and allied disciplines.

[33]  Philip D. Harvey,et al.  The Effect of Age, Race, and Sex on Social Cognitive Performance in Individuals With Schizophrenia , 2017, The Journal of nervous and mental disease.

[34]  Jason K. Johannesen,et al.  The Social Attribution Task-Multiple Choice (SAT-MC): A Psychometric and Equivalence Study of an Alternate Form , 2013, ISRN psychiatry.

[35]  M. Bell,et al.  Affect recognition in schizophrenia: a function of global impairment or a specific cognitive deficit , 1997, Psychiatry Research.

[36]  Michael F. Green,et al.  The social cognition psychometric evaluation study: results of the expert survey and RAND panel. , 2013, Schizophrenia bulletin.

[37]  Michael F. Green,et al.  Improving measurement of attributional style in schizophrenia; A psychometric evaluation of the Ambiguous Intentions Hostility Questionnaire (AIHQ). , 2017, Journal of psychiatric research.

[38]  Philip D. Harvey,et al.  Self-assessment in schizophrenia: Accuracy of evaluation of cognition and everyday functioning. , 2015, Neuropsychology.

[39]  J. Nunnally,et al.  Psychometric Theory , 2020, Encyclopedia of Behavioral Medicine.

[40]  N. Ambady,et al.  On judging and being judged accurately in zero-acquaintance situations. , 1995 .

[41]  E. Peterson,et al.  The Eyes Test as a Measure of Individual Differences: How much of the Variance Reflects Verbal IQ? , 2012, Front. Psychology.

[42]  Philip D. Harvey,et al.  Impaired Self-Assessment in Schizophrenia: Why Patients Misjudge Their Cognition and Functioning: Observations from Caregivers and Clinicians Seem to Have the Most Validity , 2015 .

[43]  B. Wexler,et al.  Social attribution test — multiple choice (SAT-MC) in schizophrenia: Comparison with community sample and relationship to neurocognitive, social cognitive and symptom measures , 2010, Schizophrenia Research.

[44]  Michael F. Green,et al.  Social cognition in psychosis: Multidimensional structure, clinical correlates, and relationship with functional outcome , 2011, Schizophrenia Research.

[45]  C. Frith,et al.  Schizophrenia, symptomatology and social inference: Investigating “theory of mind” in people with schizophrenia , 1995, Schizophrenia Research.