Validating measures of real-world outcome: the results of the VALERO expert survey and RAND panel.

BACKGROUND People with schizophrenia demonstrate considerable discrepancy between self-reported functioning and informant reports. It is not clear whether these discrepancies originate from the instruments used or from the perspectives of different informants. The goal of the Validation of Everyday Real-World Outcomes (VALERO) Study is to enhance the measurement of real-world (RW) outcomes in the social, residential, and vocational domains through selection of optimal scales and informants using a multistep process similar to the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) initiative. METHODS Forty-eight experts provided their opinion regarding the best scales measuring RW outcomes. Fifty-nine measures were nominated. The investigators selected the 11 scales that were the most highly nominated, had the most published validity data, and best represented the domains of interest. Information was provided to other experts who served as RAND panelists. Panelists rated each measure for its suitability across multiple a priori domains. Discrepant ratings were discussed until consensus was reached. RESULTS Following the RAND Panel, the 2 scales that scored highest across the various criteria for each of the classes of scales (hybrid, social functioning, and everyday living skills) were selected for use in the first substudy of VALERO. The scales selected were the Quality-of-Life Scale, Specific Levels of Functioning Scale, Social Behavior Schedule, Social Functioning Scale, Independent Living Skills Schedule, and Life Skills Profile. DISCUSSION The results show that although there are significant limitations with current scales used for the assessment of RW outcome in schizophrenia, a consensus is possible. Further, several existing instruments were rated as useful for measuring social, residential, and vocational outcomes.

[1]  W T Carpenter,et al.  The Quality of Life Scale: an instrument for rating the schizophrenic deficit syndrome. , 1984, Schizophrenia bulletin.

[2]  B. Mcfarland,et al.  A community ability scale for chronically mentally Ill consumers: Part I. Reliability and validity , 1994, Community Mental Health Journal.

[3]  Michael F. Green,et al.  Cognitive functioning in schizophrenia: a consensus statement on its role in the definition and evaluation of effective treatments for the illness. , 2004, The Journal of clinical psychiatry.

[4]  P. Czobor,et al.  The multidimensional scale of independent functioning: a new instrument for measuring functional disability in psychiatric populations. , 2003, Schizophrenia bulletin.

[5]  C. Wallace,et al.  Functional Assessment of Independent Living Skills , 1999 .

[6]  Michael F. Green,et al.  The MATRICS Consensus Cognitive Battery, part 2: co-norming and standardization. , 2008, The American journal of psychiatry.

[7]  Philip D. Harvey,et al.  Predicting Schizophrenia Patients’ Real-World Behavior with Specific Neuropsychological and Functional Capacity Measures , 2008, Biological Psychiatry.

[8]  Philip D. Harvey,et al.  Performance-based measures of functional skills: usefulness in clinical treatment studies. , 2007, Schizophrenia bulletin.

[9]  N. Andreasen,et al.  Dependence on public financial support early in the course of schizophrenia. , 1997, Psychiatric services.

[10]  Michael F. Green,et al.  Functional co-primary measures for clinical trials in schizophrenia: results from the MATRICS Psychometric and Standardization Study. , 2008, The American journal of psychiatry.

[11]  F. Dickerson,et al.  An Expanded Version of the Multnomah Community Ability Scale: Anchors and Interview Probes for the Assessment of Adults with Serious Mental Illness , 2003, Community Mental Health Journal.

[12]  Philip D. Harvey,et al.  The Schizophrenia Cognition Rating Scale: an interview-based assessment and its relationship to cognition, real-world functioning, and functional capacity. , 2006, The American journal of psychiatry.

[13]  C. Wallace,et al.  The independent living skills survey: a comprehensive measure of the community functioning of severely and persistently mentally ill individuals. , 2000, Schizophrenia bulletin.

[14]  Philip D. Harvey,et al.  Self-assessment of functional status in schizophrenia. , 2007, Journal of psychiatric research.

[15]  Michael F. Green,et al.  The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity. , 2008, The American journal of psychiatry.

[16]  D. Walsh,et al.  Social disability in schizophrenia: Its development and prediction over 15 years in incidence cohorts in six European centres , 2000, Schizophrenia Research.

[17]  T. Patterson,et al.  Assessing Disability in Older Patients With Schizophrenia: Results From the WHODAS-II , 2004, The Journal of nervous and mental disease.

[18]  M. Birchwood,et al.  programmes with schizophrenic patients. new scale of social adjustment for use in family intervention The Social Functioning Scale. The development and validation of a , 2022 .

[19]  Philip D. Harvey,et al.  The Relationship of the Brief Assessment of Cognition in Schizophrenia (BACS) to Functional Capacity and Real-world Functional Outcome , 2006, Journal of clinical and experimental neuropsychology.

[20]  Robert M Bilder,et al.  Symptomatic and functional recovery from a first episode of schizophrenia or schizoaffective disorder. , 2004, The American journal of psychiatry.

[21]  Determinants of real-world functional performance in schizophrenia subjects: correlations with cognition, functional capacity, and symptoms. , 2010, The American journal of psychiatry.

[22]  W. Fenton,et al.  Measurement and Treatment Research to Improve Cognition in Schizophrenia: NIMH MATRICS initiative to support the development of agents for improving cognition in schizophrenia , 2004, Schizophrenia Research.

[23]  M. Lorant.  WHO International Pilot Study of Schizophrenia , 1967, Psychological Medicine.

[24]  T. Wykes,et al.  The Measurement of Social Behaviour in Psychiatric Patients: An Assessment of the Reliability and Validity of the SBS Schedule , 1986, British Journal of Psychiatry.

[25]  E. Struening,et al.  SLOF: a behavioral rating scale for assessing the mentally ill. , 1983, Social work research & abstracts.

[26]  Alan D. Lopez,et al.  Global mortality, disability, and the contribution of risk factors: Global Burden of Disease Study , 1997, The Lancet.

[27]  D. R. Sewell,et al.  Assessing levels of adaptive functioning: The Role Functioning Scale , 1993, Community Mental Health Journal.

[28]  T. Patterson,et al.  Generalized cognitive impairments, ability to perform everyday tasks, and level of independence in community living situations of older patients with psychosis. , 2002, The American journal of psychiatry.

[29]  M. Tohen,et al.  One hundred years of schizophrenia: a meta-analysis of the outcome literature. , 1994 .

[30]  D. Hadzi-Pavlovic,et al.  The life skills profile: a measure assessing function and disability in schizophrenia. , 1989, Schizophrenia bulletin.