Validating the measurement of real-world functional outcomes: phase I results of the VALERO study.

OBJECTIVE Treatment of cognitive impairment has been proposed as an intervention to reduce disability in people with schizophrenia. The Validation of Everyday Real-World Outcomes (VALERO) study was conducted to evaluate functional rating scales and to identify the rating scale or scales most robustly related to performance-based measures of cognition and everyday living skills. METHOD Adults with schizophrenia (N=198) were tested with the neurocognitive measures from the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) Consensus Cognitive Battery, the UCSD Performance-Based Skills Assessment-Brief Version, and the advanced finances subscale of the Everyday Functioning Battery. They and an informant (a friend, relative, clinician, or case manager) also reported their everyday functioning on six rating scales. Best judgment ratings were generated by an interviewer who administered the rating scales to patients and informants. RESULTS Statistical analyses developed an ability latent trait that reflected scores on the three performance-based (i.e., ability) measures, and canonical correlation analysis related interviewer ratings to the latent trait. The overall fit of the model with all six rating scales was good. Individual rating scales that did not improve the fit of the model were systematically deleted, and a final model with two rating scales was fitted to the data. A regression analysis found that the Specific Levels of Functioning Assessment was a superior predictor of the three performance-based ability measures. CONCLUSIONS Systematic assessments of real-world functioning were related to performance on neurocognitive and functional capacity measures. Of the six rating scales evaluated in this study, the Specific Levels of Functioning Assessment was the best. Use of a single rating scale provides an efficient assessment of real-world functioning that accounts for considerable variance in performance-based scores.

[1]  Philip D. Harvey,et al.  Performance and interview-based assessments of cognitive change in a randomized, double-blind comparison of lurasidone vs. ziprasidone , 2011, Schizophrenia Research.

[2]  Philip D. Harvey,et al.  Validating measures of real-world outcome: the results of the VALERO expert survey and RAND panel. , 2011, Schizophrenia bulletin.

[3]  Philip D. Harvey,et al.  Characteristics of the MATRICS Consensus Cognitive Battery in a 29-site antipsychotic schizophrenia clinical trial , 2011, Schizophrenia Research.

[4]  Philip D. Harvey,et al.  Prediction of real-world functional disability in chronic mental disorders: a comparison of schizophrenia and bipolar disorder. , 2010, The American journal of psychiatry.

[5]  K. Nuechterlein,et al.  Symptoms as mediators of the relationship between neurocognition and functional outcome in schizophrenia: A meta-analysis , 2009, Schizophrenia Research.

[6]  Philip D. Harvey.  Pharmacological Cognitive Enhancement in Schizophrenia , 2009, Neuropsychology Review.

[7]  Michael F. Green,et al.  Development and psychometric performance of the schizophrenia objective functioning instrument: An interviewer administered measure of function , 2009, Schizophrenia Research.

[8]  Philip D. Harvey,et al.  Predicting Schizophrenia Patients’ Real-World Behavior with Specific Neuropsychological and Functional Capacity Measures , 2008, Biological Psychiatry.

[9]  Michael F. Green,et al.  The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity. , 2008, The American journal of psychiatry.

[10]  Michael F. Green,et al.  Functional co-primary measures for clinical trials in schizophrenia: results from the MATRICS Psychometric and Standardization Study. , 2008, The American journal of psychiatry.

[11]  Philip D. Harvey,et al.  Self-assessment of functional status in schizophrenia. , 2007, Journal of psychiatric research.

[12]  E. Twamley,et al.  A meta-analysis of cognitive remediation in schizophrenia. , 2007, The American journal of psychiatry.

[13]  S. McGurk,et al.  Cognitive training for supported employment: 2-3 year outcomes of a randomized controlled trial. , 2007, The American journal of psychiatry.

[14]  B. Mausbach,et al.  Development of a brief scale of everyday functioning in persons with serious mental illness. , 2006, Schizophrenia bulletin.

[15]  B. Mausbach,et al.  Functional Adaptation Skills Training (FAST): A randomized trial of a psychosocial intervention for middle-aged and older patients with chronic psychotic disorders , 2006, Schizophrenia Research.

[16]  Marvin Swartz,et al.  Barriers to employment for people with schizophrenia. , 2006, The American journal of psychiatry.

[17]  M. Toprac,et al.  Results of a multisite randomized trial of supported employment interventions for individuals with severe mental illness. , 2005, Archives of general psychiatry.

[18]  T. Patterson,et al.  Assessing Disability in Older Patients With Schizophrenia: Results From the WHODAS-II , 2004, The Journal of nervous and mental disease.

[19]  Carla J. Reicks,et al.  The impact of HIV-associated neuropsychological impairment on everyday functioning , 2004, Journal of the International Neuropsychological Society.

[20]  T. Patterson,et al.  Generalized cognitive impairments, ability to perform everyday tasks, and level of independence in community living situations of older patients with psychosis. , 2002, The American journal of psychiatry.

[21]  D. Walsh,et al.  Social disability in schizophrenia: Its development and prediction over 15 years in incidence cohorts in six European centres , 2000, Schizophrenia Research.

[22]  Alan D. Lopez,et al.  Global mortality, disability, and the contribution of risk factors: Global Burden of Disease Study , 1997, The Lancet.

[23]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[24]  M. Birchwood,et al.  The Social Functioning Scale the Development and Validation of a New Scale of Social Adjustment for use in Family Intervention Programmes with Schizophrenic Patients , 1990, British Journal of Psychiatry.

[25]  T. Wykes,et al.  The Measurement of Social Behaviour in Psychiatric Patients: An Assessment of the Reliability and Validity of the SBS Schedule , 1986, British Journal of Psychiatry.

[26]  E. Struening,et al.  SLOF: a behavioral rating scale for assessing the mentally ill. , 1983, Social work research & abstracts.

[27]  D. Patrick,et al.  Reliability, validity and ability to detect change of the clinician-rated Personal and Social Performance scale in patients with acute symptoms of schizophrenia. , 2009, Current medical research and opinion.

[28]  C. Wallace,et al.  The independent living skills survey: a comprehensive measure of the community functioning of severely and persistently mentally ill individuals. , 2000, Schizophrenia bulletin.

[29]  D. Braff,et al.  Neurocognitive deficits and functional outcome in schizophrenia: are we measuring the "right stuff"? , 2000, Schizophrenia bulletin.

[30]  D. Sheehan,et al.  The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. , 1998, The Journal of clinical psychiatry.

[31]  D. Hadzi-Pavlovic,et al.  The life skills profile: a measure assessing function and disability in schizophrenia. , 1989, Schizophrenia bulletin.

[32]  W T Carpenter,et al.  The Quality of Life Scale: an instrument for rating the schizophrenic deficit syndrome. , 1984, Schizophrenia bulletin.