Assessment of community functioning in people with schizophrenia and other severe mental illnesses: a white paper based on an NIMH-sponsored workshop.

People with schizophrenia frequently have significant problems in community functioning. Progress in developing effective interventions to ameliorate these problems has been slowed by the absence of reliable and valid measures that are suitable for use in clinical trials. The National Institute of Mental Health convened a workgroup in September 2005 to examine this issue and make recommendations to the field that would foster research in this area. This article reports on issues raised at the meeting. Many instruments have been developed to assess community functioning, but overall insufficient attention has been paid to psychometric issues and many instruments are not suitable for use in clinical trials. Consumer self-report, informant report, ratings by clinicians and trained raters, and behavioral assessment all can provide useful and valid information in some circumstances and may be practical for use in clinical trials. However, insufficient attention has been paid to when and how different forms of assessment and sources of information are useful or how to understand inconsistencies. A major limiting factor in development of reliable and valid instruments is failure to develop a suitable model of functioning and its primary mediators and moderators. Several examples that can guide thinking are presented. Finally, the field is limited by the absence of an objective gold standard of community functioning. Hence, outcomes must be evaluated in part by "clinical significance." This criterion is problematic because different observers and constituencies often have different opinions about what types of change are clinically important and how much change is significant.

[1]  T L Patterson,et al.  UCSD Performance-Based Skills Assessment , 2016 .

[2]  A. Bellack,et al.  Psychometric characteristics of role-play assessments of social skill in schizophrenia. , 2006, Behavior therapy.

[3]  Brian Kirkpatrick,et al.  The NIMH-MATRICS consensus statement on negative symptoms. , 2006, Schizophrenia bulletin.

[4]  Robert L Levin,et al.  Food and Drug Administration perspective on negative symptoms in schizophrenia as a target for a drug treatment claim. , 2006, Schizophrenia bulletin.

[5]  Philip D. Harvey,et al.  The Schizophrenia Cognition Rating Scale: an interview-based assessment and its relationship to cognition, real-world functioning, and functional capacity. , 2006, The American journal of psychiatry.

[6]  Robert K. Heaton,et al.  Determinants of real-world functional performance in schizophrenia subjects: correlations with cognition, functional capacity, and symptoms. , 2006, The American journal of psychiatry.

[7]  Michael F. Green,et al.  Biosocial pathways to functional outcome in schizophrenia , 2005, Schizophrenia Research.

[8]  Jeri Benson,et al.  Developing a Strong Program of Construct Validation: A Test Anxiety Example , 2005 .

[9]  K. Cook,et al.  Dynamic assessment of health outcomes: time to let the CAT out of the bag? , 2005, Health services research.

[10]  A. Bellack Scientific and consumer models of recovery in schizophrenia: concordance, contrasts, and implications. , 2005, Schizophrenia bulletin.

[11]  S. Urbina Essentials of Psychological Testing , 2005, PsyPag Quarterly.

[12]  A. Belanger,et al.  The Revised Behavior and Symptom Identification Scale (BASIS-R): Reliability and Validity , 2004, Medical care.

[13]  A. Leon Multiplicity-adjusted sample size requirements: a strategy to maintain statistical power with Bonferroni adjustments. , 2004, The Journal of clinical psychiatry.

[14]  T. Patterson,et al.  Assessing Disability in Older Patients With Schizophrenia: Results From the WHODAS-II , 2004, The Journal of nervous and mental disease.

[15]  Carla J. Reicks,et al.  The impact of HIV-associated neuropsychological impairment on everyday functioning , 2004, Journal of the International Neuropsychological Society.

[16]  A. Dowson,et al.  Applications of computerized adaptive testing (CAT) to the assessment of headache impact , 2003, Quality of Life Research.

[17]  Andy H. Lee,et al.  Assessing the driving performance of older adult drivers: on-road versus simulated driving. , 2003, Accident; analysis and prevention.

[18]  David Cella,et al.  Item banking to improve, shorten and computerize self-reported fatigue: An illustration of steps to create a core item bank from the FACIT-Fatigue Scale , 2003, Quality of Life Research.

[19]  H. Kraemer,et al.  Mediators and moderators of treatment effects in randomized clinical trials. , 2002, Archives of general psychiatry.

[20]  T. Patterson,et al.  Medication Management Ability Assessment: Results From a Performance-Based Measure in Older Outpatients With Schizophrenia , 2002, Journal of clinical psychopharmacology.

[21]  M. Rizzo,et al.  Simulated Car Crashes at Intersections in Drivers With Alzheimer Disease , 2001, Alzheimer disease and associated disorders.

[22]  Michael J. Taylor,et al.  The impact of HIV-related neuropsychological dysfunction on driving behavior , 2000, Journal of the International Neuropsychological Society.

[23]  C. McHorney,et al.  Equating Health Status Measures With Item Response Theory: Illustrations With Functional Status Items , 2000, Medical care.

[24]  G. Wilkinson,et al.  Self-report quality of life measure for people with schizophrenia: the SQLS. , 2000, The British journal of psychiatry : the journal of mental science.

[25]  P. Morosini,et al.  Development, reliability and acceptability of a new version of the DSM‐IV Social and Occupational Functioning Assessment Scale (SOFAS) to assess routine social funtioning , 2000, Acta psychiatrica Scandinavica.

[26]  Robert L. Leahy,et al.  The Use of Psychological Testing for Treatment Planning and Outcome Assessment , 2000, Journal of Cognitive Psychotherapy.

[27]  Wilbur L. Smith,et al.  Erratum: ″Personality change disorder in children and adolescents following traumatic brain injury,″ (Journal of the International Neuropsychological Society (2000) vol. 6(3) (279-289)) , 1999 .

[28]  R. Barton,et al.  Psychosocial rehabilitation services in community support systems: a review of outcomes and policy recommendations. , 1999, Psychiatric services.

[29]  J. Cook,et al.  Choosing and using outcome measures , 1998 .

[30]  H. Lehfeld,et al.  The Bayer Activities of Daily Living Scale (B-ADL) , 1998, Dementia and Geriatric Cognitive Disorders.

[31]  Nicholas Tarrier,et al.  Handbook of Social Functioning in Schizophrenia , 1998 .

[32]  D. Langbehn,et al.  Self-reported life satisfaction. , 1997, The American journal of psychiatry.

[33]  Arfken Cl Self-reported life satisfaction , 1997 .

[34]  F. Dickerson,et al.  Assessing clinical outcomes: the community functioning of persons with serious mental illness. , 1997, Psychiatric services.

[35]  T. Patterson,et al.  Researching the Caregiver: Family Members Who Care for Older Psychotic Patients , 1996 .

[36]  M. Orrell,et al.  Patients' Views Towards Care Received from Psychiatrists , 1996, British Journal of Psychiatry.

[37]  Michael F. Green,et al.  What are the functional consequences of neurocognitive deficits in schizophrenia? , 1996, The American journal of psychiatry.

[38]  C. Pantelis,et al.  Four behavioural syndromes of schizophrenia , 1996, Schizophrenia Research.

[39]  K. Mueser,et al.  Evaluation of social problem solving in schizophrenia. , 1994, Journal of abnormal psychology.

[40]  C. Rapin,et al.  The Paradoxes of Quality of Life and its Phenomenological Approach , 1994, Journal of palliative care.

[41]  C. McHorney,et al.  The MOS 36‐Item Short‐Form Health Survey (SF‐36): II. Psychometric and Clinical Tests of Validity in Measuring Physical and Mental Health Constructs , 1993, Medical care.

[42]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[43]  J. Haes,et al.  The distinction between affect and cognition in the quality of life of cancer patients—sensitivity and stability , 1992, Quality of Life Research.

[44]  C. Jenkins,et al.  Assessment of outcomes of health intervention. , 1992, Social science & medicine.

[45]  C. Sherbourne,et al.  The MOS 36-Item Short-Form Health Survey (SF-36) , 1992 .

[46]  H. Y. Meltzer Dimensions of Outcome with Clozapine , 1992, British Journal of Psychiatry.

[47]  M. Powers,et al.  Psychometric assessment of the Quality of Life Index. , 1992, Research in nursing & health.

[48]  Y. Lecrubier,et al.  Depressed Subjects Unwittingly Overreport Poor Social Adjustment Which They Reappraise When Recovered , 1991, The Journal of nervous and mental disease.

[49]  S. Mercer,et al.  Dressing for success. Promoting independence among cognitively impaired elderly. , 1991, Journal of psychosocial nursing and mental health services.

[50]  M. Birchwood,et al.  The Social Functioning Scale the Development and Validation of a New Scale of Social Adjustment for use in Family Intervention Programmes with Schizophrenic Patients , 1990, British Journal of Psychiatry.

[51]  Frank J. Landy,et al.  Stamp collecting versus science: Validation as hypothesis testing. , 1986 .

[52]  P. Johnson-Laird Mental models: towards a cognitive science of language, inference, and consciousness , 1986 .

[53]  T. Wykes,et al.  The Measurement of Social Behaviour in Psychiatric Patients: An Assessment of the Reliability and Validity of the SBS Schedule , 1986, British Journal of Psychiatry.

[54]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[55]  K. Ell Social Networks, Social Support, and Health Status: A Review , 1984, Social Service Review.

[56]  G. Serban,et al.  Relationship Between Cognitive Defect, Affect Response and Community Adjustment in Chronic Schizophrenics , 1979, British Journal of Psychiatry.

[57]  M. Hersen,et al.  Role-play tests for assessing social skills: Are they valid? , 1978 .

[58]  W T Carpenter,et al.  The prediction of outcome in schizophrenia. I. Characteristics of outcome. , 1972, Archives of general psychiatry.

[59]  J. Overall,et al.  The Brief Psychiatric Rating Scale , 1962 .

[60]  S. Wright The Method of Path Coefficients , 1934 .

[61]  Michael F. Green,et al.  A summary of the FDA-NIMH-MATRICS workshop on clinical trial design for neurocognitive drugs for schizophrenia. , 2005, Schizophrenia bulletin.

[62]  R. Heslegrave,et al.  A conceptual model of quality of life in schizophrenia: Description and preliminary clinical validation , 2004, Quality of Life Research.

[63]  S. Frangou,et al.  Which executive skills should we target to affect social functioning and symptom change? A study of a cognitive remediation therapy program. , 2004, Schizophrenia bulletin.

[64]  P. Czobor,et al.  The multidimensional scale of independent functioning: a new instrument for measuring functional disability in psychiatric populations. , 2003, Schizophrenia bulletin.

[65]  P Arns,et al.  The IAPSRS toolkit: development, utility, and relation to other performance measurement systems. Members of the IAPSRS Research Committee. International Association of Psychological Rehabilitation Services. , 2001, Psychiatric rehabilitation journal.

[66]  D. Braff,et al.  Neurocognitive deficits and functional outcome in schizophrenia: are we measuring the "right stuff"? , 2000, Schizophrenia bulletin.

[67]  J. Long,et al.  Community-based psychosocial rehabilitation and prospective change in functional, clinical, and subjective experience variables in schizophrenia. , 2000, Schizophrenia bulletin.

[68]  E. Hamera,et al.  Developing a context-based performance measure for persons with schizophrenia: the test of grocery shopping skills. , 2000, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[69]  W. Spaulding,et al.  Effects of cognitive treatment in psychiatric rehabilitation. , 1999, Schizophrenia bulletin.

[70]  K. Mueser,et al.  Social skills and social functioning. , 1998 .

[71]  M. Atkinson,et al.  Characterizing quality of life among patients with chronic mental illness: a critical examination of the self-report methodology. , 1997, The American journal of psychiatry.

[72]  Philip D. Harvey,et al.  Social-Adaptive Functioning Evaluation (SAFE): a rating scale for geriatric psychiatric patients. , 1997, Schizophrenia bulletin.

[73]  J. Jonikas,et al.  Outcomes of psychiatric rehabilitation service delivery. , 1996, New directions for mental health services.

[74]  D. Loewenstein,et al.  Neuropsychological test performance and prediction of functional capacities among Spanish-speaking and English-speaking patients with dementia. , 1995, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[75]  J. Endicott,et al.  Quality of Life Enjoyment and Satisfaction Questionnaire: a new measure. , 1993, Psychopharmacology bulletin.

[76]  E. Diener,et al.  The affective and cognitive context of self-reported measures of subjective well-being , 1993 .

[77]  P. Solomon,et al.  Psychiatric Rehabilitation in Practice , 1993 .

[78]  R. Liberman Handbook of psychiatric rehabilitation , 1992 .

[79]  Ware J.E.Jr.,et al.  THE MOS 36- ITEM SHORT FORM HEALTH SURVEY (SF- 36) CONCEPTUAL FRAMEWORK AND ITEM SELECTION , 1992 .

[80]  Peter M. Bentler,et al.  EQS : structural equations program manual , 1989 .

[81]  R. Linn Educational measurement, 3rd ed. , 1989 .

[82]  R. Baker,et al.  REHAB: a new assessment instrument for chronic psychiatric patients. , 1988, Schizophrenia bulletin.

[83]  Roger C. Schank,et al.  SCRIPTS, PLANS, GOALS, AND UNDERSTANDING , 1988 .

[84]  A. Lehman,et al.  A Quality of Life Interview for the chronically mentally ill. , 1988 .

[85]  B. Bolton Handbook of measurement and evaluation in rehabilitation , 1987 .

[86]  A. Bellack Recurrent problems in the behavioral assessment of social skill , 1983 .

[87]  V. Leirer,et al.  Development and validation of a geriatric depression screening scale: a preliminary report. , 1982, Journal of psychiatric research.

[88]  L. J. Chapman,et al.  The measurement of differential deficit. , 1978, Journal of psychiatric research.

[89]  John Cotton,et al.  Handbook of measurement and evaluation in rehabilitation. , 1978 .

[90]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.