Content validity in the PROMIS social-health domain: a qualitative analysis of focus-group data

PurposeOur aim was to assess the content validity of the Patient-Reported Outcomes Measurement Information System (PROMIS) social health item banks by comparing a prespecified conceptual model with concepts that focus-group participants identified as important social-health-related outcomes. These data will inform the process of improving health-related quality-of-life measures.MethodsTwenty-five patients with a range of social limitations due to chronic health conditions were recruited at two sites; four focus groups were conducted. Raters independently classified participants’ statements using a hierarchical, nested schema that included health-related outcomes, role performance, role satisfaction, family/friends, work, and leisure.ResultsKey themes that emerged were fulfilling both family and work responsibilities and the distinction between activities done out of responsibility versus enjoyment. Although focus-group participants identified volunteerism and pet ownership as important social-health-related concepts, these were not in our original conceptual model. The concept of satisfaction was often found to overlap with the concept of performance.ConclusionOur conceptual model appears comprehensive but is being further refined to more appropriately (a) distinguish between responsibilities versus discretionary activities, and (b) situate the outcome of satisfaction as it relates to impairment in social and other domains of health.

[1]  D. Morgan Successful Focus Groups: Advancing the State of the Art , 1993 .

[2]  C. Dolea,et al.  World Health Organization , 1949, International Organization.

[3]  M. Weissman,et al.  Assessment of social adjustment by patient self-report. , 1976, Archives of general psychiatry.

[4]  S. Syme,et al.  Issues in the study and application of social support. , 1985 .

[5]  I. McDowell,et al.  Measuring health: A guide to rating scales and questionnaires, 3rd ed. , 2006 .

[6]  Margaret Volante Qualitative research. , 2008, Nurse researcher.

[7]  M. Birchwood,et al.  programmes with schizophrenic patients. new scale of social adjustment for use in family intervention The Social Functioning Scale. The development and validation of a , 2022 .

[8]  David Stewart,et al.  Focus groups: Theory and practice, 2nd ed. , 2007 .

[9]  L. Horowitz,et al.  Inventory of interpersonal problems: psychometric properties and clinical applications. , 1988, Journal of consulting and clinical psychology.

[10]  K. B. Hafner,et al.  On assessing interrater agreement for multiple attribute responses. , 1989, Biometrics.

[11]  R. Gorden Basic Interviewing Skills , 1992 .

[12]  Nan Rothrock,et al.  Evaluation of Item Candidates: The PROMIS Qualitative Item Review , 2007, Medical care.

[13]  Clemens Heitzinger,et al.  Scientific Software Development , 2005 .

[14]  D. Morgan Focus groups for qualitative research. , 1988, Hospital guest relations report.

[15]  D. Bender,et al.  The focus group as a tool for health research: issues in design and analysis. , 1994, Health transition review : the cultural, social, and behavioural determinants of health.

[16]  N. Dalkey,et al.  An Experimental Application of the Delphi Method to the Use of Experts , 1963 .

[17]  M. Dijkers,et al.  Measures of social outcomes in disability research. , 2000, Archives of physical medicine and rehabilitation.

[18]  Serafino Buono,et al.  ICF- INTERNATIONAL CLASSIFICATION OF FUNCTIONING, DISABILITY AND HEALTH , 2003 .

[19]  Robert L. Leahy,et al.  The Use of Psychological Testing for Treatment Planning and Outcome Assessment , 2000, Journal of Cognitive Psychotherapy.

[20]  Ron D Hays,et al.  What is sufficient evidence for the reliability and validity of patient-reported outcome measures? , 2007, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[21]  James W. Carey,et al.  Intercoder Agreement in Analysis of Responses to Open-Ended Interview Questions: Examples from Tuberculosis Research , 1996 .

[22]  T. Bedirhan Üstün,et al.  Disability and culture : universalism and diversity , 2001 .

[23]  J. Kitzinger,et al.  Qualitative Research: Introducing focus groups , 1995 .

[24]  J. Tomaka,et al.  Pet Ownership Predicts Adherence to Cardiovascular Rehabilitation1 , 2002 .

[25]  Janet Mancini Billson,et al.  Focus Groups: A Practical Guide for Applied Research , 1989 .

[26]  S. Syme,et al.  Social support and health. , 1986 .

[27]  E. Curtis,et al.  Focus groups in nursing research. , 2007, Nurse researcher.

[28]  P. Liamputtong Qualitative Research Methods , 2005 .

[29]  David J Weiss,et al.  Psychometric Evaluation and Calibration of Health-Related Quality of Life Item Banks: Plans for the Patient-Reported Outcomes Measurement Information System (PROMIS) , 2007, Medical care.

[30]  J. Fries,et al.  The Patient-Reported Outcomes Measurement Information System (PROMIS): Progress of an NIH Roadmap Cooperative Group During its First Two Years , 2007, Medical care.

[31]  Richard A. Krueger,et al.  Focus groups : a practical guide for applied research / by Richard A. Krueger , 1989 .

[32]  Edward F. McQuarrie,et al.  Focus Groups: Theory and Practice , 1991 .