Health outcomes assessment in vulnerable populations: measurement challenges and recommendations.

With growing recognition that some population subgroups are particularly vulnerable to receiving suboptimal health care and achieving poor health outcomes, innovative techniques are required for collecting and evaluating health outcomes data. Research is also needed to better understand the causal pathways linking vulnerability with health outcomes. This article focuses on patients with a chronic illness (cancer) who also have low literacy and/or poor English language skills. We summarize the association among literacy, language, ethnicity, and health outcomes; describe innovative technologies to enhance communication; and discuss the advantages of using psychometric measurement models in health outcomes assessment. Results from our ongoing research projects are presented, including the development of an audiovisual computer-based testing platform for self-administration of questionnaires. Such innovative multimedia technologies allow patients with limited or even no reading ability to participate in outcomes assessment and have the potential to be incorporated into a clinical setting with minimal burden on staff and patients. Appropriate methods are also needed to evaluate measurement equivalence across diverse patient groups, that is, the extent to which items in a questionnaire perform similarly across groups. Item response theory measurement models provide a strategy for differentiating between measurement bias and real differences that may exist between groups. Recommendations for clinical practice and research are offered specifically to address medically underserved and vulnerable populations.

[1]  Jack D. Burke,et al.  Test-retest reliability in psychiatric patients of the sf-36 health survey , 1996 .

[2]  R. Hambleton,et al.  Handbook of Modern Item Response Theory , 1997 .

[3]  G. Masters,et al.  Rating Scale Analysis. Rasch Measurement. , 1983 .

[4]  D. Baker,et al.  Methodological problems in comparing English-speaking and Spanish-speaking patients' satisfaction with interpersonal aspects of care. , 1998, Medical care.

[5]  A. Tarlov Shattuck lecture--the increasing supply of physicians, the changing structure of the health-services system, and the future practice of medicine. , 1983, Journal of the Mississippi State Medical Association.

[6]  R. Hayward,et al.  Can patients use an automated questionnaire to define their current health status? , 1992, Medical care.

[7]  I. Thompson,et al.  Association of African-American ethnic background with survival in men with metastatic prostate cancer. , 2001, Journal of the National Cancer Institute.

[8]  Richard M. Smith A Comparison of the Rasch Separate Calibration and between-Fit Methods of Detecting Item Bias , 1996 .

[9]  D. Cella,et al.  Data collection strategies for patient-reported information. , 1994, Quality management in health care.

[10]  L M Kirk,et al.  Patient education pamphlets about prevention, detection, and treatment of breast cancer for low literacy women. , 1996, Patient education and counseling.

[11]  D. Baker Reading between the lines , 1999 .

[12]  D W Baker,et al.  The relationship of patient reading ability to self-reported health and use of health services. , 1997, American journal of public health.

[13]  C. Feied,et al.  Functional illiteracy among emergency department patients: a preliminary study. , 1993, Annals of emergency medicine.

[14]  Polednak Ap Reported pap test use by Hispanic women in Connecticut and Long Island. , 1996 .

[15]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .

[16]  M. Swanston,et al.  Pain assessment with interactive computer animation , 1993, Pain.

[17]  D. Tulsky,et al.  The Functional Assessment of Cancer Therapy scale: development and validation of the general measure. , 1993, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[18]  F. Hodge,et al.  Achieving cultural competency and responsive health care delivery , 1998 .

[19]  Ellwood Pm,et al.  Shattuck Lecture--outcomes management. A technology of patient experience. 1988. , 1997, Archives of pathology & laboratory medicine.

[20]  R A Stephenson,et al.  Racial and ethnic differences in advanced-stage prostate cancer: the Prostate Cancer Outcomes Study. , 2001, Journal of the National Cancer Institute.

[21]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[22]  K. Derose,et al.  Limited English Proficiency and Latinos’ Use of Physician Services , 2000, Medical care research and review : MCRR.

[23]  P. Thoits,et al.  The impact of culture on the cognitive structure of illness , 1987, Culture, medicine and psychiatry.

[24]  D. Cella,et al.  Quality of Life: The Concept , 1992, Journal of palliative care.

[25]  D H Gustafson,et al.  Introduction to evaluation of interactive health communication applications. Science Panel on Interactive Communication and Health. , 1999, American journal of preventive medicine.

[26]  Daniel L. McGee,et al.  Health Status Of Illiterate Adults: Relation Between Literacy And Health Status Among Persons With Low Literacy Skills , 1992, The Journal of the American Board of Family Medicine.

[27]  K. Fiscella,et al.  Inequality in quality: addressing socioeconomic, racial, and ethnic disparities in health care. , 2000, JAMA.

[28]  L G Kessler,et al.  Cervical cancer screening: who is not screened and why? , 1991, American journal of public health.

[29]  David Cella,et al.  Cross-cultural instrument equating: Current research and future directions , 1996 .

[30]  R. Hambleton,et al.  Fundamentals of Item Response Theory , 1991 .

[31]  F. Porzsolt,et al.  Practical aspects of quality-of-life measurement: design and feasibility study of the quality-of-life recorder and the standardized measurement of quality of life in an outpatient clinic. , 1996, Cancer treatment reviews.

[32]  Jersey Liang Assessing cross-cultural comparability in mental health among older adults , 2001 .

[33]  RON D. HAYS,et al.  Item Response Theory and Health Outcomes Measurement in the 21st Century , 2000, Medical care.

[34]  L. Carlson,et al.  Impact of computerized quality of life screening on physician behaviour and patient satisfaction in lung cancer outpatients , 2000, Psycho-oncology.

[35]  M S Swanson,et al.  Influence of socioeconomic and cultural factors on racial differences in late-stage presentation of breast cancer. , 1998, JAMA.

[36]  Anastasia E. Raczek,et al.  Comparison of Rasch and summated rating scales constructed from SF-36 physical functioning items in seven countries: results from the IQOLA Project. International Quality of Life Assessment. , 1998, Journal of clinical epidemiology.

[37]  M. Mendez,et al.  Computer-assisted self-interviewing: a multimedia approach to dietary assessment. , 1997, The American journal of clinical nutrition.

[38]  J E Ware,et al.  The status of health assessment 1994. , 1995, Annual review of public health.

[39]  C. McHorney,et al.  Evaluation of the MOS SF-36 physical functioning scale (PF-10): I. Unidimensionality and reproducibility of the Rasch item scale. , 1994, Journal of clinical epidemiology.

[40]  L. Kleinman,et al.  User Preferences for Computer Administration of Quality of Life Instruments , 2000 .

[41]  B. Kirkman-Liff,et al.  Language of interview: relevance for research of southwest Hispanics. , 1991, American journal of public health.

[42]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[43]  C. Bennett,et al.  Relation between literacy, race, and stage of presentation among low-income patients with prostate cancer. , 1998, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[44]  F. Samejima Estimation of latent ability using a response pattern of graded scores , 1968 .

[45]  D. Cella,et al.  Response to Hays et al and McHorney and Cohen: A Discussion of Item Response Theory and Its Applications in Health Status Assessment , 2000, Medical care.

[46]  S. Schroeder Outcome assessment 70 years later: are we ready? , 1987, The New England journal of medicine.

[47]  B. Wright,et al.  Best Test Design. Rasch Measurement. , 1979 .

[48]  D. Cella,et al.  Spanish language translation and initial validation of the functional assessment of cancer therapy quality-of-life instrument. , 1998, Medical care.

[49]  Nina S. Parikh,et al.  Shame and health literacy: the unspoken connection. , 1996, Patient education and counseling.

[50]  John Stewart,et al.  Are touchscreen computer surveys acceptable to medical oncology patients , 1997 .

[51]  Barry D. Weiss,et al.  Communicating with patients who have limited literacy skills. Report of the National Work Group on Literacy and Health. , 1998, The Journal of family practice.

[52]  S. M. Rogers,et al.  Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. , 1998, Science.

[53]  D. Forman,et al.  Automated collection of quality-of-life data: a comparison of paper and computer touch-screen questionnaires. , 1999, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[54]  Mark V. Williams,et al.  Relationship of functional health literacy to patients' knowledge of their chronic disease. A study of patients with hypertension and diabetes. , 1998, Archives of internal medicine.

[55]  Gordon Guyatt,et al.  Measuring Health-Related Quality of Life , 1993, Annals of Internal Medicine.

[56]  B. Weiss,et al.  Literacy skills and communication methods of low-income older persons. , 1995, Patient education and counseling.

[57]  Nina S. Parikh,et al.  The health care experience of patients with low literacy. , 1996, Archives of family medicine.

[58]  R. Kington,et al.  Health Status Measurement Performance and Health Status Differences by Age, Ethnicity, and Gender: Assessment in the Medical Outcomes Study , 2000, Journal of health care for the poor and underserved.

[59]  H. Egeth,et al.  Using pictographs to enhance recall of spoken medical instructions II. , 1998, Patient education and counseling.

[60]  S. Haley,et al.  A Hierarchical Model of Functional Performance in Rehabilitation Medicine , 1992 .

[61]  J. Samet,et al.  Breast cancer among Hispanics, American Indians and non-Hispanic whites in New Mexico. , 1994, International journal of epidemiology.

[62]  Charles F Turner,et al.  AUDIO AND VIDEO COMPUTER-ASSISTED SELF INTERVIEWING: Preliminary Tests of New Technologies for Data Collection. , 1994, Journal of official statistics.

[63]  Rachael Robinson,et al.  A comparison of computer and questionnaire methods of history-taking in a genito-urinary clinic , 1992 .

[64]  B. Smedley,et al.  The unequal burden of cancer : an assessment of NIH research and programs for ethnic minorities and the medically underserved , 1999 .

[65]  L. Lenert,et al.  Computer-assisted quality of life assessment for clinical trials. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[66]  D. Andrich A rating formulation for ordered response categories , 1978 .

[67]  Nina S. Parikh,et al.  Inadequate functional health literacy among patients at two public hospitals. , 1995, JAMA.

[68]  G. Marks,et al.  Acculturation, access to care, and use of preventive services by Hispanics: findings from HHANES 1982-84. , 1990, American journal of public health.

[69]  J. Dollahite,et al.  Readability of printed sources of diet and health information. , 1996, Patient education and counseling.

[70]  A. N. Brand,et al.  A comparison of the standard and the computerized versions of the Well-being Questionnaire (WBQ) and the Diabetes Treatment Satisfaction Questionnaire (DTSQ) , 1998, Quality of Life Research.

[71]  D. Osoba,et al.  Patients' experiences using a computerized program with a touch-sensitive video monitor for the assessment of health-related quality of life. , 1998, Quality of Life Research.

[72]  C. Schur,et al.  Language, Sociodemographics, and Health Care Use of Hispanic Adults , 1996, Journal of health care for the poor and underserved.

[73]  D. Tulsky,et al.  Quality of life in cancer: definition, purpose, and method of measurement. , 1993, Cancer investigation.

[74]  D. Karras,et al.  Comprehension of discharge instructions by patients in an urban emergency department. , 1995, Annals of emergency medicine.