Assessment Methods for Patient-Reported Outcomes

The methods used to collect information on patient-reported outcomes (PROs) can affect the validity, reliability and sensitivity of the data. This review examines the influence of a variety of methodological issues that occur. In particular, when patients are asked to rely on their memory to aggregate and summarize their experience, a variety of inaccuracies and biases can affect the data. As the extent and magnitude of recall bias have become more well-known, researchers have increasingly turned toward collecting data in the field, closer in time to events and experiences of interest. Diary methods require patients to self-monitor their experiences, disease episodes and healthcare utilization over time. The collection of diary data from patients places a premium on adherence to the data collection protocol. Recent evidence suggests that patients routinely fail to adhere to diary protocols, thus introducing retrospective error and biases into the data. Reasons for patients’ non-adherence to data collection protocols include their desire to appear to be ‘good’ patients which can result in back-filling PRO entries before a site visit, simply forgetting, and data collection methods that fail to help patients be adherent to the data collection protocol. Principles that can be used to enhance patient adherence to PRO data collection methods include good patient training, creating simple and intuitive user interfaces for PRO assessments, and actively driving the protocol by helping patients remember to complete PRO measures as required by the protocol.

[1]  A. Beck,et al.  An inventory for measuring depression. , 1961, Archives of general psychiatry.

[2]  R. Nelson Assessment and Therapeutic Functions of Self-Monitoring , 1977 .

[3]  J. Teasdale,et al.  Differential effects of induced mood on retrieval of pleasant and unpleasant events from episodic memory. , 1979, Journal of abnormal psychology.

[4]  J. Teasdale,et al.  Diurnal variation in clinical depression and accessibility of memories of positive and negative experiences , 1982 .

[5]  D. Streiner,et al.  Health Diaries: Strategies for Compliance and Relation to Other Measures , 1982, Medical care.

[6]  E. Singer,et al.  Informed consent procedures in telephone interviews. , 1982, American sociological review.

[7]  D. Lucido,et al.  Reliability of blood glucose monitoring by patients with diabetes mellitus. , 1984, The American journal of medicine.

[8]  John L. Reeves,et al.  Memory for pain: Relation between past and present pain intensity , 1985, Pain.

[9]  J. Teasdale,et al.  Constraints on the Effects of Mood on Memory , 1985 .

[10]  W. Wagenaar My memory: A study of autobiographical memory over six years , 1986, Cognitive Psychology.

[11]  S. Spector,et al.  Compliance of patients with asthma with an experimental aerosolized medication: implications for controlled clinical trials. , 1986, The Journal of allergy and clinical immunology.

[12]  L. Rips,et al.  Answering autobiographical questions: the impact of memory and inference on surveys. , 1987, Science.

[13]  R. Neugebauer Reliability of seizure diaries in adult epileptic patients. , 1989, Neuroepidemiology.

[14]  S. Kutcher,et al.  Live events and mania: A case-controlled study , 1989, Psychiatry Research.

[15]  B. Spilker Quality of life assessments in clinical trials , 1990 .

[16]  R. C. Sinclair,et al.  The Effect of Completing the Beck Depression Inventory on Self-Reported Mood State: Contrast and Assimilation , 1991 .

[17]  J. R. Erickson,et al.  Relations among measures of autobiographical memory , 1991 .

[18]  S. Linton Memory for Chronic Pain Intensity: Correlates of Accuracy , 1991, Perceptual and motor skills.

[19]  Effects of researcher follow-up of distressed subjects: tradeoff between validity and ethical responsibility. , 1991, Ethics & behavior.

[20]  Patient Compliance--Don't Count on It! , 1993 .

[21]  G. Cumming,et al.  The comparative analgesic efficacy of transcutaneous electrical nerve stimulation and a non-steroidal anti-inflammatory drug for painful osteoarthritis. , 1994, British journal of rheumatology.

[22]  Seymour Sudman,et al.  Autobiographical memory and the validity of retrospective reports , 1994 .

[23]  S. Shiffman,et al.  Ecological Momentary Assessment (Ema) in Behavioral Medicine , 1994 .

[24]  Gary E. Swan,et al.  The Effects of Estimation Strategies on the Accuracy of Respondents’ Reports of Cigarette Smoking , 1994 .

[25]  John Urquhart,et al.  Role of Patient Compliance in Clinical Pharmacokinetics , 1994 .

[26]  T M Gill,et al.  A critical appraisal of the quality of quality-of-life measurements. , 1994, JAMA.

[27]  O. Nived,et al.  A comparison of 6 months' compliance of patients with rheumatoid arthritis treated with tenoxicam and naproxen. Use of patient computer data to assess response to treatment. , 1994, The Journal of rheumatology.

[28]  F. Chmelik,et al.  Objective measurements of compliance in asthma treatment. , 1994, Annals of allergy.

[29]  J. Malo,et al.  Compliance with and accuracy of daily self-assessment of peak expiratory flows (PEF) in asthmatic subjects over a three month period. , 1996, The European respiratory journal.

[30]  S. Shiffman,et al.  First lapses to smoking: within-subjects analysis of real-time reports. , 1996, Journal of consulting and clinical psychology.

[31]  C. Rand,et al.  Noncompliance and treatment failure in children with asthma. , 1996, The Journal of allergy and clinical immunology.

[32]  D. Kahneman,et al.  Patients' memories of painful medical treatments: real-time and retrospective evaluations of two minimally invasive procedures , 1996, Pain.

[33]  Saul Shiffman,et al.  Remember that? A comparison of real-time versus retrospective recall of smoking lapses. , 1997, Journal of consulting and clinical psychology.

[34]  B. Tiplady,et al.  The Use of Electronic Diaries in Respiratory Studies , 1997 .

[35]  R. Straka,et al.  Patient Self‐Reporting of Compliance Does Not Correspond with Electronic Monitoring: An Evaluation Using Isosorbide Dinitrate as a Model Drug , 1997, Pharmacotherapy.

[36]  T. Kamarck,et al.  Effects of task strain, social conflict, and emotional activation on ambulatory cardiovascular activity: daily life consequences of recurring stress in a multiethnic adult sample. , 1998, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[37]  J Urquhart,et al.  Contending paradigms for the interpretation of data on patient compliance with therapeutic drug regimens. , 1998, Statistics in medicine.

[38]  H. Göbel,et al.  Effect of Operationalized Computer Diagnosis on the Therapeutic Results of Sumatriptan in General Practice , 1998, Cephalalgia : an international journal of headache.

[39]  P. Boudes,et al.  Drug compliance in therapeutic trials: a review. , 1998, Controlled clinical trials.

[40]  S. Shiffman,et al.  A comparison of coping assessed by ecological momentary assessment and retrospective recall. , 1998, Journal of personality and social psychology.

[41]  S. Shiffman,et al.  Introduction to the special section: Ecological momentary assessment in health psychology. , 1998 .

[42]  D E Bloom,et al.  Technology, Experimentation, and the Quality of Survey Data , 1998, Science.

[43]  J. Flory,et al.  What are quality of life measurements measuring? , 1998, BMJ.

[44]  S. M. Rogers,et al.  Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. , 1998, Science.

[45]  Eric Yorkston,et al.  The Use of Memory and Contextual Cues in the Formation of Behavioral Frequency Judgments , 1999 .

[46]  Roger Tourangeau,et al.  Remembering What Happened: Memory Errors and Survey Reports , 1999 .

[47]  K. Carlsen,et al.  Patient compliance in a clinical trial with inhaled budesonide in children with mild asthma. , 1999, The European respiratory journal.

[48]  Donald N. Bersoff,et al.  Ethical Issues in the Collection of Self-Report Data , 1999 .

[49]  M. Sprangers,et al.  Innovations and dilemmas in psychosocial oncology. Contributions from the 10th conference of the European Society for Psychosocial Oncology. , 1999, Acta oncologica.

[50]  M. Sprangers,et al.  Revealing response shift in longitudinal research on fatigue--the use of the thentest approach. , 1999, Acta oncologica.

[51]  J. Houpt,et al.  Effect of glucosamine hydrochloride in the treatment of pain of osteoarthritis of the knee. , 1999, The Journal of rheumatology.

[52]  G. Mancia,et al.  Blood Pressure Monitoring. Task force V: White-coat hypertension. , 1999, Blood pressure monitoring.

[53]  G. Mancia,et al.  Task force V: White-coat hypertension , 1999 .

[54]  A. Stone,et al.  The science of self-report. Implications for research and practice , 1999 .

[55]  Wendy Baldwin,et al.  Information No One Else Knows: The Value of Self-Report , 1999 .

[56]  Saul Shiffman,et al.  Real-time self-report of momentary states in the natural environment: Computerized ecological momentary assessment. , 2000 .

[57]  A. Stone,et al.  Does the peak-end phenomenon observed in laboratory pain studies apply to real-world pain in rheumatoid arthritics? , 2000, The journal of pain : official journal of the American Pain Society.

[58]  S Shiffman,et al.  Comparative efficacy of 24-hour and 16-hour transdermal nicotine patches for relief of morning craving. , 2000, Addiction.

[59]  Jef Raskin,et al.  The Humane Interface: New Directions for Designing Interactive Systems , 2000 .

[60]  C. Rand,et al.  Unpredictability of deception in compliance with physician-prescribed bronchodilator inhaler use in a clinical trial. , 2000, Chest.

[61]  R. Patterson Changing Patient Behavior: Improving Outcomes in Health and Disease Management , 2001 .

[62]  Letter From Mr. Patrick Marquis , 2001 .

[63]  Measuring up to the task. , 2001, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[64]  J. Fahrenberg,et al.  Progress in Ambulatory Assessment , 2001 .

[65]  S. Shiffman,et al.  Methodological issues affecting the value of patient-reported outcomes data , 2002, Expert review of pharmacoeconomics & outcomes research.

[66]  S. Shiffman,et al.  Patient non-compliance with paper diaries , 2002, BMJ : British Medical Journal.

[67]  H. Drummond,et al.  Electronic quality of life questionnaires: a comparison of pen-based electronic questionnaires with conventional paper in a gastrointestinal study , 1995, Quality of Life Research.

[68]  Gopal H. Badlani,et al.  “Compu-void II”: The computerized voiding diary , 1996, Journal of Medical Systems.