Accuracy of Patient Self-Report of Stroke: A Systematic Review from the UK Biobank Stroke Outcomes Group

Objective We performed a systematic review of the accuracy of patient self-report of stroke to inform approaches to ascertaining and confirming stroke cases in large prospective studies. Methods We sought studies comparing patient self-report against a reference standard for stroke. We extracted data on survey method(s), response rates, participant characteristics, the reference standard used, and the positive predictive value (PPV) of self-report. Where possible we also calculated sensitivity, specificity, negative predictive value (NPV), and stroke prevalence. Study-level risk of bias was assessed using the Quality Assessment of Diagnostic Studies tool (QUADAS-2). Results From >1500 identified articles, we included 17 studies. Most asked patients to report a lifetime history of stroke but a few limited recall time to ≤5 years. Some included questions for transient ischaemic attack (TIA) or stroke synonyms. No study was free of risk of bias in the QUADAS-2 assessment, the most frequent causes of bias being incomplete reference standard data, absence of blinding of adjudicators to self-report status, and participant response rates (<80%). PPV of self-report ranged from 22–87% (17 studies), sensitivity from 36–98% (10 studies), specificity from 96–99.6% (10 studies), and NPV from 88.2–99.9% (10 studies). PPV increased with stroke prevalence as expected. Among six studies with available relevant data, if confirmed TIAs were considered to be true rather than false positive strokes, PPV of self-report was >75% in all but one study. It was not possible to assess the influence of recall time or of the question(s) asked on PPV or sensitivity. Conclusions Characteristics of the study population strongly influence self-report accuracy. In population-based studies with low stroke prevalence, a large proportion of self-reported strokes may be false positives. Self-report is therefore unlikely to be helpful for identifying cases without subsequent confirmation, but may be useful for case ascertainment in combination with other data sources.

[1]  R. Doughty,et al.  Agreement between self-reports and medical records of cardiovascular disease in octogenarians. , 2013, Journal of clinical epidemiology.

[2]  A. Hofman,et al.  The healthy volunteer effect and coronary risk prediction in the general population: the Rotterdam study , 2013 .

[3]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. The Cochrane Collaboration , 2013 .

[4]  Patrick M. M. Bossuyt,et al.  Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy , 2013 .

[5]  E. Brunner,et al.  Validating self-reported strokes in a longitudinal UK cohort study (Whitehall II): Extracting information from hospital medical records versus the Hospital Episode Statistics database , 2012, BMC Medical Research Methodology.

[6]  C. González,et al.  Validity of self-reported prevalent cases of stroke and acute myocardial infarction in the Spanish cohort of the EPIC study , 2012, Journal of Epidemiology & Community Health.

[7]  R. Collins What makes UK Biobank special? , 2012, The Lancet.

[8]  Susan Mallett,et al.  QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies , 2011, Annals of Internal Medicine.

[9]  K. Nakashima,et al.  [The Rotterdam study]. , 2011, Nihon rinsho. Japanese journal of clinical medicine.

[10]  V. Hachinski,et al.  Is Stroke History Reliably Reported by Elderly with Cognitive Impairment? A Community-Based Study , 2010, Neuroepidemiology.

[11]  S. Yusuf,et al.  Risk factors for ischaemic and intracerebral haemorrhagic stroke in 22 countries (the INTERSTROKE study): a case-control study , 2010, The Lancet.

[12]  A. Pariente,et al.  Concordance between prescriber‐ and patient‐reported previous medical history and NSAID indication in the CADEUS cohort , 2010, Pharmacoepidemiology and drug safety.

[13]  C. Sudlow,et al.  Differing Risk Factor Profiles of Ischemic Stroke Subtypes: Evidence for a Distinct Lacunar Arteriopathy? , 2010, Stroke.

[14]  M. Inoue,et al.  Self-reported stroke and myocardial infarction had adequate sensitivity in a population-based prospective study JPHC (Japan Public Health Center)-based Prospective Study. , 2009, Journal of clinical epidemiology.

[15]  J. Shaw,et al.  Validity of self‐reported cardiovascular disease events in comparison to medical record adjudication and a statewide hospital morbidity database: the AusDiab study , 2009, Internal medicine journal.

[16]  J. Sterne,et al.  Systematic reviews of test accuracy should search a range of databases to identify primary studies. , 2008, Journal of clinical epidemiology.

[17]  Muin J. Khoury,et al.  Quantifying realistic sample size requirements for human genome epidemiology , 2008 .

[18]  J. Wardlaw,et al.  Early signs of brain infarction at CT: observer reliability and outcome after thrombolytic treatment--systematic review. , 2005, Radiology.

[19]  C. Kooperberg,et al.  Comparison of self-report, hospital discharge codes, and adjudication of cardiovascular events in the Women's Health Initiative. , 2004, American journal of epidemiology.

[20]  Douglas W Mahoney,et al.  Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure. , 2004, Journal of clinical epidemiology.

[21]  L. Fried,et al.  Agreement Between Self‐Report of Disease Diagnoses and Medical Record Validation in Disabled Older Women: Factors That Modify Agreement , 2004, Journal of the American Geriatrics Society.

[22]  A. Toniato,et al.  Transient ischemic attack--proposed new definition. , 2003, The New England journal of medicine.

[23]  J. Mohr,et al.  Transient ischemic attack--proposal for a new definition. , 2002, The New England journal of medicine.

[24]  W. Hacke,et al.  CT and Diffusion-Weighted MR Imaging in Randomized Order: Diffusion-Weighted Imaging Results in Higher Accuracy and Lower Interrater Variability in the Diagnosis of Hyperacute Ischemic Stroke , 2002, Stroke.

[25]  L. Brown,et al.  Interval Estimation for a Binomial Proportion , 2001 .

[26]  M. Viitanen,et al.  Validity of self-reported stroke : The Tromso Study. , 2000, Stroke.

[27]  A. G. Shaper,et al.  Validation of patient recall of doctor-diagnosed heart attack and stroke: a postal questionnaire and record review comparison. , 1998, American journal of epidemiology.

[28]  M M Bergmann,et al.  Validity of self-reported diagnoses leading to hospitalization: a comparison of self-reports with hospital records in a prospective study of American adults. , 1998, American journal of epidemiology.

[29]  B. Penninx,et al.  Self-reports and general practitioner information on the presence of chronic diseases in community dwelling elderly. A study on the accuracy of patients' self-reports and on determinants of inaccuracy. , 1996, Journal of clinical epidemiology.

[30]  J. Ferro,et al.  Diagnosis of transient ischemic attack by the nonneurologist. A validation study. , 1996, Stroke.

[31]  A. Hoes,et al.  Prevalence of stroke in the general population. The Rotterdam Study. , 1996, Stroke.

[32]  C. Sudlow,et al.  Comparing stroke incidence worldwide: what makes studies comparable? , 1996, Stroke.

[33]  R. Thomson,et al.  Validation of a population screening questionnaire to assess prevalence of stroke. , 1995, Stroke.

[34]  A. Paganini-Hill,et al.  Accuracy of recall of hip fracture, heart attack, and cancer: a comparison of postal survey data and medical records. , 1993, American journal of epidemiology.

[35]  O H Førde,et al.  The Tromsø Study. Distribution and population determinants of gamma-glutamyltransferase. , 1990, American journal of epidemiology.

[36]  S. Harlow,et al.  Agreement between questionnaire data and medical records. The evidence for accuracy of recall. , 1989, American journal of epidemiology.

[37]  W. Willett,et al.  Validation of questionnaire information on risk factors and disease outcomes in a prospective cohort study of women. , 1986, American journal of epidemiology.

[38]  S. Hatano,et al.  Experience from a multicentre stroke register: a preliminary report. , 1976, Bulletin of the World Health Organization.