Quantitative signal detection using spontaneous ADR reporting

Quantitative methods are increasingly used to analyse spontaneous reports. We describe the core concepts behind the most common methods, the proportional reporting ratio (PRR), reporting odds ratio (ROR), information component (IC) and empirical Bayes geometric mean (EBGM). We discuss the role of Bayesian shrinkage in screening spontaneous reports, the importance of changes over time in screening the properties of the measures. Additionally we discuss three major areas of controversy and ongoing research: stratification, method evaluation and implementation. Finally we give some suggestions as to where emerging research is likely to lead. Copyright © 2009 John Wiley & Sons, Ltd.

[1]  W. Haenszel,et al.  Statistical aspects of the analysis of data from retrospective studies of disease. , 1959, Journal of the National Cancer Institute.

[2]  D. J. Finney,et al.  stematic Signalling of Adverse Reactions to Drugs , 1974, Methods of Information in Medicine.

[3]  A. Sampson,et al.  A statistical methodology for postmarketing surveillance of adverse drug reaction reports. , 1988, Statistics in medicine.

[4]  M D Rawlins,et al.  Spontaneous reporting of adverse drug reactions. II: Uses. , 1988, British journal of clinical pharmacology.

[5]  M. Lindquist,et al.  Quality criteria for early signals of possible adverse drug reactions , 1990, The Lancet.

[6]  I. Edwards,et al.  Tachycardia during cisapride treatment. , 1992, BMJ.

[7]  Tachycardia during cisapride treatment. , 1992, BMJ.

[8]  M. Praus,et al.  Alert systems for post-marketing surveillance of adverse drug reactions. , 1993, Statistics in medicine.

[9]  I R Edwards,et al.  Harmonisation in Pharmacovigilance , 1994, Drug safety.

[10]  I. Edwards,et al.  Impact and Credibility of the Who Adverse Reaction Signals , 1996 .

[11]  M. Lindquist,et al.  Risks of non-sedating antihistamines , 1997, The Lancet.

[12]  F. Haramburu,et al.  Reports of hypoglycaemia associated with the use of ACE inhibitors and other drugs: a case/non-case study in the French pharmacovigilance system database. , 2003, British journal of clinical pharmacology.

[13]  B. Bégaud,et al.  Under-reporting of adverse drug reactions Estimate based on a spontaneous reporting scheme and a sentinel system , 1998, European Journal of Clinical Pharmacology.

[14]  A. Bate,et al.  A Bayesian neural network method for adverse drug reaction signal generation , 1998, European Journal of Clinical Pharmacology.

[15]  William DuMouchel,et al.  Bayesian Data Mining in Large Frequency Tables, with an Application to the FDA Spontaneous Reporting System , 1999 .

[16]  Andrew Bate,et al.  From association to alert—a revised approach to international signal analysis , 1999, Pharmacoepidemiology and drug safety.

[17]  Patrick C. Waller,et al.  Responding to drug safety issues , 1999, Pharmacoepidemiology and drug safety.

[18]  M. Lindquist,et al.  A Retrospective Evaluation of a Data Mining Approach to Aid Finding New Adverse Drug Reaction Signals in the WHO International Database , 2000, Drug safety.

[19]  R. Meyboom,et al.  Anaphylactic Reactions to Proton-Pump Inhibitors , 2000, The Annals of pharmacotherapy.

[20]  A. Lansner,et al.  Bayesian neural networks with confidence estimations applied to data mining , 2000 .

[21]  Miki Yokotsuka,et al.  The use of a medical dictionary for regulatory activities terminology (MedDRA) in prescription-event monitoring in Japan (J-PEM) , 2000, Int. J. Medical Informatics.

[22]  A. Egberts,et al.  Detecting drug–drug interactions using a database for spontaneous adverse drug reactions: an example with diuretics and non-steroidal anti-inflammatory drugs , 2000, European Journal of Clinical Pharmacology.

[23]  S. Evans,et al.  Use of proportional reporting ratios (PRRs) for signal generation from spontaneous adverse drug reaction reports , 2001, Pharmacoepidemiology and drug safety.

[24]  D. Wysowski,et al.  Postmarketing reports of QT prolongation and ventricular arrhythmia in association with cisapride and food and drug administration regulatory actions , 2001, American Journal of Gastroenterology.

[25]  M. Braun,et al.  Data mining in the US Vaccine Adverse Event Reporting System (VAERS): early detection of intussusception and other events after rotavirus vaccination. , 2001, Vaccine.

[26]  M. Lindquist,et al.  Antipsychotic drugs and heart muscle disorder in international pharmacovigilance: data mining study , 2001, BMJ : British Medical Journal.

[27]  A. Egberts,et al.  Determinants of signal selection in a spontaneous reporting system for adverse drug reactions. , 2001, British journal of clinical pharmacology.

[28]  William DuMouchel,et al.  Empirical bayes screening for multi-item associations , 2001, KDD '01.

[29]  D J Graham,et al.  The role of databases in drug postmarketing surveillance , 2001, Pharmacoepidemiology and drug safety.

[30]  R. Bright,et al.  Automated support for pharmacovigilance: a proposed system , 2002, Pharmacoepidemiology and drug safety.

[31]  M. Lindquist,et al.  A comparison of measures of disproportionality for signal detection in spontaneous reporting systems for adverse drug reactions , 2002, Pharmacoepidemiology and drug safety.

[32]  P. Purcell,et al.  Statistical Techniques for Signal Generation , 2002, Drug safety.

[33]  Stephen Evans,et al.  Statistical Methods of Signal Detection , 2002 .

[34]  E. Brown,et al.  Effects of Coding Dictionary on Signal Generation , 2002, Drug safety.

[35]  M. Lindquist,et al.  Signal Selection and Follow-Up in Pharmacovigilance , 2002, Drug safety.

[36]  Emma Heeley,et al.  Automated Signal Generation in Prescription-Event Monitoring , 2002, Drug safety.

[37]  A. Bate,et al.  Data-mining analyses of pharmacovigilance signals in relation to relevant comparison drugs , 2002, European Journal of Clinical Pharmacology.

[38]  Peter G. M. van der Heijden,et al.  On the assessment of adverse drug reactions from spontaneous reporting systems: the influence of under-reporting on odds ratios , 2002 .

[39]  R. O’Neill,et al.  Use of Screening Algorithms and Computer Systems to Efficiently Signal Higher-Than-Expected Combinations of Drugs and Events in the US FDA’s Spontaneous Reports Database , 2002, Drug safety.

[40]  Patrick C Waller,et al.  A model for the future conduct of pharmacovigilance , 2003, Pharmacoepidemiology and drug safety.

[41]  M. Lindquist,et al.  Assessing the Impact of Drug Safety Signals from the WHO Database Presented in ‘SIGNAL’ , 2003, Drug safety.

[42]  P. Waller.  Dealing with uncertainty in drug safety: lessons for the future from sertindole , 2003, Pharmacoepidemiology and drug safety.

[43]  Violation of Homogeneity: A Methodologic Issue in the Use of Data Mining Tools , 2003, Drug safety.

[44]  Nicholas Moore,et al.  Biases affecting the proportional reporting ratio (PRR) in spontaneous reports pharmacovigilance databases: the example of sertindole , 2003, Pharmacoepidemiology and drug safety.

[45]  A Lawrence Gould,et al.  Practical pharmacovigilance analysis strategies. , 2003, Pharmacoepidemiology and drug safety.

[46]  M Lindquist,et al.  Introducing triage logic as a new strategy for the detection of signals in the WHO Drug Monitoring Database , 2004, Pharmacoepidemiology and drug safety.

[47]  K. Rothman,et al.  Measuring drug effects means getting a clearer signal , 2004 .

[48]  Stephanie Chung,et al.  Postmarketing surveillance of potentially fatal reactions to oncology drugs: potential utility of two signal-detection algorithms , 2004, European Journal of Clinical Pharmacology.

[49]  Robert T. Chen,et al.  A potential signal of Bell's palsy after parenteral inactivated influenza vaccines: reports to the Vaccine Adverse Event Reporting System (VAERS)—United States, 1991–2001 , , 2004, Pharmacoepidemiology and drug safety.

[50]  Manfred Hauben,et al.  Safety Related Drug-Labelling Changes , 2004, Drug safety.

[51]  Marie Lindquist,et al.  Data Quality Management in Pharmacovigilance , 2004, Drug safety.

[52]  Antoine Egberts,et al.  The reporting odds ratio versus the proportional reporting ratio: ‘deuce’ , 2004, Pharmacoepidemiology and Drug Safety.

[53]  Kenneth J Rothman,et al.  The reporting odds ratio and its advantages over the proportional reporting ratio , 2004, Pharmacoepidemiology and drug safety.

[54]  Immune Agranulocytosis and Clarithromycin , 2004, Hematology.

[55]  M. Hauben.  Application of an Empiric Bayesian Data Mining Algorithm to Reports of Pancreatitis Associated with Atypical Antipsychotics , 2004, Pharmacotherapy.

[56]  Robert Ball,et al.  Using simulation to assess the sensitivity and specificity of a signal detection tool for multidimensional public health surveillance data. , 2005, Statistics in medicine.

[57]  A. Venot,et al.  Appraisal of the MedDRA Conceptual Structure for Describing and Grouping Adverse Drug Reactions , 2005, Drug safety.

[58]  Frantz Thiessard,et al.  Evaluation of statistical association measures for the automatic signal generation in pharmacovigilance , 2005, IEEE Transactions on Information Technology in Biomedicine.

[59]  Stefan Arnborg,et al.  A bayesian recurrent neural network for unsupervised pattern recognition in large incomplete data sets , 2005, Int. J. Neural Syst..

[60]  Andrew Bate,et al.  Selective serotonin reuptake inhibitors in pregnant women and neonatal withdrawal syndrome: a database analysis , 2005, The Lancet.

[61]  L. Hazell,et al.  Under-Reporting of Adverse Drug Reactions , 2006, Drug safety.

[62]  A. Bate,et al.  Extending the methods used to screen the WHO drug safety database towards analysis of complex associations and improved accuracy for rare events , 2006, Statistics in medicine.

[63]  G. Niklas Norén,et al.  Duplicate detection in adverse drug reaction surveillance , 2007, Data Mining and Knowledge Discovery.

[64]  M. Kulldorff,et al.  Early detection of adverse drug events within population‐based health networks: application of sequential testing methods , 2007, Pharmacoepidemiology and drug safety.

[65]  Robert Ball,et al.  Effects of Stratification on Data Mining in the US Vaccine Adverse Event Reporting System (VAERS) , 2008, Drug safety.

[66]  Johan Hopstadius,et al.  Impact of Stratification on Adverse Drug Reaction Surveillance , 2008, Drug safety.

[67]  G. Niklas Norén,et al.  Temporal pattern discovery for trends and transient effects: its application to patient records , 2008, KDD.

[68]  Stephen J W Evans.  Stratification for Spontaneous Report Databases , 2008, Drug safety.

[69]  R. Sundberg,et al.  A statistical methodology for drug–drug interaction surveillance , 2008, Statistics in medicine.

[70]  Richard Platt,et al.  Early adverse drug event signal detection within population‐based health networks using sequential methods: key methodologic considerations , 2009, Pharmacoepidemiology and drug safety.