Data mining spontaneous adverse drug event reports for safety signals in Singapore – a comparison of three different disproportionality measures

ABSTRACT Objectives: Quantitative data mining methods can be used to identify potential signals of unexpected relationships between drug and adverse event (AE). This study aims to compare and explore the use of three data mining methods in our small spontaneous AE database. Methods: We consider reporting odds ratio (ROR), Bayesian Confidence Propagation Neural Network (BCPNN) and Gamma Poisson Shrinker (GPS) assuming two different sets of criteria: (1) ROR–1.96SE>1, IC–1.96SD>0, EB05>1 (2) ROR–1.96SE>2, IC–1.96SD>1, EB05 >2. Count of drug-AE pairs ≥3 was considered for ROR and GPS. Results: The Health Sciences Authority, Singapore received 151,180 AE reports between 1993 and 2013. ROR, BCPNN and GPS identified 2,835, 2,311 and 2,374 significant drug-AE pairs using Criterion 1, and 1,899, 1,101 and 1,358 respectively using Criterion 2. The performance of the three methods with respect to specificity, positive predictive value and negative predictive value were similar, although ROR yielded a higher sensitivity and larger area under the receiver operating characteristic curve. ROR and GPS picked up some potential signals which BCPNN missed. Conclusions: The defined threshold used for ROR (Criterion 1) is a useful screening tool for our small database. It may be used in conjunction with GPS to avoid missed signals.

[1]  R. Majdzadeh,et al.  Applying quantitative methods for detecting new drug safety signals in pharmacovigilance national database , 2007, Pharmacoepidemiology and drug safety.

[2]  N. Dakota..  Population Trends , 1936, Nature.

[3]  William DuMouchel,et al.  Bayesian Data Mining in Large Frequency Tables, with an Application to the FDA Spontaneous Reporting System , 1999 .

[4]  X. Ye,et al.  A computerized system for signal detection in spontaneous reporting system of Shanghai China , 2009, Pharmacoepidemiology and drug safety.

[5]  J. LaFountain.  Inc. , 2013, American Art.

[6]  I. Edwards,et al.  Adverse drug reactions: definitions, diagnosis, and management , 2000, The Lancet.

[7]  Daisuke Koide,et al.  Comparison of data mining methodologies using Japanese spontaneous reports , 2004, Pharmacoepidemiology and drug safety.

[8]  I. Edwards.  Who cares about pharmacovigilance? , 1997, European Journal of Clinical Pharmacology.

[9]  Stephanie J. Reisinger,et al.  Drug-versus-Drug Adverse Event Rate Comparisons , 2009, Drug safety.

[10]  M. Lindquist,et al.  A comparison of measures of disproportionality for signal detection in spontaneous reporting systems for adverse drug reactions , 2002, Pharmacoepidemiology and drug safety.

[11]  Johan Hopstadius,et al.  Shrinkage observed-to-expected ratios for robust and transparent large-scale pattern discovery , 2011, Statistical methods in medical research.

[12]  R. O’Neill,et al.  Use of Screening Algorithms and Computer Systems to Efficiently Signal Higher-Than-Expected Combinations of Drugs and Events in the US FDA’s Spontaneous Reports Database , 2002, Drug safety.

[13]  Vaishali K. Patadia,et al.  Data mining in pharmacovigilance: the need for a balanced perspective. , 2005, Drug safety.

[14]  Effect of Date of Drug Marketing on Disproportionality Measures in Pharmacovigilance , 2009, Drug safety.

[15]  G. Niklas Norén,et al.  Statistical methods for knowledge discovery in adverse drug reaction surveillance. , 2007 .

[16]  L. Hazell,et al.  Under-Reporting of Adverse Drug Reactions , 2006, Drug safety.

[17]  V. Bauchau,et al.  The upper bound to the Relative Reporting Ratio—a measure of the impact of the violation of hidden assumptions underlying some disproportionality methods used in signal detection , 2014, Pharmacoepidemiology and drug safety.

[18]  Y. Okuno,et al.  Commonality of Drug-associated Adverse Events Detected by 4 Commonly Used Data Mining Algorithms , 2014, International journal of medical sciences.

[19]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[20]  Jielai Xia,et al.  A comparison of measures of disproportionality for signal detection on adverse drug reaction spontaneous reporting database of Guangdong province in China , 2008, Pharmacoepidemiology and drug safety.

[21]  Preciosa M. ColomaGianluca Trifiro.  Where does Signal Detection Using Electronic Healthcare Records Fit into the Big Picture , 2013 .

[22]  Joseph M. Tonning,et al.  Perspectives on the Use of Data Mining in Pharmacovigilance , 2005, Drug safety.

[23]  Vaishali K. Patadia,et al.  Data Mining in Pharmacovigilance , 2005 .

[24]  Gaurav Deshpande,et al.  Data Mining in Drug Safety , 2010, Pharmaceutical Medicine.

[25]  Soulaymani Abdelmajid,et al.  Use of measures of disproportionality in pharmacovigilance , 2016 .

[26]  A. Bate,et al.  A Bayesian neural network method for adverse drug reaction signal generation , 1998, European Journal of Clinical Pharmacology.

[27]  A. Bate,et al.  Quantitative signal detection using spontaneous ADR reporting , 2009, Pharmacoepidemiology and drug safety.

[28]  M Lindquist,et al.  Introducing triage logic as a new strategy for the detection of signals in the WHO Drug Monitoring Database , 2004, Pharmacoepidemiology and drug safety.