Type I Error Probability Spending for Post-Market Drug and Vaccine Safety Surveillance With Poisson Data

Statistical sequential hypothesis testing is meant to analyze cumulative data accruing in time. The methods can be divided in two types, group and continuous sequential approaches, and a question that arises is if one approach suppresses the other in some sense. For Poisson stochastic processes, we prove that continuous sequential analysis is uniformly better than group sequential under a comprehensive class of statistical performance measures. Hence, optimal solutions are in the class of continuous designs. This paper also offers a pioneer study that compares classical Type I error spending functions in terms of expected number of events to signal. This was done for a number of tuning parameters scenarios. The results indicate that a log-exp shape for the Type I error spending function is the best choice in most of the evaluated scenarios.

[1]  M. Kulldorff,et al.  A Maximized Sequential Probability Ratio Test for Drug and Vaccine Safety Surveillance , 2011 .

[2]  David L. DeMets,et al.  Design and analysis of group sequential tests based on the type I error spending rate function , 1987 .

[3]  Efficient Score Statistic in Drug and Vaccine Safety Surveillance , 2015 .

[4]  S. Pocock.  Group sequential methods in the design and analysis of clinical trials , 1977 .

[5]  I R Silva,et al.  Continuous versus group sequential analysis for post‐market drug and vaccine safety surveillance , 2015, Biometrics.

[6]  B. Turnbull,et al.  Group Sequential Methods with Applications to Clinical Trials , 1999 .

[7]  K. K. Lan,et al.  Discrete sequential boundaries for clinical trials , 1983 .

[8]  N. Andrews,et al.  Near real‐time vaccine safety surveillance using electronic health records—a systematic review of the application of statistical methods † , 2016, Pharmacoepidemiology and drug safety.

[9]  Jennifer C. Nelson,et al.  Statistical performance of group sequential methods for observational post-licensure medical product safety surveillance: A simulation study , 2012 .

[10]  P. O'Brien,et al.  A multiple testing procedure for clinical trials. , 1979, Biometrics.

[11]  J. S. D. Cani,et al.  Group sequential designs using a family of type I error probability spending functions. , 1990, Statistics in medicine.

[12]  Christopher Jennison,et al.  Statistical Approaches to Interim Monitoring of Medical Trials: A Review and Commentary , 1990 .

[13]  W Katherine Yih,et al.  Active Surveillance for Adverse Events: The Experience of the Vaccine Safety Datalink Project , 2011, Pediatrics.

[14]  Christopher Jennison,et al.  Interim analyses: the repeated confidence interval approach , 1989 .

[15]  Robert T. Chen,et al.  Active Surveillance of Vaccine Safety: A System to Detect Early Signs of Adverse Events , 2005, Epidemiology.

[16]  Andrea J Cook,et al.  Challenges in the design and analysis of sequentially monitored postmarket safety surveillance evaluations using electronic observational health care data , 2012, Pharmacoepidemiology and drug safety.

[17]  Robert L Davis,et al.  Real-Time Vaccine Safety Surveillance for the Early Detection of Adverse Events , 2007, Medical care.