Standard 4: Determining Adequate Sample Sizes

* Abbreviations: CINV — : chemotherapy-induced nausea and vomiting RCT — : randomized controlled trial RSV — : respiratory syncytial virus There are many challenges to be faced when conducting randomized controlled trials (RCTs) in pediatric research. One important challenge is the determination of an appropriate sample size. Recruiting more children than necessary risks unnecessary overexposure of children to an inferior treatment, whereas underestimating the sample required will lead to inconclusive or unreliable results. Both options pose important ethical dilemmas for the pediatric researcher. Reviews have concluded that sample size calculations are frequently based on inaccurate assumptions regarding the key pieces of information needed.1,2 For example, a recent “failed” pediatric RCT highlighted the commonly encountered problem of underestimating the SD of a continuous primary outcome variable.3 This leads to underestimation of the necessary sample size, inadequate statistical power, and, consequently, an unanswered study question. Similarly, an incorrect estimation of the frequency with which a dichotomous outcome, or event, occurs in the control group of a trial (known as the control or baseline event rate) will also lead to incorrect sample size estimation. This standards article uses a series of scenarios to assist pediatric researchers in not only determining an adequate trial sample size but also how to proceed when this sample size may be difficult to achieve. Recommendations for practice are summarized in Table 1. View this table: TABLE 1 Recommendations for Practice Methods to calculate adequate sample sizes are described for superiority, noninferiority, and cluster-randomized trials with various types of primary outcome variables, including continuous, dichotomous, or time-to-event data.4–10 In this article, we focus primarily on superiority trial designs with continuous or dichotomous outcomes. Information on noninferiority or equivalence designs, as well as on cluster-randomized designs, can be found in the literature.9,10 RCTs generally have many outcomes of interest, but the number of patients required (and the main statistical analysis) should be based on … Address correspondence to Martin Offringa, MD, PhD, Senior Scientist and Program Head, Child Health Evaluative Sciences, Research Institute, The Hospital for Sick Children, 555 University Ave, Toronto, Ontario, Canada M5G 1X8. E-mail: martin.offringa{at}sickkids.ca

[1]  T. Friede,et al.  Re-calculating the sample size in internal pilot study designs with control of the type I error rate. , 2000, Statistics in medicine.

[2]  Steven N Goodman,et al.  A Bayesian approach to randomized controlled trials in children utilizing information from adults: the case of Guillain-Barre , 2005, Clinical trials.

[3]  Y. Gupta,et al.  Anti‐emetic effect of ginger powder versus placebo as an add‐on therapy in children and young adults receiving high emetogenic chemotherapy , 2011, Pediatric blood & cancer.

[4]  J. Haybittle,et al.  Repeated assessment of results in clinical trials of cancer treatment. , 1971, The British journal of radiology.

[5]  B. Freidlin,et al.  Release of data from an ongoing randomized clinical trial for sample size adjustment or planning , 2007, Statistics in medicine.

[6]  Michael A Proschan,et al.  Practical midcourse sample size modification in clinical trials. , 2003, Controlled clinical trials.

[7]  A. Gould,et al.  Sample size re-estimation without unblinding for normally distributed outcomes with unknown variance , 1992 .

[8]  Sally Hopewell,et al.  Clinical trials should begin and end with systematic reviews of relevant evidence: 12 years and waiting , 2010, The Lancet.

[9]  C. H. Evans,et al.  Small Clinical Trials: Issues and Challenges , 2001 .

[10]  Stephen Senn,et al.  Cross-over trials in clinical research , 1993 .

[11]  M. Pike,et al.  Design and analysis of randomized clinical trials requiring prolonged observation of each patient. II. analysis and examples. , 1977, British Journal of Cancer.

[12]  Gordon Graham,et al.  Bayesian sample size for exploratory clinical trials incorporating historical data , 2008, Statistics in medicine.

[13]  Bjorn Winkens,et al.  Optimal number of repeated measures and group sizes in clinical trials with linearly divergent treatment effects. , 2006, Contemporary clinical trials.

[14]  D. Schoenfeld,et al.  Bayesian design using adult data to augment pediatric trials , 2009, Clinical trials.

[15]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[16]  S. Julious Sample sizes for clinical trials with Normal data , 2004, Statistics in medicine.

[17]  J. H. van der Lee,et al.  Pitfalls in the design and analysis of paediatric clinical trials: a case of a ‘failed’ multi-centre study, and potential solutions , 2008, Acta paediatrica.

[18]  R. Owen,et al.  Sample size calculations for clinical studies allowing for uncertainty about the variance , 2006, Pharmaceutical statistics.

[19]  P. Armitage,et al.  Design and analysis of randomized clinical trials requiring prolonged observation of each patient. I. Introduction and design. , 1976, British Journal of Cancer.

[20]  D L DeMets,et al.  Interim analysis: the alpha spending function approach. , 1994, Statistics in medicine.

[21]  W. Brannath,et al.  The advantages and disadvantages of adaptive designs for clinical trials. , 2004, Drug discovery today.

[22]  Guosheng Yin,et al.  Fundamentals of Clinical Trials , 2012 .

[23]  K. Hesketh,et al.  The Early Prevention of Obesity in CHildren (EPOCH) Collaboration - an Individual Patient Data Prospective Meta-Analysis , 2010, BMC public health.

[24]  Philippe Ravaud,et al.  Reporting of sample size calculation in randomised controlled trials: review , 2009, BMJ : British Medical Journal.

[25]  R. Ehrenkranz Caffeine Therapy for Apnea of Prematurity , 2007 .

[26]  COMMITTEE FOR MEDICINAL PRODUCTS FOR HUMAN USE (CHMP) REFLECTION PAPER NON-CLINICAL AND CLINICAL DEVELOPMENT OF SIMILAR MEDICINAL PRODUCTS CONTAINING RECOMBINANT INTERFERON ALFA DRAFT AGREED BY BIOSIMILAR MEDICINAL PRODUCTS WORKING PARTY (BMWP) October 2007 ADOPTION BY CHMP FOR RELEASE FOR CONSULTAT , 2009 .

[27]  P. Bauer,et al.  Evaluation of experiments with adaptive interim analyses. , 1994, Biometrics.

[28]  C D Naylor,et al.  Meta-analysis of controlled clinical trials. , 1989, The Journal of rheumatology.

[29]  David J Henderson-Smart,et al.  Methylxanthine treatment for apnoea in preterm infants. , 2010, The Cochrane database of systematic reviews.

[30]  L. Freedman Tables of the number of patients required in clinical trials using the logrank test. , 1982, Statistics in medicine.

[31]  P. O'Brien,et al.  A multiple testing procedure for clinical trials. , 1979, Biometrics.

[32]  Nicola J Cooper,et al.  Evidence‐based sample size calculations based upon updated meta‐analysis , 2007, Statistics in medicine.

[33]  J. Higgins Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011]. The Cochrane Collaboration , 2011 .

[34]  D. Henderson-smart,et al.  Methylxanthine treatment for apnea in preterm infants. , 2008, The Cochrane database of systematic reviews.

[35]  Arne Ohlsson,et al.  Long-term effects of caffeine therapy for apnea of prematurity. , 2007, The New England journal of medicine.

[36]  A Donner,et al.  Approaches to sample size estimation in the design of clinical trials--a review. , 1984, Statistics in medicine.

[37]  S. Stanojevic,et al.  Reference values for lung function: past, present and future , 2010, European Respiratory Journal.

[38]  Andrew J Vickers,et al.  Underpowering in randomized trials reporting a sample size calculation. , 2003, Journal of clinical epidemiology.

[39]  J. Lachin Introduction to sample size determination and power analysis for clinical trials. , 1981, Controlled clinical trials.

[40]  J. Berlin,et al.  Prospective Meta‐Analysis , 2008 .

[41]  J. Wittes,et al.  The role of internal pilot studies in increasing the efficiency of clinical trials. , 1990, Statistics in medicine.

[42]  Methods for one‐sided testing of the difference between proportions and sample size considerations related to non‐inferiority clinical trials , 2008, Pharmaceutical statistics.