Statistical significance and statistical power in hypothesis testing

Experimental design requires estimation of the sample size required to produce a meaningful conclusion. Often, experimental results are performed with sample sizes which are inappropriate to adequately support the conclusions made. In this paper, two factors which are involved in sample size estimation are detailed—namely type I (α) and type II (β) error. Type I error can be considered a “false positive” result while type II error can be considered a “false negative” result. Obviously, both types of error should be avoided. The choice of values for α and β is based on an investigator's understanding of the experimental system, not on arbitrary statistical rules. Examples relating to the choice of α and β are presented, along with a series of suggestions for use in experimental design.

[1]  T C Chalmers,et al.  The importance of beta, the type II error and sample size in the design and interpretation of the randomized control trial. Survey of 71 "negative" trials. , 1978, The New England journal of medicine.

[2]  W. Dixon,et al.  BMDP statistical software , 1983 .

[3]  C Poole,et al.  Beyond the confidence interval. , 1987, American journal of public health.

[4]  W. Thompson,et al.  On the comparison of effects. , 1987, American journal of public health.

[5]  W. Thompson,et al.  Statistical criteria in the interpretation of epidemiologic data. , 1987, American journal of public health.

[6]  R. Lieber,et al.  Corrective shoes and inserts as treatment for flexible flatfoot in infants and children. , 1989, The Journal of bone and joint surgery. American volume.