Alternatives to P value: confidence interval and effect size

The previous articles of the Statistical Round in the Korean Journal of Anesthesiology posed a strong enquiry on the issue of null hypothesis significance testing (NHST). P values lie at the core of NHST and are used to classify all treatments into two groups: "has a significant effect" or "does not have a significant effect." NHST is frequently criticized for its misinterpretation of relationships and limitations in assessing practical importance. It has now provoked criticism for its limited use in merely separating treatments that "have a significant effect" from others that do not. Effect sizes and CIs expand the approach to statistical thinking. These attractive estimates facilitate authors and readers to discriminate between a multitude of treatment effects. Through this article, I have illustrated the concept and estimating principles of effect sizes and CIs.

[1]  C. Ferguson.  An effect size primer: A guide for clinicians and researchers. , 2009 .

[2]  Magdalena Szumilas.  Explaining odds ratios. , 2010, Journal of the Canadian Academy of Child and Adolescent Psychiatry = Journal de l'Academie canadienne de psychiatrie de l'enfant et de l'adolescent.

[3]  Ken Kelley,et al.  Confidence Intervals for Standardized Effect Sizes: Theory, Application, and Implementation , 2007 .

[4]  J. McGough,et al.  Estimating the size of treatment effects: moving beyond p values. , 2009, Psychiatry (Edgmont (Pa. : Township)).

[5]  Xiao-Hua Zhou,et al.  Statistical Methods for Meta‐Analysis , 2008 .

[6]  R. Fumagalli,et al.  Intraperitoneal nebulization of ropivacaine for pain control after laparoscopic cholecystectomy: a double-blind, randomized, placebo-controlled trial. , 2013, British journal of anaesthesia.

[7]  Bruce Thompson,et al.  "Statistical," "practical", and "clinical": How many kinds of significance do counselors need to consider? , 2002 .

[8]  Francis K C Hui,et al.  The arcsine is asinine: the analysis of proportions in ecology. , 2011, Ecology.

[9]  I. Cuthill,et al.  Effect size, confidence interval and statistical significance: a practical guide for biologists , 2007, Biological reviews of the Cambridge Philosophical Society.

[10]  L. Hedges,et al.  Statistical Methods for Meta-Analysis , 1987 .

[11]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[12]  N. Kawakami,et al.  Long-term psychological consequences among adolescent survivors of the Wenchuan earthquake in China: A cross-sectional survey six years after the disaster. , 2016, Journal of affective disorders.

[13]  Joe W. Kotrl.  The Incorporation of Effect Size in Information Technology , Learning , and Performance Research , 2003 .

[14]  Joe W. Kotrlik,et al.  The Incorporation of Effect Size in The Incorporation of Effect Size in Information Technology, Learning, Information Technology, Learning, and Performance Research and Performance Research , 2003 .

[15]  Olejnik,et al.  Measures of Effect Size for Comparative Studies: Applications, Interpretations, and Limitations. , 2000, Contemporary educational psychology.

[16]  J. Algina,et al.  Generalized eta and omega squared statistics: measures of effect size for some common research designs. , 2003, Psychological methods.

[17]  Tae Kyun Kim,et al.  T test as a parametric statistic , 2015, Korean journal of anesthesiology.

[18]  Donald B. Rubin,et al.  A Simple, General Purpose Display of Magnitude of Experimental Effect , 1982 .

[19]  Junyong In,et al.  Standard deviation and standard error of the mean , 2015, Korean journal of anesthesiology.

[20]  Rex B. Kline,et al.  Beyond Significance Testing: Reforming Data Analysis Methods in Behavioral Research , 2004 .

[21]  B. Thompson.  What Future Quantitative Social Science Research Could Look Like: Confidence Intervals for Effect Sizes , 2002 .

[22]  M. R. Stoline.  The Status of Multiple Comparisons: Simultaneous Estimation of all Pairwise Comparisons in One-Way ANOVA Designs , 1981 .

[23]  B. Thompson,et al.  How to Estimate and Interpret Various Effect Sizes , 2004 .

[24]  Sangseok Lee.  Avoiding negative reviewer comments: common statistical errors in anesthesia journals , 2016, Korean journal of anesthesiology.

[25]  M. Jabor,et al.  Reporting and Interpreting Effect Size in Quantitative Agricultural Education Research. , 2011 .

[26]  C. Garvan,et al.  Proportions, odds, and risk. , 2004, Radiology.

[27]  Tammi Vacha-Haase,et al.  Statistical Significance should not be Considered one of Life’s Guarantees: Effect Sizes are Needed , 2001 .