Comparing two independent groups via the lower and upper quantiles

The most common strategy for comparing two independent groups is in terms of some measure of location intended to reflect the typical observation. However, it can be informative and important to compare the lower and upper quantiles as well, but when there are tied values, extant techniques suffer from practical concerns reviewed in the paper. For the special case where the goal is to compare the medians, a slight generalization of the percentile bootstrap method performs well in terms of controlling Type I errors when there are tied values [Wilcox RR. Comparing medians. Comput. Statist. Data Anal. 2006;51:1934–1943]. But our results indicate that when the goal is to compare the quartiles, or quantiles close to zero or one, this approach is highly unsatisfactory when the quantiles are estimated using a single order statistic or a weighted average of two order statistics. The main result in this paper is that when using the Harrell–Davis estimator, which uses all of the order statistics to estimate a quantile, control over the Type I error probability can be achieved in simulations, even when there are tied values, provided the sample sizes are not too small. It is demonstrated that this method can also have substantially higher power than the distribution free method derived by Doksum and Sievers [Plotting with confidence: graphical comparisons of two populations. Biometrika 1976;63:421–434]. Data from two studies are used to illustrate the practical advantages of the method studied here.

[1]  Rand R. Wilcox.  Comparing medians , 2006, Comput. Stat. Data Anal..

[2]  Terry E. Dielman,et al.  A comparison of quantile estimators , 1994 .

[3]  R. Koenker.  Confidence Intervals for Regression Quantiles , 1994 .

[4]  Frank E. Harrell,et al.  A new distribution-free quantile estimator , 1982 .

[5]  R. Parrish,et al.  Comparison of Quantile Estimators in Normal Sampling , 1990 .

[6]  Y. Hochberg.  A sharper Bonferroni procedure for multiple tests of significance , 1988 .

[7]  David C. Hoaglin,et al.  Summarizing Shape Numerically: The g‐and‐h Distributions , 2011 .

[8]  Regina Y. Liu,et al.  Notions of Limiting P Values Based on Data Depth and Bootstrap , 1997 .

[9]  Chih-Ping Chou,et al.  Confronting challenges in intervention research with ethnically diverse older adults: the USC Well Elderly II Trial , 2009, Clinical trials.

[10]  Lyndall G. Steed,et al.  Does exposure to cigarette health warnings elicit psychological reactance in smokers , 2011 .

[11]  Julia Kastner,et al.  Introduction to Robust Estimation and Hypothesis Testing , 2005 .

[12]  James Stephen Marron,et al.  Kernel Quantile Estimators , 1990 .

[13]  L. Radloff.  The CES-D Scale , 1977 .

[14]  Kjell A. Doksum,et al.  Plotting with confidence: Graphical comparisons of two populations , 1976 .

[15]  Michael E. Sfakianakis,et al.  A New Family of Nonparametric Quantile Estimators , 2008, Commun. Stat. Simul. Comput..

[16]  Frederick Mosteller,et al.  Exploring Data Tables, Trends and Shapes. , 1986 .

[17]  R. Koenker,et al.  Regression Quantiles , 2007 .

[18]  Roger Koenker,et al.  Inference on the Quantile Regression Process , 2000 .