Distribution-free tests of stochastic dominance for small samples

Abstract One variable is said to “stochastically dominate” another if the probability of observations smaller than x is greater for one variable than the other, for all x . Inferring stochastic dominance from data samples is important for many applications of econometrics and experimental psychology, but little is known about the performance of existing inferential methods. Through simulation, we show that three of the most widely used inferential methods are inadequate for use in small samples of the size commonly encountered in many applications (up to 400 observations from each distribution). We develop two new inferential methods that perform very well in a limited, but practically important, case where the two variables are guaranteed not to be equal in distribution. We also show that extensions of these new methods, and an improved version of an existing method, perform quite well in the original, unlimited case.

[1]  Harshinder Singh,et al.  Testing for Second-Order Stochastic Dominance of Two Distributions , 1994, Econometric Theory.

[2]  Joseph W. Houpt,et al.  Systems Factorial Technology provides new insights on global-local information processing in autism spectrum disorders. , 2010, Journal of mathematical psychology.

[3]  Jay I. Myung,et al.  A Statistician’s View on Bayesian Evaluation of Informative Hypotheses , 2008 .

[4]  Thomas B. Fomby,et al.  Studies in the economics of uncertainty : in honor of Josef Hadar , 1989 .

[5]  M. Aitkin,et al.  Bayes factors: Prior sensitivity and model generalizability , 2008 .

[6]  R. Schweickert,et al.  Selective Influence and Response Time Cumulative Distribution Functions in Serial-Parallel Task Networks. , 2000, Journal of mathematical psychology.

[7]  J T Townsend,et al.  Truth and consequences of ordinal differences in statistical distributions: toward a theory of hierarchical inference. , 1990, Psychological bulletin.

[8]  D. McFadden.  Testing for Stochastic Dominance , 1989 .

[9]  Alberto Abadie.  Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models , 2002 .

[10]  Herbert Hoijtink,et al.  Bayesian model selection using encompassing priors , 2005 .

[11]  LevyHaim.  Stochastic Dominance and Expected Utility , 1992 .

[12]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[13]  H. Hoijtink,et al.  Bayesian Evaluation of Informative Hypotheses. , 2008 .

[14]  P. Hall,et al.  Testing for monotone increasing hazard rate , 2005, math/0507419.

[15]  Herbert Hoijtink,et al.  Inequality constrained analysis of variance: a Bayesian approach. , 2005, Psychological methods.

[16]  W. Griffiths,et al.  Bayesian Assessment of Lorenz and Stochastic Dominance in Income Distributions , 2006 .

[17]  J. Townsend,et al.  Stochastic dependencies in parallel and serial models: effects on systems factorial interactions , 1994 .

[18]  H. Ury,et al.  Tables of the Studentized Maximum Modulus Distribution and an Application to Multiple Comparisons Among Means , 1979 .

[19]  AN Kolmogorov-Smirnov,et al.  Sulla determinazione empírica di uma legge di distribuzione , 1933 .

[20]  Ehtibar N. Dzhafarov,et al.  Mental architectures with selectively influenced but stochastically interdependent components , 2004 .

[21]  Eric-Jan Wagenmakers,et al.  An encompassing prior generalization of the Savage-Dickey density ratio , 2010, Comput. Stat. Data Anal..

[22]  Ami Eidels,et al.  Where similarity beats redundancy: the importance of context, higher order similarity, and response assignment. , 2008, Journal of experimental psychology. Human perception and performance.

[23]  T. Ferguson.  A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[24]  H. Levy.  Stochastic dominance and expected utility: survey and analysis , 1992 .

[25]  Gordon Anderson,et al.  Nonparametric Tests of Stochastic Dominance in Income Distributions , 1996 .

[26]  J. Doob.  Heuristic Approach to the Kolmogorov-Smirnov Theorems , 1949 .

[27]  Xibin Zhang,et al.  Australia Department of Econometrics and Business Statistics a Monte Carlo Investigation of Some Tests for Stochastic Dominance a Monte Carlo Investigation of Some Tests for Stochastic Dominance , 2022 .

[28]  J. Townsend,et al.  Spatio-temporal properties of elementary perception: an investigation of parallel, serial, and coactive theories , 1995 .

[29]  R. Davidson,et al.  Statistical Inference for Stochastic Dominance and for the Measurement of Poverty and Inequality , 1998 .

[30]  A. Raftery,et al.  Estimating Bayes Factors via Posterior Simulation with the Laplace—Metropolis Estimator , 1997 .