Asymptotic Properties of Multicolor Randomly Reinforced Pólya Urns

The generalized Pólya urn has been extensively studied and is widely applied in many disciplines. An important application of urn models is in the development of randomized treatment allocation schemes in clinical studies. The randomly reinforced urn was recently proposed, but, although the model has some intuitively desirable properties, it lacks theoretical justification. In this paper we obtain important asymptotic properties for multicolor reinforced urn models. We derive results for the rate of convergence of the number of patients assigned to each treatment under a set of minimum required conditions and provide the distributions of the limits. Furthermore, we study the asymptotic behavior for the nonhomogeneous case.

[1]  Svante Janson,et al.  Functional limit theorems for multitype branching processes and generalized Pólya urns , 2004 .

[2]  Feifang Hu,et al.  Immigrated urn models—theoretical properties and applications , 2008, 0812.3698.

[3]  L. J. Wei,et al.  The Randomized Play-the-Winner Rule in Medical Trials , 1978 .

[4]  Feifang Hu,et al.  Asymptotic theorems of sequential estimation-adjusted urn models , 2006 .

[5]  H A Wendel,et al.  Randomization in clinical trials. , 1978, Science.

[6]  G. Pólya,et al.  Über die Statistik verketteter Vorgänge , 1923 .

[7]  A. Paganoni,et al.  Randomly Reinforced Urn Designs Whose Allocation Proportions Converge to Arbitrary Prespecified Values , 2013 .

[8]  William F. Rosenberger,et al.  RANDOMIZED URN MODELS AND SEQUENTIAL DESIGN , 2002 .

[9]  W. Rosenberger,et al.  The theory of response-adaptive randomization in clinical trials , 2006 .

[10]  P. Secchi,et al.  A Functional Equation Whose Unknown is $\mathcal{P}([0,1])$ Valued , 2009, 0905.3310.

[11]  Nicolas Pouyanne,et al.  Limit distributions for large P\'{o}lya urns , 2009, 0907.1477.

[12]  Giacomo Aletti,et al.  On the distribution of the limit proportion for a two-color, randomly reinforced urn with equal reinforcement distributions , 2007, Advances in Applied Probability.

[13]  Anna Maria Paganoni,et al.  A numerical study for comparing two response-adaptive designs for continuous treatment effects , 2007, Stat. Methods Appl..

[14]  Feifang Hu,et al.  Asymptotics in randomized urn models , 2005 .

[15]  P. Hall,et al.  Martingale Limit Theory and its Application. , 1984 .

[16]  Alan W. Beggs,et al.  On the convergence of reinforcement learning , 2005, J. Econ. Theory.

[17]  Luca Pratelli,et al.  Central limit theorems for multicolor urns with dominated colors , 2009, 0907.0676.

[18]  Clyde F. Martin,et al.  Value of information in the Polya urn process , 2002, Inf. Sci..

[19]  Feifang Hu,et al.  Asymptotic theorems for urn models with nonhomogeneous generating matrices , 1999 .

[20]  Feifang Hu,et al.  Asymptotic properties of doubly adaptive biased coin designs for multitreatment clinical trials , 2003 .

[21]  P. Muliere,et al.  Randomly reinforced urns for clinical trials with continuous responses , 2006 .

[22]  P. Hall,et al.  Martingale Limit Theory and Its Application , 1980 .

[23]  S. D. Durham,et al.  A sequential design for maximizing the probability of a favourable response , 1998 .

[24]  G. Pólya,et al.  Sur quelques points de la théorie des probabilités , 1930 .

[25]  Connie Page,et al.  Estimation after adaptive allocation , 2000 .

[26]  N. Flournoy,et al.  Asymptotics in response-adaptive designs generated by a two-color, randomly reinforced urn , 2009, 0904.0350.

[27]  Anna Maria Paganoni,et al.  A randomly reinforced urn , 2006 .

[28]  S. D. Durham,et al.  Randomized Play-the-Leader Rules for Sequential Sampling from Two Populations , 1990, Probability in the engineering and informational sciences (Print).

[29]  Giacomo Aletti,et al.  Randomly Reinforced Urn Designs with Prespecified Allocations , 2013, J. Appl. Probab..

[30]  Svante Janson,et al.  Limit theorems for triangular urn schemes , 2006 .

[31]  W. Rosenberger,et al.  Randomization in Clinical Trials: Theory and Practice , 2002 .

[32]  Luca Pratelli,et al.  A Central Limit Theorem and its Applications to Multicolor Randomly Reinforced Urns , 2009, Journal of Applied Probability.

[33]  P. Secchi,et al.  A central limit theorem, and related results, for a two-color randomly reinforced urn , 2008, Advances in Applied Probability.

[34]  A. Roth,et al.  Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria , 1998 .

[35]  William F. Rosenberger,et al.  Asymptotic Properties of Adaptive designs for Clinical Trials with delayed Response , 2002 .