Bootstrap Recycling: A Monte Carlo Alternative to the Nested Bootstrap

Abstract A Monte Carlo algorithm is described that can be used in place of the nested bootstrap. It is particularly advantageous when there is a premium on the number of bootstrap samples, either because samples are hard to generate or because expensive computations are applied to each sample. This recycling algorithm is useful because it enables inference procedures like prepivoting and bootstrap iteration in models where nested bootstrapping is computationally impractical. Implementation of the recycling algorithm is quite straightforward. As a replacement of the double bootstrap, for example, bootstrap recycling involves two stages of sampling, as does the double bootstrap. The first stage of both algorithms is the same: simulate from the fitted model. In the second stage of recycling, one batch of samples is simulated from one measure; a measure dominating all the first-stage fits. These samples are recycled with each first-stage sample to yield estimated adjustments to the original inference procedur...

[1]  S. S. Wilks The Large-Sample Distribution of the Likelihood Ratio for Testing Composite Hypotheses , 1938 .

[2]  R. Tibshirani Variance stabilization and the bootstrap , 1988 .

[3]  Nitin R. Patel,et al.  A Network Algorithm for Performing Fisher's Exact Test in r × c Contingency Tables , 1983 .

[4]  Charles J. Geyer,et al.  Constrained Maximum Likelihood Exemplified by Isotonic Convex Logistic Regression , 1991 .

[5]  R. Beran Prepivoting to reduce level error of confidence sets , 1987 .

[6]  Bounds on the size of the likelihood ratio test of independence in a contingency table , 1993 .

[7]  P. Hall,et al.  On bootstrap resampling and iteration , 1988 .

[8]  A stochastic model for haematopoiesis in cats. , 1990, IMA journal of mathematics applied in medicine and biology.

[9]  C. Geyer Markov Chain Monte Carlo Maximum Likelihood , 1991 .

[10]  M. Johns Importance Sampling for Bootstrap Confidence Intervals , 1988 .

[11]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[12]  R. Beran Prepivoting Test Statistics: A Bootstrap View of Asymptotic Refinements , 1988 .

[13]  P. Hall On the Bootstrap and Confidence Intervals , 1986 .

[14]  Michael A. Martin On Bootstrap Iteration for Coverage Correction in Confidence Intervals , 1990 .

[15]  Kai Lai Chung,et al.  A Course in Probability Theory , 1949 .

[16]  B. Efron Jackknife‐After‐Bootstrap Standard Errors and Influence Functions , 1992 .

[17]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[18]  H. Teicher,et al.  Probability theory: Independence, interchangeability, martingales , 1978 .

[19]  P. Hall,et al.  The Effect of Simulation Order on Level Accuracy and Power of Monte Carlo Tests , 1989 .

[20]  D. V. Hinkley,et al.  Importance sampling and the nested bootstrap , 1989 .