I present a new Markov chain sampling method appropriate for distributions with isolated modes. Like the recently developed method of ‘simulated tempering’, the ‘tempered transition’ method uses a series of distributions that interpolate between the distribution of interest and a distribution for which sampling is easier. The new method has the advantage that it does not require approximate values for the normalizing constants of these distributions, which are needed for simulated tempering, and can be tedious to estimate. Simulated tempering performs a random walk along the series of distributions used. In contrast, the tempered transitions of the new method move systematically from the desired distribution, to the easily-sampled distribution, and back to the desired distribution. This systematic movement avoids the inefficiency of a random walk, an advantage that is unfortunately cancelled by an increase in the number of interpolating distributions required. Because of this, the sampling efficiency of the tempered transition method in simple problems is similar to that of simulated tempering. On more complex distributions, however, simulated tempering and tempered transitions may perform differently. Which is better depends on the ways in which the interpolating distributions are ‘deceptive’.
[1]
C. D. Gelatt,et al.
Optimization by Simulated Annealing
,
1983,
Science.
[2]
S. Duane,et al.
Hybrid Monte Carlo
,
1987
.
[3]
Adrian F. M. Smith,et al.
Bayesian computation via the gibbs sampler and related markov chain monte carlo methods (with discus
,
1993
.
[4]
A. Kennedy.
The theory of hybrid stochastic algorithms
,
1990
.
[5]
C. Geyer.
Markov Chain Monte Carlo Maximum Likelihood
,
1991
.
[6]
E. Keramidas.
Computing science and statistics : proceedings of the 23rd Symposium on the Interface, Seattle, Washington, April 21-24, 1991 ; Interface '91
,
1991
.
[7]
Berg,et al.
New approach to spin-glass simulations.
,
1992,
Physical review letters.
[8]
G. Parisi,et al.
Simulated tempering: a new Monte Carlo scheme
,
1992,
hep-lat/9205018.
[9]
Kerrie Mengersen,et al.
[Bayesian Computation and Stochastic Systems]: Rejoinder
,
1995
.
[10]
J. Besag,et al.
Bayesian Computation and Stochastic Systems
,
1995
.
[11]
C. Geyer,et al.
Annealing Markov chain Monte Carlo with applications to ancestral inference
,
1995
.