We consider in this paper the use of Monte Carlo simulation to numerically approximate the asymptotic variance of an estimator of a population parameter. When the variance of an estimator does not exist in finite samples, the variance of its limiting distribution is often used for inferences. However, in this case, the numerical approximation of asymptotic variances is less straightforward, unless their analytical derivation is mathematically tractable. The method proposed does not assume the existence of variance in finite samples. If finite sample variance does exist, it provides a more efficient approximation than the one based on the convergence of finite sample variances. Furthermore, the results obtained will be potentially useful in evaluating and comparing different estimation procedures based on their asymptotic variances for various types of distributions. The method is also applicable in surveys where the sample size required to achieve a fixed margin of error is based on the asymptotic variance of the estimator. The proposed method can be routinely applied and alleviates the complex theoretical treatment usually associated with the analytical derivation of the asymptotic variance of an estimator which is often managed on a case by case basis. This is particularly appealing in view of the advance of modern computing technology. The proposed numerical approximation is based on the variances of a certain truncated statistic for two selected sample sizes, using a Richardson extrapolation type formulation. The variances of the truncated statistic for the two sample sizes are computed based on Monte Carlo simulations, and the theory for optimizing the computing resources is also given. The accuracy of the proposed method is numerically demonstrated in a classical errors-in-variables model where analytical results are available for the purpose of comparisons.
[1]
P. Bickel,et al.
Richardson Extrapolation and the Bootstrap
,
1988
.
[2]
P. Moran.
Estimating structural and functional relationships
,
1971
.
[3]
M. Karim.
Generalized Linear Models With Random Effects
,
1991
.
[4]
Alexander Kukush,et al.
Measurement Error Models
,
2011,
International Encyclopedia of Statistical Science.
[5]
Tak K. Mak,et al.
Maximum Likelihood Estimation of a Linear Structural Relationship with Replication
,
1979
.
[6]
K. Chan,et al.
Monte Carlo EM Estimation for Time Series Models Involving Counts
,
1995
.
[7]
R. H. Browne.
On the use of a pilot sample for sample size determination.
,
1995,
Statistics in medicine.
[8]
S L Zeger,et al.
Generalized linear models with random effects; salamander mating revisited.
,
1992,
Biometrics.
[9]
T. K. Tak K. Mak,et al.
Estimating variances for all sample sizes by the bootstrap
,
2004,
Comput. Stat. Data Anal..
[10]
A. Agresti,et al.
Categorical Data Analysis
,
1991,
International Encyclopedia of Statistical Science.
[11]
J. Booth,et al.
Monte Carlo Approximation of Bootstrap Variances
,
1998
.
[12]
Wolfgang Jank,et al.
A survey of Monte Carlo algorithms for maximizing the likelihood of a two-stage hierarchical model
,
2001
.