, in multidimensional models, simultaneous confidence or credibility regions for continuous parameters hold the overall frequentist long run or Bayesian posterior probability constant at some level such as 95%. This means that, as the dimensionality of the problem increases, the precision or information required about each individual parameter also rapidly increases so parameters have progressively less chance of being set to 0 in such a model selection procedure. These methods do not appropriately answer most of the inference questions that are generally encountered in applied statistics. Thus, sample size, model selection criteria and the estimation of parameter precision are intimately related. In contrast with frequentist and Bayesian procedures, direct likelihood inference, calibrating acceptable likelihood regions by criteria derived from model selection, such as the Akaike information criterion, holds the precision requirements per parameter constant as the dimensionality grows, thus allowing the series of inferences to remain compatible. Other model selection criteria, such as the Bayes information criterion, that depend on the sample size, maintain compatibility but decrease the precision per parameter as the sample increases, so, in the limit, the null model tends to be chosen (Lindley's paradox).
[1]
H. Akaike,et al.
Information Theory and an Extension of the Maximum Likelihood Principle
,
1973
.
[2]
G. C. Tiao,et al.
Bayesian inference in statistical analysis
,
1973
.
[3]
M. Stone.
Comments on Model Selection Criteria of Akaike and Schwarz
,
1979
.
[4]
B. G. Quinn,et al.
The determination of the order of an autoregression
,
1979
.
[5]
Douglas G. Altman,et al.
Practical statistics for medical research
,
1990
.
[6]
D. Saville.
Multiple Comparison Procedures: The Practical Solution
,
1990
.
[7]
D. Clayton,et al.
Statistical Models in Epidemiology
,
1993
.
[8]
J. Lindsey.
The uses and limits of linear models
,
1995
.