On the Elimination of Nuisance Parameters

Abstract Eliminating nuisance parameters from a model is universally recognized as a major problem of statistics. A surprisingly large number of elimination methods have been proposed by various writers on the topic. In this article we propose to critically review two such elimination methods. We shall be concerned with some particular cases of the marginalizing and the conditioning methods. The origin of these methods may be traced to the work of Sir Ronald A. Fisher. The contents of the marginalization and the conditionality arguments are then reexamined from the Bayesian point of view. This article should be regarded as a sequel to the author's three-part essay (Basu 1975) on statistical information and likelihood.

[1]  R. Fisher,et al.  Statistical Methods for Research Workers , 1930, Nature.

[2]  D. A. Sprott,et al.  Foundations of Statistical Inference. , 1972 .

[3]  J. Neyman,et al.  Consistent Estimates Based on Partially Consistent Observations , 1948 .

[4]  Else Sandved.  Ancillary statistics in models without and with nuisance parameters , 1972 .

[5]  James Durbin,et al.  Some methods of constructing exact tests , 1961 .

[6]  Yu. V. Linnik.  On the elimination of nuisance parameters in statistical problems , 1967 .

[7]  D. Cox.  Some problems connected with statistical inference , 1958 .

[8]  A. Dawid.  On the Concepts of Sufficiency and Ancillarity in the Presence of Nuisance Parameters , 1975 .

[9]  Louis Olshevsky.  Two Properties of Sufficient Statistics , 1940 .

[10]  Howard Raiffa,et al.  Applied Statistical Decision Theory. , 1961 .

[11]  Sufficient Statistics with Nuisance Parameters , 1956 .

[12]  Yu. V. Prohorov.  Some characterization problems in statistics , 1967 .

[13]  O. Barndorff-Nielsen.  Exponential families and conditioning , 1973 .

[14]  E. Andersen.  On partial sufficiency and partial ancillarity , 1967 .

[15]  G. Barnard,et al.  Likelihood Inference and Time Series , 1962 .

[16]  Jaroslav Hájek,et al.  On basic concepts of statistics , 1967 .

[17]  E. Lehmann.  Testing Statistical Hypotheses , 1960 .

[18]  David R. Cox,et al.  The Choice between Alternative Ancillary Statistics , 1971 .

[19]  C. Stein.  A Two-Sample Test for a Linear Hypothesis Whose Power is Independent of the Variance , 1945 .

[20]  H. Raiffa,et al.  Applied Statistical Decision Theory. , 1961 .

[21]  Rory A. Fisher,et al.  Statistical methods and scientific inference. , 1957 .

[22]  Else Sandved.  A PRINCIPLE FOR CONDITIONING ON AN ANCILLARY STATISTIC , 1966 .