Tensor Methods in Statistics

This book provides a systematic development of tensor methods in statistics, beginning with the study of multivariate moments and cumulants. The effect on moment arrays and on cumulant arrays of making linear or affine transformations of the variables is studied. Because of their importance in statistical theory, invariant functions of the cumulants are studied in some detail. This is followed by an examination of the effect of making a polynomial transformation of the original variables. The fundamental operation of summing over complementary set partitions is introduced at this stage. This operation shapes the notation and pervades much of the remainder of the book. The necessary lattice-theory is discussed and suitable tables of complementary set partitions are provided. Subsequent chapters deal with asymptotic approximations based on Edgeworth expansion and saddlepoint expansion. The saddlepoint expansion is introduced via the Legendre transformation of the cumulant generating function, also known as the conjugate function of the cumulant generating function. A recurring them is that, with suitably chosen notation, multivariate calculations are often simpler and more transparent than the corresponding univariate calculations. The final two chapters deal with likelihood ratio statistics, maximum likelihood estimation and the effect on inferences of conditioning on ancillary or approximately ancillary statistics. The Bartlett adjustment factor is derived in the general case and simplified for certain types of generalized linear models. Finally, Barndorff-Nielsen's formula for the conditional distribution of the maximum liklelihood estimator is derived and discussed. More than 200 Exercises are provided to illustrate the uses of tensor methodology.

[1]  A. Einstein,et al.  Die Grundlage der allgemeinen Relativitätstheorie , 1916 .

[2]  L. Isserlis.  ON A FORMULA FOR THE PRODUCT-MOMENT COEFFICIENT OF ANY ORDER OF A NORMAL FREQUENCY DISTRIBUTION IN ANY NUMBER OF VARIABLES , 1918 .

[3]  Rory A. Fisher,et al.  Theory of Statistical Estimation , 1925, Mathematical Proceedings of the Cambridge Philosophical Society.

[4]  Rory A. Fisher,et al.  Moments and Product Moments of Sampling Distributions , 1930 .

[5]  Rory A. Fisher,et al.  The Derivation of the Pattern Formulae of Two‐Way Partitions from those of Simpler Patterns , 1932 .

[6]  F Escher,et al.  On the probability function in the collective theory of risk , 1932 .

[7]  Applications of the Absolute Differential Calculus , 1932 .

[8]  R. Fisher.  Two New Properties of Mathematical Likelihood , 1934 .

[9]  C. E. Weatherburn,et al.  An Introduction to Riemannian Geometry and the Tensor Calculus , 1938 .

[10]  M. Bartlett.  The Characteristic Function of a Conditional Statistic , 1938 .

[11]  R. Fisher,et al.  148: Moments and Cumulants in the Specification of Distributions. , 1938 .

[12]  PROOF OF FISHER'S RULES FOR ASCERTAINING THE SAMPLING SEMI-INVARIANTS OF k-STATISTICS , 1940 .

[13]  Statistical Seminvariants and Their Setimates with Particular Emphasis on Their Relation to Algebraic Invariants , 1940 .

[14]  Maurice G. Kendall,et al.  THE DERIVATION OF MULTIVARIATE SAMPLING FORMULAE FROM UNIVARIATE FORMULAE BY SYMBOLIC OPERATION , 1940 .

[15]  THE MODE AND MEDIAN OF A NEARLY NORMAL DISTRIBUTION WITH GIVEN CUMULANTS , 1942 .

[16]  M. Kendall,et al.  SAMPLING MOMENTS OF MOMENTS FOR A FINITE POPULATION , 1943 .

[17]  R. Fisher.  The Advanced Theory of Statistics , 1943, Nature.

[18]  E. Churchill.  Information Given by Odd Moments , 1946 .

[19]  W. Heitler.  The Principles of Quantum Mechanics , 1947, Nature.

[20]  J. Tukey.  One Degree of Freedom for Non-Additivity , 1949 .

[21]  W. Fenchel.  On Conjugate Convex Functions , 1949, Canadian Journal of Mathematics.

[22]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[23]  J. Tukey.  Some Sampling Simplified , 1950 .

[24]  M. B. Cook.  Bi-variate k-statistics and cumulants of their joint sampling distribution. , 1951, Biometrika.

[25]  E. L. Kaplan,et al.  TENSOR NOTATION AND THE SAMPLING CUMULANTS OF k-STATISTICS* , 1952 .

[26]  I. S. Sokolnikoff,et al.  Tensor Analysis: Theory and Applications , 1952 .

[27]  H. Chernoff.  A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of Observations , 1952 .

[28]  J. Wishart.  MOMENT COEFFICIENTS OF THE k-STATISTICS IN SAMPLES FROM A FINITE POPULATION , 1952 .

[29]  H. Daniels.  Saddlepoint Approximations in Statistics , 1954 .

[30]  Expression of the $k$-Statistics $k_9$ and $K_{10}$ in Terms of Power Sums and Sample Moments , 1954 .

[31]  H. Barnett,et al.  The Variance of the Product of Two Independent Variables and Its Application to an Investigation Based on Sample Data , 1955 .

[32]  R. Fisher.  On a Test of Significance in Pearson's Biometrika Tables (No. 11) , 1956 .

[33]  J. Tukey.  Keeping Moment-Like Sampling Computations Simple , 1956 .

[34]  Some Applications of Bipolykays to the Estimation of Variance Components and their Moments , 1956 .

[35]  D. Lawley.  A GENERAL METHOD FOR APPROXIMATING TO THE DISTRIBUTION OF LIKELIHOOD RATIO CRITERIA , 1956 .

[36]  Robert Hooke,et al.  SYMMETRIC FUNCTIONS OF A TWO-WAY ARRAY' , 1956 .

[37]  M. Tweedie.  Statistical Properties of Inverse Gaussian Distributions. II , 1957 .

[38]  D. L. Wallace.  Asymptotic Approximations to Distributions , 1958 .

[39]  Irving John Good,et al.  The Interaction Algorithm and Practical Fourier Analysis , 1958 .

[40]  Albert N. Shiryaev,et al.  On a Method of Calculation of Semi-Invariants , 1959 .

[41]  H. Daniels.  Approximate Solutions of Green's Type for Univariate Stochastic Processes , 1960 .

[42]  E. Beale,et al.  Confidence Regions in Non‐Linear Estimation , 1960 .

[43]  R. R. Bahadur,et al.  On Deviations of the Sample Mean , 1960 .

[44]  I. J. Good,et al.  The Interaction Algorithm and Practical Fourier Analysis: An Addendum , 1960 .

[45]  L. A. Goodman.  On the Exact Variance of Products , 1960 .

[46]  F. J. Anscombe,et al.  Examination of Residuals , 1961 .

[47]  Leo A. Goodman,et al.  The Variance of the Product of K Random Variables , 1962 .

[48]  End Semester Sta,et al.  RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS , 2014 .

[49]  D. F. Lawden.  An introduction to tensor calculus and relativity , 1962 .

[50]  C. C. Heyde,et al.  On a Property of the Lognormal Distribution , 1963 .

[51]  A Combinatorial Method for Products of Two Polykays with Some General Formulae , 1964 .

[52]  Concepts from Tensor Analysis and Differential Geometry , 1965 .

[53]  W. J. Studden,et al.  Tchebycheff Systems: With Applications in Analysis and Statistics. , 1967 .

[54]  N. L. Johnson,et al.  Linear Statistical Inference and Its Applications , 1966 .

[55]  Francis D. Murnaghan,et al.  Finite Deformation of an Elastic Solid , 1967 .

[56]  D. C. Drucker,et al.  Introduction to Mechanics of Deformable Solids , 1967 .

[57]  J. Chambers,et al.  On methods of asymptotic approximation for multivariate distributions. , 1967, Biometrika.

[58]  Some Rules for a Combinatorial Method for Multiple Products of Generalized $k$-Statistics , 1968 .

[59]  D. Fraser.  The Structure of Inference. , 1969 .

[60]  David R. Brillinger,et al.  The calculation of cumulants via conditioning , 1969 .

[61]  K. Mardia.  Measures of multivariate skewness and kurtosis with applications , 1970 .

[62]  H. D. Patterson,et al.  Recovery of inter-block information when block sizes are unequal , 1971 .

[63]  David R. Cox,et al.  The Choice between Alternative Ancillary Statistics , 1971 .

[64]  B. E. Cooper,et al.  Symmetric Function and Allied Tables. , 1967 .

[65]  D. Pierce.  On Some Difficulties in a Frequency Theory of Inference , 1973 .

[66]  Efficiency and estimation in asymptotically normal distributions , 1973 .

[67]  R. W. Wedderburn.  Quasi-likelihood functions, generalized linear models, and the Gauss-Newton method , 1974 .

[68]  B. Efron.  Defining the Curvature of a Statistical Problem (with Applications to Second Order Efficiency) , 1975 .

[69]  P. Bickel,et al.  Using Residuals Robustly I: Tests for Heteroscedasticity, Nonlinearity , 1975 .

[70]  I. Good.  A new formula for cumulants , 1975, Mathematical Proceedings of the Cambridge Philosophical Society.

[71]  G. K. Robinson.  Some counterexamples to the theory of confidence intervals , 1975 .

[72]  R. Rao,et al.  Normal Approximation and Asymptotic Expansions , 1976 .

[73]  A. W. Davis.  Statistical distributions in univariate and multivariate Edgeworth populations , 1976 .

[74]  David Williams,et al.  Improved likelihood ratio tests for complete contingency tables , 1976 .

[75]  I. J. Good,et al.  A New Formula for $k$-Statistics , 1977 .

[76]  J. Kiefer.  Conditional Confidence Statements and Confidence Estimators , 1977 .

[77]  Frederick Mosteller,et al.  Data Analysis and Regression , 1978 .

[78]  R. D. Richtmyer,et al.  Principles of Advanced Mathematical Physics , 1978 .

[79]  S. Stigler.  Francis Ysidro Edgeworth, Statistician , 1978 .

[80]  J. Ghosh,et al.  ON THE VALIDITY OF THE FORMAL EDGEWORTH EXPANSION , 1978 .

[81]  H. W. Peers.  Second-order sufficiency and statistical invariants , 1978 .

[82]  J. L. Folks,et al.  The Inverse Gaussian Distribution and its Statistical Application—A Review , 1978 .

[83]  G. K. Robinson.  On the necessity of Bayesian inference and the construction of measures of nearness to Bayesian form , 1978 .

[84]  B. Efron,et al.  Assessing the accuracy of the maximum likelihood estimator: Observed versus expected Fisher information , 1978 .

[85]  S. D. Grove.  Computational Methods for Data Analysis , 1979 .

[86]  J. F. C. Kingman,et al.  Information and Exponential Families in Statistical Theory , 1980 .

[87]  Sandy L. Zabell,et al.  Large Deviations of the Sample Mean in General Vector Spaces , 1979 .

[88]  R. Michel.  Asymptotic expansions for conditional distributions , 1979 .

[89]  V. Malyshev.  CLUSTER EXPANSIONS IN LATTICE MODELS OF STATISTICAL PHYSICS AND THE QUANTUM THEORY OF FIELDS , 1980 .

[90]  D. Hinkley.  Likelihood as approximate pivotal distribution , 1980 .

[91]  F. Pukelshim,et al.  Multilinear estimation of skewness and kutosis in linear models , 1980 .

[92]  Erich L. Lehmann,et al.  An Interpretation of Completeness and Basu's Theorem , 1981 .

[93]  E. Redish,et al.  Partition combinatorics and multiparticle scattering theory , 1981 .

[94]  T. Willmore.  Total curvature in Riemannian geometry , 1982 .

[95]  R. Buehler.  Some Ancillary Statistics and Their Properties , 1982 .

[96]  C. Morris.  Natural Exponential Families with Quadratic Variance Functions , 1982 .

[97]  S. Amari,et al.  Differential geometry of edgeworth expansions in curved exponential family , 1983 .

[98]  S. G. Machado.  Two statistics for testing for multivariate normality , 1983 .

[99]  A. Takemura.  Tensor Analysis of ANOVA Decomposition , 1983 .

[100]  O. Barndorff-Nielsen.  On a formula for the distribution of the maximum likelihood estimator , 1983 .

[101]  H. Daniels.  Saddlepoint approximations for estimating equations , 1983 .

[102]  O. Barndorff-Nielsen.  On conditionality resolution and the likelihood ratio for curved exponential models , 1984 .

[103]  P. McCullagh.  Tensor notation and cumulants of polynomials , 1984 .

[104]  Donald E. Knuth,et al.  The TEX Book , 1984 .

[105]  D. Cox,et al.  Bartlett Adjustments to the Likelihood Ratio Statistic and the Distribution of the Maximum Likelihood Estimator , 1984 .

[106]  O. Barndorff-Nielsen.  Confidence limits from c|j|1/2 L in the single-parameter case , 1985 .

[107]  Shun-ichi Amari,et al.  Differential-geometrical methods in statistics , 1985 .

[108]  ANCILLARIES SUFFICIENT FOR THE SAMPLE SIZE1 , 1985 .

[109]  Peter McCullagh,et al.  On the asymptotic distribution of pearson's statistic in linear exponential-family models , 1985 .

[110]  David V. Hinkley,et al.  Transformation diagnostics for linear models , 1985 .

[111]  R. Ellis,et al.  Entropy, large deviations, and statistical mechanics , 1985 .

[112]  H. W. Peers,et al.  Asymptotic Expansions for Confidence Limits in the Presence of Nuisance Parameters, with Applications , 1985 .

[113]  I. Skovgaard.  Successive improvement of the order of ancillarity , 1986 .

[114]  Would leibniz lie to you? (three aspects of the affine connection) , 1986 .

[115]  O. Barndorff-Nielsen.  Strings, tensorial combinants, and Bartlett adjustments , 1986, Proceedings of the Royal Society of London. A. Mathematical and Physical Sciences.

[116]  The Pictex manual , 1986 .

[117]  T. Speed.  Cumulants and partition lattices II: generalised k-statistics , 1986, Journal of the Australian Mathematical Society. Series A. Pure Mathematics and Statistics.

[118]  Ib M. Skovgaard,et al.  On Multivariate Edgeworth Expansions , 1986 .

[119]  T. Speed.  Cumulants and partition lattices III: Multiply-indexed arrays , 1986, Journal of the Australian Mathematical Society. Series A. Pure Mathematics and Statistics.

[120]  Peter McCullagh,et al.  Invariants and likelihood ratio statistics , 1986 .

[121]  L. L. Cam,et al.  The Central Limit Theorem Around 1935 , 1986 .

[122]  D. Cox,et al.  The role of differential geometry in statistical theory , 1986 .

[123]  R. R. Bahadur.  Some Limit Theorems in Statistics , 1987 .

[124]  甘利 俊一.  Differential geometry in statistical inference , 1987 .

[125]  J. Nelder,et al.  An extended quasi-likelihood function , 1987 .

[126]  H. E. Daniels,et al.  Tail Probability Approximations , 1987 .

[127]  Daryl Pregibon,et al.  $k$-Statistics and Dispersion Effects in Regression , 1987 .

[128]  Recovery of Ancillary Information , 1988 .

[129]  Nancy Reid,et al.  Saddlepoint Methods and Statistical Inference , 1988 .

[130]  Peter McCullagh,et al.  Complementary set partitions , 1988, Proceedings of the Royal Society of London. A. Mathematical and Physical Sciences.

[131]  J. Ghosh.  Statistics Independent of a Complete Sufficient Statistic , 1988 .

[132]  A. Bonato,et al.  Graphs and Hypergraphs , 2021, Clustering.