Parametrized measure models

This chapter represents the most important technical achievement of this book, a combination of functional analysis and geometry as the natural framework for families of probability measures on general sample spaces. In order to work on such a sample space, one needs a base or reference measure. Other measures, like those in a parametric family, are then described by densities w.r.t. this base measure. Such a base measure, however, is not canonical, and it can be changed by multiplication with an \(L^{1}\)-function. But then, also the description of a parametric family by densities changes. Keeping track of the resulting functorial behavior and pulling it back to the parameter spaces of a parametric family is the key that unlocks the natural functional analytical properties of parametric families. We develop the appropriate differentiability and integrability concepts. In particular, we shall need roots (half-densities) and other fractional powers of densities. For instance, when the sample space is a differentiable manifold, its diffeomorphism group operates isometrically on the space of half-densities with their \(L^{2}\)-product. The latter again yields the Fisher metric. At the end of this chapter, we compare our framework with that of Pistone–Sempi which depends on an analysis of integrability properties under exponentiation.

[1]  B. Efron Defining the Curvature of a Statistical Problem (with Applications to Second Order Efficiency) , 1975 .

[2]  R. Fisher,et al.  On the Mathematical Foundations of Theoretical Statistics , 1922 .

[3]  Giovanni Pistone,et al.  Nonparametric Information Geometry , 2013, GSI.

[4]  K. Fukumizu Algebraic and Geometric Methods in Statistics: Exponential manifold by reproducing kernel Hilbert spaces , 2009 .

[5]  Thomas Friedrich,et al.  Die Fisher‐Information und symplektische Strukturen , 1991 .

[6]  J. Neveu,et al.  Mathematical foundations of the calculus of probability , 1965 .

[7]  J. Moser On the volume elements on a manifold , 1965 .

[8]  O. K. Yoon,et al.  Introduction to differentiable manifolds , 1993 .

[9]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .

[10]  Kim C. Border,et al.  Infinite dimensional analysis , 1994 .

[11]  S. Amari Differential Geometry of Curved Exponential Families-Curvatures and Information Loss , 1982 .

[12]  M. C. Chaki ON STATISTICAL MANIFOLDS , 2000 .

[13]  Miroslav Lovric,et al.  Multivariate Normal Distributions Parametrized as a Riemannian Symmetric Space , 2000 .

[14]  Hông Vân Lê,et al.  The uniqueness of the Fisher metric as information metric , 2013, 1306.1465.

[15]  N. N. Chent︠s︡ov Statistical decision rules and optimal inference , 1982 .

[16]  Paola Siri,et al.  New results on mixture and exponential models by Orlicz spaces , 2016, 1603.05465.

[17]  C. R. Rao,et al.  Information and the Accuracy Attainable in the Estimation of Statistical Parameters , 1992 .

[18]  H. Jeffreys An invariant form for the prior probability in estimation problems , 1946, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[19]  N. Ay,et al.  Information geometry and sufficient statistics , 2012, Probability Theory and Related Fields.

[20]  Giovanni Pistone,et al.  Connections on non-parametric statistical manifolds by Orlicz space geometry , 1998 .

[21]  Martin Bauer,et al.  Uniqueness of the Fisher–Rao metric on the space of smooth densities , 2014, 1411.5577.

[22]  M. Murray,et al.  Differential Geometry and Statistics , 1993 .

[23]  Giovanni Pistone,et al.  An Infinite-Dimensional Geometric Structure on the Space of all the Probability Measures Equivalent to a Given One , 1995 .

[24]  R. F.,et al.  Mathematical Statistics , 1944, Nature.

[25]  N. Čencov Statistical Decision Rules and Optimal Inference , 2000 .

[26]  Nigel J. Newton An infinite-dimensional statistical manifold modelled on Hilbert space , 2012 .

[27]  Shun-ichi Amari,et al.  Differential geometrical theory of statistics , 1987 .

[28]  N. Čencov Algebraic foundation of mathematical statistics 2 , 1978 .