Legendre transform structure and extremal properties of the relative Fisher information

Abstract Variational extremization of the relative Fisher information (RFI, hereafter) is performed. Reciprocity relations, akin to those of thermodynamics are derived, employing the extremal results of the RFI expressed in terms of probability amplitudes. A time independent Schrodinger-like equation (Schrodinger-like link) for the RFI is derived. The concomitant Legendre transform structure (LTS, hereafter) is developed by utilizing a generalized RFI-Euler theorem, which shows that the entire mathematical structure of thermodynamics translates into the RFI framework, both for equilibrium and non-equilibrium cases. The qualitatively distinct nature of the present results vis-a-vis those of prior studies utilizing the Shannon entropy and/or the Fisher information measure (FIM, hereafter) is discussed. A principled relationship between the RFI and the FIM frameworks is derived. The utility of this relationship is demonstrated by an example wherein the energy eigenvalues of the Schrodinger-like link for the RFI are inferred solely using the quantum mechanical virial theorem and the LTS of the RFI.

[1]  Walter Greiner,et al.  Quantum Mechanics: An Introduction , 1989 .

[2]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[3]  Takuya Yamano,et al.  Phase space gradient of dissipated work and information: A role of relative Fisher information , 2013, 1311.2176.

[4]  Flavia Pennini,et al.  The Frieden-Soffer principle and wave functions that maximize Shannon's measure , 1997 .

[5]  Piotr Garbaczewski,et al.  Shannon versus Kullback-Leibler Entropies in Nonequilibrium Random Motion , 2005, cond-mat/0504115.

[6]  Robert A. Gatenby,et al.  Exploratory Data Analysis Using Fisher Information , 2006 .

[7]  Plastino,et al.  Information theory and Riemann spaces: An invariant reformulation. , 1985, Physical review. A, General physics.

[8]  R. Fisher,et al.  On the Mathematical Foundations of Theoretical Statistics , 1922 .

[9]  Sergio Verdú Mismatched estimation and relative entropy , 2010, IEEE Trans. Inf. Theory.

[10]  E. Carlen,et al.  Entropy production by block variable summation and central limit theorems , 1991 .

[11]  C. Villani,et al.  Generalization of an Inequality by Talagrand and Links with the Logarithmic Sobolev Inequality , 2000 .

[13]  J. Linnett,et al.  Quantum mechanics , 1975, Nature.

[14]  Giuseppe Savaré,et al.  The Wasserstein Gradient Flow of the Fisher Information and the Quantum Drift-diffusion Equation , 2009 .

[15]  S. Kullback,et al.  Information Theory and Statistics , 1959 .

[16]  Gordon Blower Random Matrices: High Dimensional Phenomena: Contents , 2009 .

[17]  B H Soffer,et al.  Fisher-based thermodynamics: its Legendre transform and concavity properties. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[18]  S. Kullback,et al.  A Note on Minimum Discrimination Information , 1966 .

[19]  C. Villani Topics in Optimal Transportation , 2003 .

[20]  General dynamical invariants for time-dependent Hamiltonians. , 1987, Physical review. A, General physics.

[21]  B. Frieden Science from Fisher Information , 2004 .

[22]  Takuya Yamano,et al.  de Bruijn-type identity for systems with flux , 2013, 1310.2812.

[23]  P. Sánchez-Moreno,et al.  Jensen divergence based on Fisher’s information , 2010, ArXiv.

[24]  Melville S. Green Principles of Statistical Mechanics. The Information Theory Approach. Amnon Katz. Freeman, San Francisco, 1967. xii + 188 pp., illus. $8 , 1968 .

[25]  Hiroaki Yoshida,et al.  An Integral Representation of the Relative Entropy , 2012, Entropy.

[26]  J. S. Dehesa,et al.  Fisher information of special functions and second-order differential equations , 2008 .

[27]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[28]  D. Vernon Inform , 1995, Encyclopedia of the UN Sustainable Development Goals.

[29]  A. R. Plastino,et al.  Special features of the relation between Fisher information and Schrödinger eigenvalue equation , 2011 .

[30]  Shlomo Shamai,et al.  The Interplay Between Information and Estimation Measures , 2013, Found. Trends Signal Process..