M.D. I. Estimation via Unconstrained Convex Programming.

A method is presented for obtaining minimum discrimination information (M.D.I.) estimates of probability distributions. This involves using an extremal principle of Charnes and Cooper (1974) and, viewing M.D.I, estimation in a dual convex programming framework. The resulting dual convex program is unconstrained and involves only exponential and linear terms, and hence is easily

[1]  A. Charnes,et al.  An Extremal Principle for Accounting Balance of a Resource Value-Transfer Economy: Existence, Uniqueness and Computation , 1974 .

[2]  Anthony V. Fiacco,et al.  Nonlinear programming;: Sequential unconstrained minimization techniques , 1968 .

[3]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[4]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[5]  Solomon Kullback,et al.  Information Theory and Statistics , 1960 .

[6]  Hirotugu Akaike,et al.  An extension of the method of maximum likelihood and the Stein's problem , 1977 .

[7]  Baruch Lev,et al.  A Maximum Entropy Approach to the Choice of Asset Depreciation , 1978 .

[8]  Philip E. Gill,et al.  Numerical methods for constrained optimization , 1974 .

[9]  Abraham Charnes,et al.  Constrained Information Theoretic Characterizations in Consumer Purchase Behaviour , 1978 .

[10]  S. Kullback,et al.  The Information in Contingency Tables , 1980 .

[11]  A. Charnes,et al.  An extremal and information-theoretic characterization of some interzonal transfer models , 1972 .

[12]  H. Akaike.  A new look at the Bayes procedure , 1978 .

[13]  Michael A. Saunders,et al.  Large-scale linearly constrained optimization , 1978, Math. Program..

[14]  A. Khinchin.  Mathematical foundations of statistical mechanics , 1949 .

[15]  Olvi L. Mangasarian,et al.  Nonlinear Programming , 1969 .

[16]  Rory A. Fisher,et al.  Theory of Statistical Estimation , 1925, Mathematical Proceedings of the Cambridge Philosophical Society.

[17]  A. Charnes,et al.  Extremal Principles and Optimization Dualities for Khinchin-Kullback-Leibler Estimation. , 1978 .

[18]  A Charnes,et al.  A Dual Optimization Framework for Some Problems of Information Theory and Statistics. , 1977 .