ENTROPY MINIMAX MULTIVARIATE STATISTICAL MODELING—II: APPLICATIONS

Applications of entropy minimax are summarized in three major areas: meteorology, engineering/ materials science, and medicine/biology. The applications cover both discrete patterns in multidimensional spaces of mixed quantitative and qualitative variables, and continuous patterns employing concepts of potential functions and fuzzy entropies. Major achievements of entropy minimax modeling include the first long range weather forecasting models with statistical reliability significantly above chance verified on independent data, the first models of fission gas release and nuclear fuel failure under commercial operating conditions with significant and independently verified statistical reliability, and the first prognosis models in coronary artery disease and in non-Hodgkin's lymphoma with significant predictability verified on independent data. In addition, applications of entropy minimization and maximization separately are reviewed, including feature selection, unsupervised classification, probability es...

[1]  R. Smith,et al.  Statistical patterns of fuel failure in stainless steel clad light water reactor fuel rods , 1985 .

[2]  F. Harrell,et al.  Regression models for prognostic prediction: advantages, problems, and suggested solutions. , 1985, Cancer treatment reports.

[3]  R. Christensen.  ENTROPY MINIMAX MULTIVARIATE STATISTICAL MODELING–I: THEORY , 1985 .

[4]  Hans von Storch,et al.  Statistical Aspects of Estimated Principal Vectors (EOFs) Based on small Sample Sizes , 1985 .

[5]  B. Specker,et al.  Determination of clinical efficacy: nuclear medicine as applied to lung scanning. , 1985, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[6]  E. Potchen,et al.  Application of an information-theoretic method for efficacy assessment. , 1985, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[7]  George J. Klir,et al.  Reconstructability analysis: Aims, results, open problems , 1985 .

[8]  R. F. Eilbert,et al.  Seasonal Precipitation Forecasting with a 6–7 Month Lead Time in the Pacific Northwest Using an Information Theoretic Model , 1985 .

[9]  George J. Klir,et al.  An Empirical Investigation of Reconstructability Analysis: Probabilistic Systems , 1985, Int. J. Man Mach. Stud..

[10]  T. Reichert,et al.  Patterns of survival in advanced non-Hodgkin’s lymphoma , 1985 .

[11]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[12]  F. Harrell,et al.  Regression modelling strategies for improved prognostic prediction. , 1984, Statistics in medicine.

[13]  S. Rosenthal,et al.  Handbook of Cancer Diagnosis and Staging: A Clinical Atlas , 1984 .

[14]  R. A. Christensen,et al.  Performance of the Entropy Minimax Hydrological Forecasts for California, Water Years 1948–1977 , 1983 .

[15]  J. N. Kapur.  Twenty-five years of maximum-entropy principle , 1983 .

[16]  J. Cadzow,et al.  Spectral estimation: An overdetermined rational model equation approach , 1982, Proceedings of the IEEE.

[17]  E. Robinson,et al.  A historical perspective of spectrum estimation , 1982, Proceedings of the IEEE.

[18]  E. Jaynes.  On the rationale of maximum-entropy methods , 1982, Proceedings of the IEEE.

[19]  D. Luenberger,et al.  Estimation of structured covariance matrices , 1982, Proceedings of the IEEE.

[20]  E. Gehan,et al.  Prediction of remission in adult acute leukemia. Development and testing of predictive models , 1982, Cancer.

[21]  G. Was,et al.  Clad Failure Modeling , 1982 .

[22]  Robert M. Gray,et al.  Minimum Cross-Entropy Pattern Classification and Cluster Analysis , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Autoregressive Spectral Estimation, Log Spectral Smoothing, and Entropy. , 1981 .

[24]  R. Fisher,et al.  Factors predicting long-term survival in diffuse mixed, histiocytic, or undifferentiated lymphoma. , 1981, Blood.

[25]  R. A. Christensen,et al.  Successful Hydrologic Forecasting for California Using an Information Theoretic Model , 1981 .

[26]  T. P. Barnett,et al.  Statistical Prediction of North American Air Temperatures from Pacific Predictors , 1981 .

[27]  R. A. Christensen,et al.  Temperature profiles in UO2 fuel under direct electric heating conditions , 1981 .

[28]  J. Kalbfleisch,et al.  The Statistical Analysis of Failure Time Data , 1980 .

[29]  B. Roy Frieden,et al.  Statistical models for the image restoration problem , 1980 .

[30]  Clifford Ambrose Truesdell,et al.  The tragicomical history of thermodynamics, 1822-1854 , 1980 .

[31]  S. Haykin.  Nonlinear Methods of Spectral Analysis , 1980 .

[32]  I. Good,et al.  The Maximum Entropy Formalism. , 1979 .

[33]  F. Harrell,et al.  Survival in medically treated coronary artery disease. , 1979, Circulation.

[34]  R. Bukowski,et al.  Prognostic factors affecting remission, remission duration, and survival in adult acute nonlymphocytic leukemia , 1979, Cancer.

[35]  K. Hasselmann,et al.  Techniques of Linear Prediction, With Application to Oceanic and Atmospheric Fields in the Tropical Pacific (Paper 9R0319) , 1979 .

[36]  G. N. Minerbo,et al.  MENT: A maximum entropy algorithm for reconstructing a source from projection data , 1979 .

[37]  K. Hammermeister,et al.  Variables predictive of survival in patients with coronary disease. Selection by univariate and multivariate analyses from the clinical, electrocardiographic, exercise, arteriographic, and quantitative angiographic evaluations. , 1979, Circulation.

[38]  Ronald A. Christensen,et al.  Automatic Phase Alignment for the Karhunen-Loève Expansion , 1979, IEEE Transactions on Biomedical Engineering.

[39]  Michael Webber.  Information theory and urban spatial structure , 1979 .

[40]  Yair Censor,et al.  RELAXATIONAL METHODS FOR LARGE-SCALE ENTROPY OPTIMIZATION PROBLEMS, WITH APPLICATION IN IMAGE RECONSTRUCTION , 1979 .

[41]  S. Haykin,et al.  Prediction-Error Filtering and Maximum-Entropy Spectral Estimation (With 16 Figures) , 1979 .

[42]  E. T. Jaynes,et al.  Where do we Stand on Maximum Entropy , 1979 .

[43]  R. Madden,et al.  Estimates of the Natural Variability of Time-Averaged Temperatures over the United States , 1978 .

[44]  C. E. Leith,et al.  Predictability of climate , 1978, Nature.

[45]  T. P. Barnett,et al.  Multifield Analog Prediction of Short-Term Climate Fluctuations Using a Climate State vector , 1978 .

[46]  R K Blashfield,et al.  The Literature On Cluster Analysis. , 1978, Multivariate behavioral research.

[47]  A. Bruschke,et al.  Natural history of obstructive coronary artery disease: ten-year study of 601 nonsurgical cases. , 1978, Progress in cardiovascular diseases.

[48]  Donald G. Childers,et al.  Modern Spectrum Analysis , 1978 .

[49]  Jerome Namias,et al.  Multiple Causes of the North American Abnormal Winter 1976–77 , 1978 .

[50]  Baruch Lev,et al.  A Maximum Entropy Approach to the Choice of Asset Depreciation , 1978 .

[51]  Sidney Oldberg,et al.  Dealing with Uncertainty in Fuel Rod Modeling , 1978 .

[52]  R. Kikuchi,et al.  Maximum entropy image restoration. I. The entropy expression , 1977 .

[53]  A. Bartolucci,et al.  BCNU with and without cyclophosphamide, vincristine, and prednisone (COP) and cycle-active therapy in non-Hodgkin's lymphoma. , 1977, Cancer treatment reports.

[54]  William H. Barker,et al.  Information Theory and the Optimal Detection Search , 1977, Oper. Res..

[55]  E. Kalnay-Rivas,et al.  The 4th order GISS model of the global atmosphere , 1977 .

[56]  C. F. Barton.  Computerized axial tomography for neutron radiography of nuclear fuel , 1977 .

[57]  R. Davis,et al.  Techniques for statistical analysis and prediction of geophysical fluid systems , 1977 .

[58]  Silviu Guiaşu,et al.  Information theory with applications , 1977 .

[59]  René Thom,et al.  Structural stability and morphogenesis , 1977, Pattern Recognit..

[60]  R. A. Madden,et al.  Estimates of the Natural Variability of Time-Averaged Sea-Level Pressure , 1976 .

[61]  Svante Wold,et al.  Pattern recognition by means of disjoint principal components models , 1976, Pattern Recognit..

[62]  Elias P. Gyftopoulos,et al.  A unified quantum theory of mechanics and thermodynamics. Part I. Postulates , 1976 .

[63]  R. Jenne,et al.  Estimates of Seasonal Mean Temperature, Using Persistence between Seasons , 1975 .

[64]  Calyampudi R. Rao,et al.  Characterization Problems in Mathematical Statistics , 1975 .

[65]  T. Ulrich,et al.  Maximum entropy spectral analy-sis and autoregressive decomposition , 1975 .

[66]  J. Parker,et al.  Prognosis in Coronary Artery Disease: Angiographic, Hemodynamic, and Clinical Factors , 1975, Circulation.

[67]  D. Gokhale.  Maximum Entropy Characterizations of Some Distributions , 1975 .

[68]  B. S. Duran,et al.  Cluster Analysis: A Survey , 1976 .

[69]  C. D. Barry,et al.  Comparison of predicted and experimentally determined secondary structure of adenyl kinase , 1974, Nature.

[70]  R. Rosati,et al.  The Nature of Treatment Selection in Coronary Artery Disease: Experience with Medical and Surgical Treatment of a Chronic Disease , 1974, Circulation.

[71]  J. Herniter,et al.  A Comparison of the Entropy Model and the Hendry Model , 1974 .

[72]  Frank M. Bass,et al.  The Theory of Stochastic Preference and Brand Switching , 1974 .

[73]  John M. Cozzolino,et al.  The Maximum-Entropy Distribution of the Future Market Price of a Stock , 1973, Oper. Res..

[74]  J. Herniter.  An Entropy Model of Brand Purchase Behavior , 1973 .

[75]  C. E. Leith,et al.  The Standard Error of Time-Average Estimates of Climatic Means , 1973 .

[76]  A. Wragg,et al.  Maximum-entropy distributions having prescribed first and second moments (Corresp.) , 1973, IEEE Trans. Inf. Theory.

[77]  Cesar A. Caceres.  The case against electrocardiographic automation , 1973, Computer.

[78]  B. J. Wrona,et al.  First Report on Apparatus to Simulate In-Reactor Transient Heating Conditions in Oxide Fuel Columns , 1973 .

[79]  S. P. Evans.  A relationship between the gravity model for trip distribution and the transportation problem in linear programming , 1973 .

[80]  Michael M. Fitelson,et al.  Notes on maximum-entropy processing (Corresp.) , 1973, IEEE Trans. Inf. Theory.

[81]  Ronald G. Matteson,et al.  Computer Processing for Data Communications , 1973, Computer.

[82]  Joseph P. Noonan,et al.  The Mutual Information Principle and Applications , 1973, Inf. Control..

[83]  L. L. Gatlin.  The entropy maximum of protein , 1972 .

[84]  J. Burg.  THE RELATIONSHIP BETWEEN MAXIMUM ENTROPY SPECTRA AND MAXIMUM LIKELIHOOD SPECTRA , 1972 .

[85]  B. Frieden.  Restoring with maximum likelihood and maximum entropy. , 1972, Journal of the Optical Society of America.

[86]  J. Lisman,et al.  Note on the generation of most probable frequency distributions , 1972 .

[87]  M. Bad,et al.  L'algorithme le plus rationnel de reconnaissance appliqué dans le diagnostic des maladies rénales. , 1972 .

[88]  A. Monin,et al.  Weather forecasting as a problem in physics , 1972 .

[89]  D. Cox.  Regression Models and Life-Tables , 1972 .

[90]  The amount of information stored in proteins and other short biological code sequences , 1972 .

[91]  Lila L. Gatlin,et al.  Information theory and the living system , 1972 .

[92]  J. L. King.  The role of mutation in evolution , 1972 .

[93]  Adriaan van den Bos,et al.  Alternative interpretation of maximum entropy spectral analysis (Corresp.) , 1971, IEEE Trans. Inf. Theory.

[94]  R. M. Cormack,et al.  A Review of Classification , 1971 .

[95]  R S Bell,et al.  The utility and futility of radiographic skull examination for trauma. , 1971, The New England journal of medicine.

[96]  A. Hobson.  Concepts in statistical mechanics , 1971 .

[97]  G. Herman,et al.  Algebraic reconstruction techniques (ART) for three-dimensional electron microscopy and x-ray photography. , 1970, Journal of theoretical biology.

[98]  F. Snickars,et al.  Derivation of the Negative Exponential Model by an Entropy Maximising Method , 1970 .

[99]  L. Campbell.  Equivalence of Gauss's Principle and Minimum Discrimination Information Estimation of Probabilities , 1970 .

[100]  A. Wragg,et al.  Fitting continuous probability density functions over [0,∞) using information theory ideas (Corresp.) , 1970, IEEE Trans. Inf. Theory.

[101]  Clinical Electrocardiography And Computers , 1970 .

[102]  A. Goldin,et al.  PRECLINICAL INVESTIGATION OF ALKYLATING AGENTS IN CANCER CHEMOTHERAPY , 1969 .

[103]  Enrique H. Ruspini,et al.  A New Approach to Clustering , 1969, Inf. Control..

[104]  Temple F. Smith.  The genetic code, information density, and evolution , 1969 .

[105]  Satosi Watanabe,et al.  Knowing and guessing , 1969 .

[106]  M. Tribus.  Rational descriptions, decisions, and designs , 1969 .

[107]  George W. Bruyn,et al.  Brain's diseases of the nervous system , 1969 .

[108]  A. Goldin,et al.  Relation of structure of purine and pyrimidine nucleosides to antitumor activity. , 1968, Cancer chemotherapy reports. Part 2.

[109]  Edwin T. Jaynes,et al.  Prior Probabilities , 1968, Encyclopedia of Machine Learning.

[110]  C. S. Wallace,et al.  An Information Measure for Classification , 1968, Comput. J..

[111]  Nelson M. Blachman,et al.  The amount of information that y gives about X , 1968, IEEE Trans. Inf. Theory.

[112]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[113]  E. Patrassi.  Die wärmeleitfähigkeit von urandioxid bei sehr hohen temperaturgradienten , 1967 .

[114]  Strother H. Walker,et al.  Estimation of the probability of an event as a function of several independent variables. , 1967, Biometrika.

[115]  D. F. Morrison,et al.  Multivariate Statistical Methods , 1968 .

[116]  E. Jaynes.  Foundations of Probability Theory and Statistical Mechanics , 1967 .

[117]  J. P. Burg,et al.  Maximum entropy spectral analysis. , 1967 .

[118]  A. Katz.  Principles of statistical mechanics : the information theory approach , 1967 .

[119]  W. H. Pearson.  Estimation of a correlation coefficient from an uncertainty measure , 1966, Psychometrika.

[120]  O. V. Mering,et al.  The Diagnosis of Problem Patients , 1966 .

[121]  L. L. Gatlin,et al.  The information content of DNA. , 1966, Journal of theoretical biology.

[122]  Pipberger Hv.  Computer analysis of electrocardiograms. , 1966, Canadian hospital.

[123]  Calyampudi R. Rao,et al.  Linear Statistical Inference and Its Applications. , 1975 .

[124]  L. Szilard.  On the decrease of entropy in a thermodynamic system by the intervention of intelligent beings. , 1964, Behavioral science.

[125]  I. Good.  Maximum Entropy for Hypothesis Formulation, Especially for Multidimensional Contingency Tables , 1963 .

[126]  Jay Edie,et al.  PATTERN RECOGNITION RESEARCH , 1963 .

[127]  C. B. Bell.  Mutual Information and Maximal Correlation as Measures of Dependence , 1962 .

[128]  Philip M. Lewis,et al.  The characteristic selection problem in recognition systems , 1962, IRE Trans. Inf. Theory.

[129]  M. Tribus.  Information Theory as the Basis for Thermostatics and Thermodynamics , 1961 .

[130]  H. Pipberger,et al.  Automatic Screening of Normal and Abnormal Electrocardiograms by Means of a Digital Electronic Computer.∗ , 1961, Proceedings of the Society for Experimental Biology and Medicine. Society for Experimental Biology and Medicine.

[131]  Myron Tribus,et al.  Thermostatics and thermodynamics : an introduction to energy, information and states of matter, with engineering applications , 1961 .

[132]  J. Richardson.  The hydrodynamical equations of a one component system derived from nonequilibrium statistical mechanics , 1960 .

[133]  H. Merritt,et al.  A Textbook of Neurology , 1960 .

[134]  S. Kullback.  Information Theory and Statistics , 1959 .

[135]  Philip M. Lewis,et al.  Approximating Probability Distributions to Reduce Storage Requirements , 1959, Information and Control.

[136]  E. Kaplan,et al.  Nonparametric Estimation from Incomplete Observations , 1958 .

[137]  E. Jaynes.  Information Theory and Statistical Mechanics , 1957 .

[138]  E. H. Linfoot.  An Informational Measure of Correlation , 1957, Inf. Control..

[139]  P. D. Thompson.  A Heuristic Theory of Large-Scale Turbulence and Long-Period Velocity Variations in Barotropic Flow , 1957 .

[140]  D. Ter Haar,et al.  Elements of Statistical Mechanics , 1954 .

[141]  L. Brillouin,et al.  The Negentropy Principle of Information , 1953 .

[142]  A. C. Thomson,et al.  Generalized Statistical Mechanics and the Onsager Relations , 1953 .

[143]  S. Kullback,et al.  AN APPLICATION OF INFORMATION THEORY TO MULTIVARIATE ANALYSIS, II , 1952 .

[144]  P. M. Woodward,et al.  Information theory and inverse probability in telecommunication , 1952 .

[145]  L. Brillouin.  Maxwell's Demon Cannot Operate: Information and Entropy. I , 1951 .

[146]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[147]  Glenn W. Brier,et al.  Verification of Weather Forecasts , 1951 .

[148]  Scott Rw.  PROGNOSIS in coronary artery disease. , 1951, Medical world.

[149]  L. J. Savage,et al.  Probability and the weighing of evidence , 1951 .

[150]  H. Jeffreys.  An invariant form for the prior probability in estimation problems , 1946, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[151]  M. Bartlett.  Further aspects of the theory of multiple regression , 1938, Mathematical Proceedings of the Cambridge Philosophical Society.

[152]  W. Elsasser.  On Quantum Measurements and the Role of the Uncertainty Relations in Statistical Mechanics , 1937 .

[153]  Harold Jeffreys,et al.  Further significance tests , 1936, Mathematical Proceedings of the Cambridge Philosophical Society.

[154]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[155]  H. Hotelling.  Analysis of a complex of statistical variables into principal components. , 1933 .

[156]  G N Lewis,et al.  THE SYMMETRY OF TIME IN PHYSICS. , 1930, Science.

[157]  P. Heidke,et al.  Berechnung Des Erfolges Und Der Güte Der Windstärkevorhersagen Im Sturmwarnungsdienst , 1926 .

[158]  H. Jeffreys.  The Theory of Probability , 1896 .