Entropy and information: A multidisciplinary overview

The concept of entropy, from the second law of thermodynamics, has been used by numerous writers on information theory. Basic relationships between entropy, order, information, and meaning have been observed by writers in disciplines as diverse as biology, economics, information science, the arts, and religion. This article, while not attempting comprehensive treatment, cites representative extensions of the concept, including its use as metaphor.

[1]  Henry Adams.  The tendency of history , 1928 .

[2]  Michael F. Lynch,et al.  Variety generation - A reinterpretation of Shannon's mathematical theory of communication, and its implications for information science , 1977, J. Am. Soc. Inf. Sci..

[3]  S. Brown,et al.  Collective oscillations in a plasma , 1968 .

[4]  Wil Lepkowski.  The Social Thermodynamics of Ilya Prigogine. , 1979 .

[5]  Nicholas Georgescu-Roegen,et al.  The Steady State and Ecological Salvation: A Thermodynamic Analysis , 1977 .

[6]  M. Tribus,et al.  Energy and information , 1971 .

[7]  C. Shannon,et al.  The bandwagon (Edtl.) , 1956 .

[8]  Aurel Avramescu,et al.  Coherent Informational Energy and Entropy , 1980, J. Documentation.

[9]  Comments on Discussions of Entropy and Art in Leonardo in 1973 , 1973 .

[10]  Sanford E. Gerber,et al.  Great Ideas in Information Theory, Language and Cybernetics , 1966 .

[11]  Tefko Saracevic,et al.  RELEVANCE: A review of and a framework for the thinking on the notion in information science , 1997, J. Am. Soc. Inf. Sci..

[12]  M. Dutta.  A hundred years of entropy , 1968 .

[13]  Hillary Jay Kelley.  Entropy of Knowledge , 1969, Philosophy of Science.

[14]  S. Polgar,et al.  Evolution and the thermodynamic imperative. , 1961, Human biology.

[15]  L. Szilard.  über die Entropieverminderung in einem thermodynamischen System bei Eingriffen intelligenter Wesen , 1929 .

[16]  John H. Lienhard,et al.  Entropy: A New World View , 1980 .

[17]  James E. Rush,et al.  Toward a theory of indexing—II , 1970 .

[18]  L. Brillouin,et al.  The Negentropy Principle of Information , 1953 .

[19]  Henry Adams,et al.  The Degradation Of The Democratic Dogma , 1919 .

[20]  N. J. T. A. Kramer,et al.  Systems thinking: Concepts and notions , 1977 .

[21]  H. Morowitz,et al.  Energy Flow in Biology , 1969 .

[22]  D. Hofstadter,et al.  Godel, Escher, Bach: An Eternal Golden Braid , 1979 .

[23]  L. Brillouin,et al.  Physical Entropy and Information. II , 1951 .

[24]  James Rettig.  A Theoretical Model and Definition of the Reference Process. , 1978 .

[25]  I. Prigogine.  Time, Structure, and Fluctuations , 1978, Science.

[26]  Wil Lepkowski.  The social thermodynamics of llya Prigogine: 1977 Nobel Prize winner in chemistry explains how his research on nonequilibrium states could lead to new ways of understanding social processes , 1979 .