Claude Shannon: Biologist [information theory used in biology]

Claude Shannon founded information theory in the 1940s. The theory has long been known to be closely related to thermodynamics and physics through the similarity of Shannon's uncertainty measure to the entropy function. Recent work using information theory to understand molecular biology has unearthed a curious fact: Shannon’s channel capacity theorem only applies to living organisms and their products, such as communications channels and molecular machines that make choices from several possibilities. Since he used a property of biology to formulate his mathematics, the author concludes that Claude Shannon was doing biology and was therefore, effectively, a biologist - although he was probably unaware of it. What are the implications of the idea that Shannon was doing biology? First, the author claims it means that communications systems and molecular biology are headed on a collision course. As electrical circuits approach molecular sizes, the results of molecular biologists can be used to guide designs. We might envision a day when communications and biology are treated as a single field. Second, codes discovered for communications potentially teach us new biology if we find the same codes in a biological system. Finally, the reverse is also to be anticipated: discoveries in molecular biology about systems that have been refined by evolution for billions of years should tell us how to build new and more efficient communications systems.

[1]  E. Guizzo,et al.  Closing in on the perfect code [turbo codes] , 2004, IEEE Spectrum.

[2]  T. D. Schneider,et al.  Theory of molecular machines. I. Channel capacity of molecular machines. , 1991, Journal of theoretical biology.

[3]  Aaron D. Wyner,et al.  Claude E. Shannon , 1993 .

[4]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[5]  T. D. Schneider,et al.  Features of spliceosome evolution and function inferred from an analysis of the information at human splice sites. , 1992, Journal of molecular biology.

[6]  T. D. Schneider,et al.  Information content of binding sites on nucleotide sequences. , 1986, Journal of molecular biology.

[7]  H. Callen Thermodynamics and an Introduction to Thermostatistics , 1988 .

[8]  A. Glavieux,et al.  Near Shannon limit error-correcting coding and decoding: Turbo-codes. 1 , 1993, Proceedings of ICC '93 - IEEE International Conference on Communications.

[9]  T. D. Schneider,et al.  Using sequence logos and information analysis of Lrp DNA binding sites to investigate discrepancies between natural selection and SELEX. , 1999, Nucleic acids research.

[10]  Heinz Zemanek,et al.  Claude E. Shannon (1916–2001) (Claude E. Shannon (1916–2001)) , 2001, Informationstechnik Tech. Inform..

[11]  T. D. Schneider,et al.  Molecular flip-flops formed by overlapping Fis sites. , 2003, Nucleic acids research.

[12]  T. D. Schneider,et al.  Sequence logos, machine/channel capacity, Maxwell's demon, and molecular computers: a review of the theory of molecular machines , 1994 .

[13]  T. D. Schneider,et al.  Information analysis of human splice site mutations , 1998, Human mutation.

[14]  T. D. Schneider,et al.  Information analysis of Fis binding sites. , 1997, Nucleic acids research.

[15]  T. D. Schneider,et al.  Theory of molecular machines. II. Energy dissipation from molecular machines. , 1991, Journal of theoretical biology.

[16]  Aaron D. Wyner,et al.  Claude Elwood Shannon: Collected Papers , 1993 .

[17]  P K Rogan,et al.  Using information content and base frequencies to distinguish mutations from genetic polymorphisms in splice junction recognition sites , 1995, Human mutation.

[18]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[19]  Thomas D. Schneider,et al.  OxyR and SoxRS Regulation offur , 1999, Journal of bacteriology.

[20]  T. D. Schneider,et al.  Anatomy of Escherichia coli ribosome binding sites. , 2001, Journal of molecular biology.

[21]  N. Sloane,et al.  Obituary: Claude Shannon (1916–2001) , 2001, Nature.