A Brief Touch on Information Theory

Our last topic in this book consists of a very brief description on the relation between statistical physics and information theory, a research field pioneered by Claude Elwood Shannon (1916–2001), whose seminal paper “A Mathematical Theory of communications” (1948) has established the corner–stone of this field.