Entropy in communication and chemical systems

Entropy plays a central role in communication systems. On the one hand, the objective of communication is to reduce the entropy of some random variable. On the other hand, many useful models of communication networks evolve to a state of maximum entropy given external constraints. Chemical systems also exhibit a similar entropy-maximizing property, as do many systems of interacting particles. This paper reviews this set of fundamental ideas.

[1]  Anthony Unwin,et al.  Reversibility and Stochastic Networks , 1980 .

[2]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[3]  Leonard Kleinrock,et al.  Mean Packet Queueing Delay in a Buffered Two-User CSMA/CD System , 1985, IEEE Trans. Commun..

[4]  Jean C. Walrand,et al.  A Distributed CSMA Algorithm for Throughput and Utility Maximization in Wireless Networks , 2010, IEEE/ACM Transactions on Networking.

[5]  Peter Whittle,et al.  Systems in stochastic equilibrium , 1986 .

[6]  Leonard Kleinrock,et al.  Queueing Systems: Volume I-Theory , 1975 .

[7]  S. Wittevrongel,et al.  Queueing Systems , 2019, Introduction to Stochastic Processes and Simulation.

[8]  Thomas M. Cover,et al.  Elements of Information Theory: Cover/Elements of Information Theory, Second Edition , 2005 .

[9]  Koushik Kar,et al.  Throughput modelling and fairness issues in CSMA/CA based ad-hoc networks , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..