The Concept of Entropy in Probability Theory and Its Application in the Theory of Information Transmission Through Communication Channels

A foundation is developed for information theory for a very large class of sources and non-stationary channels with a set of all possible states.