INFORMATION TRANSMISSION THEORY

Abstract : The theory of information transmission deals with the construction of methods for the coding and decoding of messages and signals with the object of transmitting them along communication channels, and the establishment of principles for the comparison of the effectiveness, noiseproof feature and feasibility of these methods. The principles of this theory are discussed: the conditions under which the transmission of information is possible; the information-theory aspects of the theory of information transmission and certain pertinent mathematical works are specified. In statistical coding the principal problems are: discretization messages; measurement of statistical properties of messages and statistical coding, i.e., the reduction of the sequence of digits by utilizing the statistical properties of messages.