Multiplex signal transmission and the development of sampling techniques: the work of Herbert Raabe in contrast to that of Claude Shannon

This article discusses the interplay between multiplex signal transmission in telegraphy and telephony, and sampling methods. It emphasizes the works of Herbert Raabe (1909–2004) and Claude Shannon (1916–2001) and the context in which they occurred. Attention is given to the role that the exceptional research atmosphere in Berlin during the 1920s and early 1930s played in the development of some of the ideas underlying these works, first in Germany and then in the USA, as some of the protagonists moved there. Raabe's thesis, published in 1939, describes and analyses a time-division multiplex system for telephony. In order to build his working prototype, Raabe had to develop the theoretical tools he needed and achieved a thorough understanding of sampling, including sampling with pulses of finite duration and sampling of low-pass and band-pass signals. His condition for reconstruction was known as ‘Raabe's condition’ in the German literature of the time. On the other hand, Shannon's works of 1948 and 1949 contain the classical sampling theorem, but go much further and lay down the abstract theoretical framework that underlies much of the modern digital communications. It is interesting to compare Raabe's very practical approach with Shannon's abstract work: Raabe independently developed his methods to the degree he needed, but his main purpose was to build a working prototype. Shannon, on the other hand, approached sampling independently of practical constraints, as part of information theory – which became tremendously influential.

[1]  Gertrud Weiss Szilard,et al.  The Collected Works of Leo Szilard: Scientific Papers , 1974 .

[2]  D. Petz Entropy, von Neumann and the von Neumann Entropy , 2001 .

[3]  C. Shannon,et al.  The bandwagon (Edtl.) , 1956 .

[4]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[5]  Pesi Rustom Masani,et al.  Norbert Wiener - 1894-1964 , 1989, The Journal of nervous and mental disease.

[6]  J. M. Whittaker The “Fourier” Theory of the Cardinal Function , 1928 .

[7]  Aaron D. Wyner,et al.  Claude Elwood Shannon: Collected Papers , 1993 .

[8]  D. Petz Quantum Information Theory and Quantum Statistics , 2007 .

[9]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series, with Engineering Applications , 1949 .

[10]  ε-Entropie und ε-Kapazität von Mengen in Funktionalräumen , 1960 .

[11]  J. Crow,et al.  Shannon's brief foray into genetics. , 2001, Genetics.

[12]  B.M. Oliver,et al.  The Philosophy of PCM , 1948, Proceedings of the IRE.

[13]  W. R. Bennett,et al.  Spectra of quantized signals , 1948, Bell Syst. Tech. J..

[14]  John Auwaerter Data transmission , 1970, ACM '70.

[15]  Anton A. Huurdeman The worldwide history of telecommunications , 2003 .

[16]  Prashant Parikh A Theory of Communication , 2010 .

[17]  Gertrud Weiss Szilard,et al.  Leo Szilard: His Version of the Facts , 1978 .

[18]  Paul E. Ceruzzi,et al.  A history of modern computing , 1999 .

[19]  Wolfgang Splettstösser Über die Approximation stetiger Funktionen durch die klassischen und durch neue Abtastsummen mit Fehlerabschätzungen , 1977 .

[20]  Ana Millán Gasca,et al.  The World as a Mathematical Game , 2009 .

[21]  F. H. Adler Cybernetics, or Control and Communication in the Animal and the Machine. , 1949 .

[22]  R. F. W. Coates Modern communication systems , 1975 .

[23]  Aaron D. Wyner,et al.  Claude E. Shannon , 1993 .

[24]  Claude E. Shannon,et al.  Communication theory - Exposition of fundamentals , 1953, Trans. IRE Prof. Group Inf. Theory.

[25]  Chris Bissell Karl Küpfmüller, 1928: an early time-domain, closed-loop, stability criterion , 2006 .

[26]  Paul C. Shields,et al.  The Interactions Between Ergodic Theory and Information Theory , 1998, IEEE Trans. Inf. Theory.

[27]  W. McCulloch Recollections of the Many Sources of Cybernetics , 1974 .

[28]  Gertrud Weiss Szilard,et al.  Leo Szilard: His Version of the Facts: Selected Recollections and Correspondence , 1980 .

[29]  John von Neumann,et al.  Theory Of Self Reproducing Automata , 1967 .

[30]  J. Benedetto,et al.  Modern Sampling Theory: Mathematics and Applications , 2012 .

[31]  William Aspray,et al.  John von Neumann and the origins of modern computing , 1990, History of computing.

[32]  Claude E. Shannon,et al.  A symbolic analysis of relay and switching circuits , 1938, Transactions of the American Institute of Electrical Engineers.

[33]  William R. Bennett,et al.  Introduction to signal transmission , 1970 .

[34]  M. Tribus,et al.  Energy and information , 1971 .

[35]  H. Nyquist,et al.  Certain Topics in Telegraph Transmission Theory , 1928, Transactions of the American Institute of Electrical Engineers.

[36]  C. Shannon Von Neumann's contributions to automata theory , 1958 .

[37]  J. M. Whittaker Interpolatory function theory , 1935 .

[38]  W. R. Bennett,et al.  Time division multiplex systems , 1941 .

[39]  Edmund Taylor Whittaker XVIII.—On the Functions which are represented by the Expansions of the Interpolation-Theory , 1915 .

[40]  Erico Marui Guizzo,et al.  The essential message : Claude Shannon and the making of information theory , 2003 .

[41]  Walt Kester,et al.  The data conversion handbook , 2005 .

[42]  Robert G. Gallager,et al.  Claude E. Shannon: A retrospective on his life, work, and impact , 2001, IEEE Trans. Inf. Theory.

[43]  Paul L. Butzer,et al.  An Introduction to Sampling Analysis , 2001 .

[44]  Mill Johannes G.A. Van,et al.  Transmission Of Information , 1961 .

[45]  S. Rice Mathematical analysis of random noise , 1944 .

[46]  A. Robert Calderbank,et al.  The Art of Signaling: Fifty Years of Coding Theory , 1998, IEEE Trans. Inf. Theory.

[47]  Eugène Rouché Sur l'interpolation , 1859 .

[48]  L. Szilard über die Entropieverminderung in einem thermodynamischen System bei Eingriffen intelligenter Wesen , 1929 .

[49]  C. Shannon,et al.  An algebra for theoretical genetics , 1940 .

[50]  Michael E. Gorman,et al.  Invention: The Care and Feeding of Ideas , 1993 .

[51]  C. C. Bissell Karl Küpfmüller: a German contributor to the early development of linear systems theory , 1986 .

[52]  John R. Pierce,et al.  Symbols, Signals, and Noise: The Nature and Process of Communication. , 1961 .

[53]  J. Favard,et al.  Sur l'interpolation , 1939 .

[54]  C. Bissell Karl Kupfmuller, 1928 , 2006, IEEE Control Systems.

[55]  G. W. Dunnington,et al.  Carl Friedrich Gauss: Titan of Science , 1956 .

[56]  Kcstcr The Data Conversion Handbook , 2007 .

[57]  J. R. Carson Notes on the Theory of Modulation , 1922, Proceedings of the Institute of Radio Engineers.

[58]  Phillip A. Laplante,et al.  Anecdotes , 2006, IEEE Ann. Hist. Comput..

[59]  R.M. Gray,et al.  Communication systems: An introduction to signals and noise in electrical communication , 1976, Proceedings of the IEEE.

[60]  Mark Semenovich Pinsker,et al.  Kolmogorov remembered , 1988, IEEE Trans. Inf. Theory.

[61]  Sergio Verdú,et al.  Fifty Years of Shannon Theory , 1998, IEEE Trans. Inf. Theory.

[62]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[63]  George L. Turin,et al.  The theory of optimum noise immunity , 1959 .

[64]  A. Rex,et al.  Maxwell's demon 2: entropy, classical and quantum information, computing , 2002 .

[65]  Richard G. Hewlett,et al.  Genius in the Shadows: A Biography of Leo Szilard-The Man behind the Bomb@@@The Rickover Effect: How One Man Made a Difference , 1994 .

[66]  G. I. Khudiakov Sampling theorem in signal theory and its originators , 2008 .

[67]  R. L. Stens,et al.  The Shannon sampling series and the reconstruction of signals in terms of linear, quadratic and cubic splines , 1986 .

[68]  L. Brillouin,et al.  Science and information theory , 1956 .

[69]  A. Shiryaev,et al.  Andrei Nikolaevich Kolmogorov , 2004 .

[70]  G. W. Dunnington,et al.  "Carl Friedrich Gauss, Titan of Science - A Study of his Life and Work", G. Waldo Dunnington, New York 1955 : [recenzja] / Stanisław Dobrzycki. , 1955 .

[71]  J. I The Design of Experiments , 1936, Nature.

[72]  Hans-Dieter Lüke,et al.  The origins of the sampling theorem , 1999, IEEE Commun. Mag..

[73]  R. L. Stens,et al.  Error Estimates for Sampling Sums Based on Convolution Integrals , 1980, Inf. Control..

[74]  Roland L. Dobrushin Survey of Soviet research in information theory , 1972, IEEE Trans. Inf. Theory.

[75]  H. Nyquist,et al.  The Regeneration Theory , 1954, Journal of Fluids Engineering.

[76]  J. R. Higgins,et al.  Five short stories about the cardinal series , 1985 .

[77]  R. Hartley A More Symmetrical Fourier Analysis Applied to Transmission Problems , 1942, Proceedings of the IRE.

[78]  Daniel J. Costello,et al.  Channel coding: The road to channel capacity , 2006, Proceedings of the IEEE.

[79]  J. Neumann Thermodynamik quantenmechanischer Gesamtheiten , 1927 .

[80]  Toby Berger,et al.  Andrei Nikolaevich Kolmogorov (April 25, 1903-October 20, 1987) , 1988, IEEE Trans. Inf. Theory.

[81]  R. Grass,et al.  Carl Friedrich Gauss: Titan of Science , 1956 .

[82]  S. Mccartney ENIAC: The Triumphs and Tragedies of the World's First Computer , 1999 .

[83]  Klaus Hentschel,et al.  Pesi Rustom Masani, Norbert Wiener, 1894 - 1964 : Basel ..., Birkhäuser, 1990; [Rezension] , 1991 .

[84]  Werner Ebeling,et al.  Statistical Thermodynamics and Stochastic Theory of Nonequilibrium Systems , 2005 .

[85]  L. Szilard On the decrease of entropy in a thermodynamic system by the intervention of intelligent beings. , 1964, Behavioral science.

[86]  István Hargittai,et al.  The Martians of Science: Five Physicists Who Changed the Twentieth Century , 2006 .

[87]  J. C. Oxtoby,et al.  John von Neumann 1903-1957 , 1958 .

[88]  E. Fels Kolmogoroff, A.N., und W. M. Tichomirow: ε‐Entropie und ε‐Kapazität von Mengen in Funktionalräumen. Arbeiten zur Informationstheorie III (Mathematische Forschungsberichte, herausgegeben von Prof. Dr. Heinrich Grell). VEB Deutscher Verlag der Wissenschaften, Berlin 1960; 88 S., kart. DM 22,60 , 1963 .

[89]  R. Fisher Indeterminism and Natural Selection , 1934, Philosophy of Science.

[90]  F. Smithies The Shaping of Functional Analysis , 1997 .

[91]  W. G. Tuller,et al.  Theoretical Limitations on the Rate of Transmission of Information , 1949, Proceedings of the IRE.

[92]  David Slepian,et al.  Key papers in the development of information theory , 1974 .

[93]  A. N. Kolmogorov,et al.  Interpolation and extrapolation of stationary random sequences. , 1962 .

[94]  J. Blanchard,et al.  A pioneeing attempt at multiplex telephony , 1963 .

[95]  Stephen Rice In Memoriam: W. R. Bennett-Some Early Memories , 1984, IEEE Trans. Commun..

[96]  P. K. Chaturvedi,et al.  Communication Systems , 2002, IFIP — The International Federation for Information Processing.

[97]  H. Nyquist,et al.  Certain factors affecting telegraph speed , 1924, Journal of the A.I.E.E..

[98]  H. Vincent Poor,et al.  Detection of Stochastic Processes , 1998, IEEE Trans. Inf. Theory.

[99]  Andrei N. Kolmogorov,et al.  On the Shannon theory of information transmission in the case of continuous signals , 1956, IRE Trans. Inf. Theory.

[100]  Julian Blanchard,et al.  History of electrical resonance , 1941, Electrical Engineering.

[101]  Scott J Muller,et al.  Asymmetry: the foundation of information , 2007 .

[102]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[103]  Claude E. Shannon,et al.  Communication theory of secrecy systems , 1949, Bell Syst. Tech. J..

[104]  Samuel W. Thomsen Some evidence concerning the genesis of Shannon’s information theory , 2009 .

[105]  J. Neumann Mathematische grundlagen der Quantenmechanik , 1935 .

[106]  Andrei N. Kolmogorov,et al.  Logical basis for information theory and probability theory , 1968, IEEE Trans. Inf. Theory.

[107]  M. M. Dodson,et al.  Herbert Raabe's work in multiplex signal transmission and his development of sampling methods , 2010, Signal Process..

[108]  Anthony E. Cawkell,et al.  Claude Elwood Shannon, 1916-2001 , 2001, J. Inf. Sci..