The paradigm of complex probability and Claude Shannon’s information theory

ABSTRACTAndrey Kolmogorov put forward in 1933 the five fundamental axioms of classical probability theory. The original idea in my complex probability paradigm is to add new imaginary dimensions to the experiment real dimensions which will make the work in the complex probability set totally predictable and with a probability permanently equal to one. Therefore, adding to the real set of probabilities the contributions of the imaginary set of probabilities will make the event in absolutely deterministic. It is of great importance that stochastic systems become totally predictable since we will be perfectly knowledgeable to foretell the outcome of all random events that occur in nature. Hence, my purpose here is to link my complex probability paradigm to Claude Shannon’s information theory that was originally proposed in 1948. Consequently, by calculating the parameters of the new prognostic model, we will be able to determine the magnitude of the chaotic factor, the degree of our knowledge, the complex pr...

[1]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[2]  Andrew F. Rex,et al.  Maxwell's Demon, Entropy, Information, Computing , 1990 .

[3]  Zoran Ognjanović,et al.  Complex valued probability logics , 2014 .

[4]  Abdo Abou Jaoude,et al.  COMPLEX PROBABILITY THEORY AND PROGNOSTIC , 2014 .

[5]  R. H. Myers,et al.  Probability and Statistics for Engineers and Scientists , 1978 .

[6]  John D. Barrow,et al.  Pi in the sky , 1984, Nature.

[7]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[8]  Ludwig Boltzmann,et al.  Lectures on Gas Theory , 1964 .

[9]  Abdo Abou Jaoude.  The paradigm of complex probability and the Brownian motion , 2015 .

[10]  P K Rogan,et al.  Organization of the ABCR gene: analysis of promoter and splice junction sequences. , 1998, Gene.

[11]  Benjamin Flecker,et al.  Multivariate information measures: an experimentalist's perspective , 2011, 1111.6857.

[12]  A. Shiryaev,et al.  Andrei Nikolaevich Kolmogorov , 2004 .

[13]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[14]  James Gleick.  The Information: A History, A Theory, A Flood (Gleick, J.; 2011) [Book Review] , 2011, IEEE Transactions on Information Theory.

[15]  L. Daston.  Classical Probability in the Enlightenment , 1988 .

[16]  E. Bell.  The development of mathematics , 1941 .

[17]  R. Jeffrey.  Probability and the Art of Judgment , 1992 .

[18]  Ian Hacking,et al.  The Emergence of Probability. A Philosophical Study of Early Ideas about Probability, Induction and Statistical Inference , 1979 .

[19]  Eugene Seneta.  Statisticians of the Centuries , 2007 .

[20]  Max Planck,et al.  Treatise on thermodynamics , 1928, The Mathematical Gazette.

[21]  Paul Davies,et al.  The Mind of God , 1992 .

[22]  Abdo Abou Jaoude,et al.  Prediction in Complex Dimension Using Kolmogorov's Set of Axioms , 2010 .

[23]  Abdo Abou Jaoude.  The Complex Probability Paradigm and Analytic Linear Prognostic for Vehicle Suspension Systems , 2015 .

[24]  J. McMaster,et al.  The Elegant Universe , 1999 .

[25]  Raymond W. Yeung,et al.  Information Theory and Network Coding , 2008 .

[26]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[27]  Vladimir G Ivancevic,et al.  Quantum Leap: From Dirac and Feynman, Across the Universe, to Human Body and Mind , 2008 .

[28]  D. Hand.  A History of Probability and Statistics and Their Applications before 1750 , 1990 .

[29]  James Franklin,et al.  The Science of Conjecture: Evidence and Probability before Pascal , 2001 .

[30]  Harvey S. Leff,et al.  Maxwell's Demon 2 , 1990 .

[31]  F. N. David,et al.  Games, gods and gambling: The origins and history of probability and statistical ideas from the earliest times to the Newtonian era , 1963 .

[32]  Abdo Abou Jaoude.  THE THEORY OF COMPLEX PROBABILITY AND THE FIRST ORDER RELIABILITY METHOD , 2013 .

[33]  E. Jaynes.  Information Theory and Statistical Mechanics , 1957 .

[34]  Douglas C. Montgomery,et al.  Applied Statistics and Probability for Engineers, Third edition , 1994 .

[35]  Robert K. Logan,et al.  What is information?: Propagating organization in thebiosphere, symbolosphere, technosphere and econosphere , 2014 .

[36]  Masud Mansuripur,et al.  Introduction to information theory , 1986 .

[37]  Robert B. Ash,et al.  Information Theory , 2020, The SAGE International Encyclopedia of Mass Media and Society.

[38]  Christoph Arndt,et al.  Information Measures: Information and its Description in Science and Engineering , 2001 .

[39]  Robert J. McEliece,et al.  The Theory of Information and Coding , 1979 .

[40]  D. Cox.  A use of complex probabilities in the theory of stochastic processes , 1955, Mathematical Proceedings of the Cambridge Philosophical Society.

[41]  Carlo Cercignani.  Ludwig Boltzmann. The Man Who Trusted Atoms , 1999 .

[42]  A. Kolmogorov.  Three approaches to the quantitative definition of information , 1968 .

[43]  Daniel De Kee,et al.  Advanced Mathematics for Applied and Pure Sciences , 1997 .

[44]  Henri Theil,et al.  Economics and information theory , 1967 .

[45]  Jianbin Qiu,et al.  Mode-dependent nonrational output feedback control for continuous-time semi-Markovian jump systems with time-varying delay , 2015 .

[46]  D. Salsburg.  The lady tasting tea : how statistics revolutionized science in the twentieth century , 2002 .

[47]  Don Weingarten.  Complex probabilities on R(N) as real probabilities on C(N) and an application to path integrals. , 2002, Physical review letters.

[48]  Jan von Plato.  Creating Modern Probability: Index of Subjects , 1994 .

[49]  Miodrag Raskovic,et al.  A Probabilistic Temporal Logic That Can Model Reasoning about Evidence , 2010, FoIKS.

[50]  Ray Bert,et al.  \IThe Information: A History, A Theory, A Flood\N By James Gleick. New York City: Pantheon Books, 2011 , 2011 .

[51]  R. Hartley.  Transmission of information , 1928 .

[52]  James Gleick.  Chaos: Making a New Science , 1987 .

[53]  Raymond W. Yeung,et al.  A First Course in Information Theory , 2002 .

[54]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[55]  Hamid Reza Karimi,et al.  model reduction for continuous-time Markovian jump systems with incomplete statistics of mode information , 2014, Int. J. Syst. Sci..

[56]  Jonathan P. Bollback,et al.  Bayesian Inference of Phylogeny and Its Impact on Evolutionary Biology , 2001, Science.

[57]  J. Gullberg.  Mathematics: From the Birth of Numbers , 1997 .

[58]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[59]  Aleksandr Yakovlevich Khinchin,et al.  Mathematical foundations of information theory , 1959 .

[60]  Pablo Suau,et al.  Information Theory in Computer Vision and Pattern Recognition , 2009 .

[61]  R. Gallager.  Information Theory and Reliable Communication , 1968 .

[62]  J. J. Kelly.  A new interpretation of information rate , 1956 .

[63]  Mark Burgin,et al.  Interpretations of Negative Probabilities , 2010, 1008.1287.

[64]  Bin Ma,et al.  Chain letters & evolutionary histories. , 2003, Scientific American.

[65]  Stanford Goldman,et al.  Information theory , 1953 .

[66]  John E. Freund.  Introduction to probability , 1973 .

[67]  Abdo Abou Jaoude.  The paradigm of complex probability and analytic linear prognostic for unburied petrochemical pipelines , 2017 .

[68]  P.M.B. Vitányi,et al.  Andrei Nikolaevich Klomogorov , 1988 .

[69]  Abdo Abou Jaoude.  THE COMPLEX STATISTICS PARADIGM AND THE LAW OF LARGE NUMBERS , 2013 .

[70]  J. Plato.  Creating Modern Probability: Its Mathematics, Physics and Philosophy in Historical Perspective , 1994 .

[71]  Fazlollah M. Reza,et al.  Introduction to Information Theory , 2004, Lecture Notes in Electrical Engineering.

[72]  Abdo Abou Jaoude.  The paradigm of complex probability and analytic nonlinear prognostic for vehicle suspension systems , 2016 .

[73]  Ronald Fagin,et al.  A logic for reasoning about probabilities , 1988, [1988] Proceedings. Third Annual Information Symposium on Logic in Computer Science.

[74]  Toby Berger,et al.  Digital Compression For Multimedia Principles And Standards , 1998 .

[75]  Patrick E. Haggerty.  The corporation and innovation , 1981 .

[76]  Abdo Abou Jaoude.  The paradigm of complex probability and Chebyshev’s inequality , 2016 .

[77]  Saul Youssef.  Quantum mechanics as complex probability theory , 1993 .

[78]  Anders Hald,et al.  History of Probability and Statistics and Their Applications before 1750: Hald/History of Probability & Statistics , 2005 .

[79]  Jan von Plato.  Creating Modern Probability by Jan von Plato , 1994 .

[80]  Douglas A. Cenzer,et al.  A connection between the Cantor–Bendixson derivative and the well-founded semantics of finite logic programs , 2012, Annals of Mathematics and Artificial Intelligence.