A Unified View on Semantic Information and Communication: A Probabilistic Logic Approach

This article aims to provide a unified and technical approach to semantic information, communication, and their interplay through the lens of probabilistic logic. To this end, on top of the existing technical communication (TC) layer, we additionally introduce a semantic communication (SC) layer that exchanges logically meaningful clauses in knowledge bases. To make these SC and TC layers interact, we propose various measures based on the entropy of a clause in a knowledge base. These measures allow us to delineate various technical issues on SC such as a message selection problem for improving the knowledge at a receiver. Extending this, we showcase selected examples in which SC and TC layers interact with each other while taking into account constraints on physical channels.

[1]  Luciano Floridi,et al.  Is Semantic Information Meaningful Data? , 2005, Philosophy and Phenomenological Research.

[2]  Sergio Barbarossa,et al.  6G Networks: Beyond Shannon Towards Semantic and Goal-Oriented Communications , 2020, Comput. Networks.

[3]  Jaakko Hintikka,et al.  On Semantic Information , 1970 .

[4]  Matthieu R. Bloch,et al.  Physical-Layer Security: From Information Theory to Security Engineering , 2011 .

[5]  Jean-Claude Belfiore,et al.  Topos and Stacks of Deep Neural Networks , 2021, ArXiv.

[6]  Dov M. Gabbay ... et al..  Handbook of the logic of argument and inference , 2013 .

[7]  Nils J. Nilsson,et al.  Probabilistic Logic * , 2022 .

[8]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[9]  Jinho Choi,et al.  A Cross-Layer Approach to Data-Aided Sensing Using Compressive Random Access , 2019, IEEE Internet of Things Journal.

[10]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[11]  Luciano Floridi,et al.  Trends in the Philosophy of Information , 2008 .

[12]  Jinho Choi,et al.  Data-Aided Sensing Where Communication and Sensing Meet: An Introduction , 2020, 2020 IEEE Wireless Communications and Networking Conference Workshops (WCNCW).

[13]  Dieter Gernert,et al.  Pragmatic Information: Historical Exposition and General Overview , 2006 .

[14]  Imre Csiszár,et al.  Information Theory - Coding Theorems for Discrete Memoryless Systems, Second Edition , 2011 .

[15]  James A. Hendler,et al.  Towards a theory of semantic communication , 2011, 2011 IEEE Network Science Workshop.

[16]  Claude E. Shannon,et al.  Recent Contributions to The Mathematical Theory of Communication , 2009 .

[17]  Mehdi Bennis,et al.  Semantics-Native Communication with Contextual Reasoning , 2021, ArXiv.

[18]  Theodore Hailperin,et al.  Probability logic , 1984, Notre Dame J. Formal Log..

[19]  H. Jeffreys.  Logical Foundations of Probability , 1952, Nature.

[20]  Zhijin Qin,et al.  Semantic Communications for Speech Signals , 2020, ICC 2021 - IEEE International Conference on Communications.

[21]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[22]  Jinho Choi,et al.  Gaussian Data-Aided Sensing With Multichannel Random Access and Model Selection , 2019, IEEE Internet of Things Journal.

[23]  Pieter Adriaans,et al.  A Critical Analysis of Floridi’s Theory of Semantic Information , 2010 .