Logic Tensor Networks

Artificial Intelligence agents are required to learn from their surroundings and to reason about the knowledge that has been learned in order to make decisions. While state-of-the-art learning from data typically use sub-symbolic distributed representations, reasoning is normally useful at a higher level of abstraction with the use of a first-order logic language for knowledge representation. As a result, attempts at combining symbolic AI and neural computation into neural-symbolic systems have been on the increase. In this paper, we present Logic Tensor Networks (LTN), a neurosymbolic formalism and computational model that supports learning and reasoning through the introduction of a many-valued, end-to-end differentiable first-order logic called Real Logic as a representation language for deep learning. We show that LTN provides a uniform language for the specification and the computation of several AI tasks such as data clustering, multi-label classification, relational learning, query answering, semi-supervised learning, regression and embedding learning. We implement and illustrate each of the above tasks with a number of simple explanatory examples using TensorFlow 2.

[1]  John McCarthy,et al.  Epistemological challenges for connectionism , 1988, Behavioral and Brain Sciences.

[2]  Foundations of Reasoning with Uncertainty via Real-valued Logics , 2020, ArXiv.

[3]  Marco Gori,et al.  Integrating Learning and Reasoning with Deep Logic Models , 2019, ECML/PKDD.

[4]  Richard Evans,et al.  Learning Explanatory Rules from Noisy Data , 2017, J. Artif. Intell. Res..

[5]  Priya L. Donti,et al.  SATNet: Bridging deep learning and logical reasoning using a differentiable satisfiability solver , 2019, ICML.

[6]  Michael Spranger,et al.  Injecting Prior Knowledge for Transfer Learning into Reinforcement Learning Algorithms using Logic Tensor Networks , 2019, ArXiv.

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  Frank van Harmelen,et al.  Analyzing Differentiable Fuzzy Implications , 2020, KR.

[9]  Radko Mesiar,et al.  Triangular Norms , 2000, Trends in Logic.

[10]  Edward Grefenstette,et al.  Learning Reasoning Strategies in End-to-End Differentiable Proving , 2020, ICML.

[11]  Leslie G. Valiant,et al.  Three problems in computer science , 2003, JACM.

[12]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[13]  Thomas Lukasiewicz,et al.  Ontology Reasoning with Deep Neural Networks , 2018, J. Artif. Intell. Res..

[14]  Marco Gori,et al.  Constraint-Based Visual Generation , 2018, ICANN.

[15]  Tim Rocktäschel,et al.  End-to-end Differentiable Proving , 2017, NIPS.

[16]  Jian Tang,et al.  Probabilistic Logic Neural Networks for Reasoning , 2019, NeurIPS.

[17]  Yun Shi,et al.  A Deep Study of Fuzzy Implications , 2009 .

[18]  Stevan Harnad,et al.  Symbol grounding problem , 1990, Scholarpedia.

[19]  Pascal Hitzler,et al.  Complementing Logical Reasoning with Sub-symbolic Commonsense , 2019, RuleML+RR.

[20]  Ivan Donadello,et al.  Compensating Supervision Incompleteness with Prior Knowledge in Semantic Image Interpretation , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[21]  Eric P. Xing,et al.  Harnessing Deep Neural Networks with Logic Rules , 2016, ACL.

[22]  Krysia Broda,et al.  Neural-symbolic learning systems - foundations and applications , 2012, Perspectives in neural computing.

[23]  Lokendra Shastri,et al.  Advances in SHRUTI—A Neurally Motivated Model of Relational Knowledge Representation and Rapid Inference Using Temporal Synchrony , 1999, Applied Intelligence.

[24]  Ondrej Kuzelka,et al.  Neural Markov Logic Networks , 2019, UAI.

[25]  Moshe Y. Vardi,et al.  Graph Neural Networks Meet Neural-Symbolic Computing: A Survey and Perspective , 2020, IJCAI.

[26]  Luc De Raedt,et al.  DeepProbLog: Neural Probabilistic Logic Programming , 2018, BNAIC/BENELEARN.

[27]  Dov M. Gabbay,et al.  Neural-Symbolic Cognitive Reasoning , 2008, Cognitive Technologies.

[28]  Steven Schockaert,et al.  Lifted Relational Neural Networks: Efficient Learning of Latent Relational Structures , 2018, J. Artif. Intell. Res..

[29]  Pascal Hitzler,et al.  On the Capabilities of Logic Tensor Networks for Deductive Reasoning , 2019, AAAI Spring Symposium Combining Machine Learning with Knowledge Engineering.

[30]  Guy Van den Broeck,et al.  Probabilistic Sentential Decision Diagrams , 2014, KR.

[31]  Jinglu Hu,et al.  Improving multi-label classification performance by label constraints , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[32]  Jianfeng Gao,et al.  Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving , 2019, ArXiv.

[33]  Philipp Koehn,et al.  Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2016 .

[34]  Chuang Gan,et al.  The Neuro-Symbolic Concept Learner: Interpreting Scenes Words and Sentences from Natural Supervision , 2019, ICLR.

[35]  Michael E. Akintunde,et al.  Verifying Strategic Abilities of Neural-symbolic Multi-agent Systems , 2020, KR.

[36]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[37]  Frank van Harmelen,et al.  Semi-supervised Learning using Differentiable Reasoning , 2019, FLAP.

[38]  Jürgen Schmidhuber,et al.  Learning to Reason with Third-Order Tensor Products , 2018, NeurIPS.

[39]  Yee Whye Teh,et al.  Stacked Capsule Autoencoders , 2019, NeurIPS.

[40]  Stuart J. Russell,et al.  BLOG: Probabilistic Models with Unknown Objects , 2005, IJCAI.

[41]  Zhi-Hua Zhou,et al.  Bridging Machine Learning and Logical Reasoning by Abductive Learning , 2019, NeurIPS.

[42]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[43]  Luciano Serafini,et al.  Knowledge Enhanced Neural Networks , 2019, PRICAI.

[44]  Luis C. Lamb,et al.  Neurosymbolic AI: the 3rd wave , 2020, Artificial Intelligence Review.

[45]  Artur S. d'Avila Garcez,et al.  Logic Tensor Networks for Semantic Image Interpretation , 2017, IJCAI.

[46]  Dov M. Gabbay,et al.  The Many Valued and Nonmonotonic Turn in Logic , 2007, Handbook of the History of Logic.

[47]  Pascal Hitzler,et al.  Perspectives of Neural-Symbolic Integration , 2007, Studies in Computational Intelligence.

[48]  Artur S. d'Avila Garcez,et al.  Graph Neural Networks Meet Neural-Symbolic Computing: A Survey and Perspective , 2020, IJCAI.

[49]  Fabrizio Lamberti,et al.  Faster-LTN: a neuro-symbolic, end-to-end object detection architecture , 2021, ICANN.

[50]  Razvan Pascanu,et al.  Interaction Networks for Learning about Objects, Relations and Physics , 2016, NIPS.

[51]  Luciano Serafini,et al.  Neural-Symbolic Computing: An Effective Methodology for Principled Integration of Machine Learning and Reasoning , 2019, FLAP.

[52]  Luc De Raedt,et al.  From Statistical Relational to Neuro-Symbolic Artificial Intelligence , 2020, IJCAI.

[53]  Mislav Balunovic,et al.  DL2: Training and Querying Neural Networks with Logic , 2019, ICML.

[54]  Gadi Pinkas,et al.  Reasoning, Nonmonotonicity and Learning in Connectionist Networks that Capture Propositional Knowledge , 1995, Artif. Intell..

[55]  Stephen Muggleton,et al.  Meta-interpretive learning: application to grammatical inference , 2013, Machine Learning.

[56]  Géraldine Legendre,et al.  The Harmonic Mind: From Neural Computation to Optimality-Theoretic GrammarVolume I: Cognitive Architecture (Bradford Books) , 2006 .

[57]  Ah Chung Tsoi,et al.  The Graph Neural Network Model , 2009, IEEE Transactions on Neural Networks.

[58]  Artur S. d'Avila Garcez,et al.  Learning and Reasoning with Logic Tensor Networks , 2016, AI*IA.

[59]  Christopher Joseph Pal,et al.  A Meta-Transfer Objective for Learning to Disentangle Causal Mechanisms , 2019, ICLR.

[60]  Marco Gori,et al.  LYRICS: A General Interface Layer to Integrate Logic Inference and Deep Learning , 2019, ECML/PKDD.

[61]  Artur S. d'Avila Garcez,et al.  Logic Tensor Networks: Deep Learning and Logical Reasoning from Data and Knowledge , 2016, NeSy@HLAI.

[62]  William W. Cohen,et al.  TensorLog: A Probabilistic Database Implemented Using Deep-Learning Infrastructure , 2020, J. Artif. Intell. Res..

[63]  Artur d'Avila Garcez,et al.  Neural-Symbolic Integration for Fairness in AI , 2021, AAAI Spring Symposium: Combining Machine Learning with Knowledge Engineering.

[64]  Sebastijan Dumancic,et al.  From Statistical Relational to Neuro-Symbolic Artificial Intelligence , 2020, IJCAI.

[65]  Artur S. d'Avila Garcez,et al.  Fast relational learning using bottom clause propositionalization with artificial neural networks , 2013, Machine Learning.

[66]  Sebastian Riedel,et al.  Logical Rule Induction and Theory Learning Using Neural Theorem Proving , 2018, ArXiv.

[67]  Petr Hájek,et al.  Metamathematics of Fuzzy Logic , 1998, Trends in Logic.

[68]  Guy Van den Broeck,et al.  A Semantic Loss Function for Deep Learning with Symbolic Knowledge , 2017, ICML.

[69]  Franz J. Kurfess,et al.  CHCL - A Connectionist Infernce System , 1990, Dagstuhl Seminar on Parallelization in Inference Systems.

[70]  N. Campbell,et al.  A multivariate study of variation in two species of rock crab of the genus Leptograpsus , 1974 .

[71]  Artur S. d'Avila Garcez,et al.  Learning and Representing Temporal Knowledge in Recurrent Networks , 2011, IEEE Transactions on Neural Networks.

[72]  Vasco M. Manquinho,et al.  Algorithms for Weighted Boolean Optimization , 2009, SAT.

[73]  Frank van Harmelen,et al.  Analyzing Differentiable Fuzzy Logic Operators , 2020, Artif. Intell..