Large-scale Parallel Stratified Defeasible Reasoning

We are recently experiencing an unprecedented explosion of available data coming from the Web, sensors readings, scientific databases, government authorities and more. Such datasets could benefit from the introduction of rule sets encoding commonly accepted rules or facts, application- or domain-specific rules, com-monsense knowledge etc. This raises the question of whether, how, and to what extent knowledge representation methods are capable of handling huge amounts of data for these applications. In this paper, we consider inconsistency-tolerant reasoning in the form of defeasible logic, and analyze how parallelization, using the MapReduce framework, can be used to reason with defeasible rules over huge datasets. We extend previous work by dealing with predicates of arbitrary arity, under the assumption of stratification. Moving from unary to multi-arity predicates is a decisive step towards practical applications, e.g. reasoning with linked open (RDF) data. Our experimental results demonstrate that defeasible reasoning with millions of data is performant, and has the potential to scale to billions of facts.

[1]  Spyros Kotoulas,et al.  Towards Parallel Nonmonotonic Reasoning with Billions of Facts , 2012, KR.

[2]  Octavian Udrea,et al.  Apples and oranges: a comparison of RDF benchmarks and real RDF datasets , 2011, SIGMOD '11.

[3]  David Mizell,et al.  High-Performance Computing Applied to Semantic Databases , 2011, ESWC.

[4]  Frank van Harmelen,et al.  OWL Reasoning with WebPIE: Calculating the Closure of 100 Billion Triples , 2010, ESWC.

[5]  Frank van Harmelen,et al.  Mind the data skew: distributed inferencing by speeddating in elastic regions , 2010, WWW '10.

[6]  Jeffrey D. Ullman,et al.  Optimizing joins in a map-reduce environment , 2010, EDBT '10.

[7]  Frank van Harmelen,et al.  Marvin: Distributed reasoning over large-scale Semantic Web data , 2009, J. Web Semant..

[8]  Frank van Harmelen,et al.  Scalable Distributed Reasoning Using MapReduce , 2009, SEMWEB.

[9]  Tim Berners-Lee,et al.  Linked Data - The Story So Far , 2009, Int. J. Semantic Web Inf. Syst..

[10]  Vassilis Christophides,et al.  A Formal Approach for RDF/S Ontology Evolution , 2008, ECAI.

[11]  Frank van Harmelen,et al.  A Semantic Web Primer, 2nd Edition (Cooperative Information Systems) , 2008 .

[12]  Sanjay Ghemawat,et al.  MapReduce: simplified data processing on large clusters , 2008, CACM.

[13]  Michael J. Maher Under consideration for publication in Theory and Practice of Logic Programming 1 Propositional Defeasible Logic has Linear Complexity , 2004 .

[14]  Michael J. Maher,et al.  Efficient defeasible reasoning systems , 2000, Proceedings 12th IEEE Internationals Conference on Tools with Artificial Intelligence. ICTAI 2000.

[15]  David Billington,et al.  Defeasible Logic is Stable , 1993, J. Log. Comput..

[16]  Frank van Harmelen,et al.  KR and Reasoning on the Semantic Web: Web-Scale Reasoning , 2011, Handbook of Semantic Web Technologies.

[17]  Vassilis Christophides,et al.  Declarative Repairing Policies for Curated KBs , 2011 .

[18]  Pascal Hitzler,et al.  A MapReduce Algorithm for EL+ , 2010, Description Logics.

[19]  Andrzej Szalas,et al.  Living with Inconsistency and Taming Nonmonotonicity , 2010, Datalog.

[20]  Frank van Harmelen,et al.  A Semantic Web Primer, 2nd Edition , 2008, Cooperative information systems.

[21]  Anthony Hunter,et al.  Elements of Argumentation , 2007, ECSQARU.

[22]  Frank van Harmelen,et al.  A semantic web primer , 2004 .