Framework for Benchmarking Rule-Based Inference Engines

Rule-based systems constitute the state of the art solutions in the area of artificial intelligence. They provide fast, human readable and self explanatory mechanism for encoding knowledge. Due to large popularity of rules, dozens of inference engines were developed over last few decades. They differ in the reasoning efficiency depending on many factors such as model characteristics or deployment platform. Therefore, picking a reasoning engine that best fits the requirement of the system becomes a non-trivial task. The primary objective of the work presented in this paper was to provide a fully automated framework for benchmarking rule-based reasoning engines.

[1]  Peter Van Weert,et al.  Efficient Lazy Evaluation of Rule-Based Programs , 2010, IEEE Transactions on Knowledge and Data Engineering.

[2]  Grzegorz J. Nalepa,et al.  How to Reason by HeaRT in a Semantic Knowledge-Based Wiki , 2011, 2011 IEEE 23rd International Conference on Tools with Artificial Intelligence.

[3]  Ivan Bratko,et al.  Prolog Programming for Artificial Intelligence , 1986 .

[4]  Grzegorz J. Nalepa,et al.  Loki - Semantic Wiki with Logical Knowledge Representation , 2011, Trans. Comput. Collect. Intell..

[5]  Ludwig Ostermayer.  Seamless Cooperation of Java and Prolog for Rule-Based Software Development , 2015, Challenge+DC@RuleML.

[6]  Seth Flaxman,et al.  EU regulations on algorithmic decision-making and a "right to explanation" , 2016, ArXiv.

[7]  Muhammad Younus Javed,et al.  Context Inference Engine (CiE): Inferring Context , 2012, Int. J. Adv. Pervasive Ubiquitous Comput..

[8]  Adrian Paschke,et al.  RuleML 1.0: The Overarching Specification of Web Rules , 2010, RuleML.

[9]  Jun-Hwan Jang,et al.  Development of the Rule-Based Inference Engine for the Advanced Context-Awareness , 2015 .

[10]  Zhengxiang Pan.  Benchmarking DL Reasoners Using Realistic Ontologies , 2005, OWLED.

[11]  Daniel P. Miranker.  TREAT: a better match algorithm for AI production systems , 1987, AAAI 1987.

[12]  Charles L. Forgy,et al.  Rete: A Fast Algorithm for the Many Patterns/Many Objects Match Problem , 1982, Artif. Intell..

[13]  Daniel P. Miranker,et al.  The Organization and Performance of a TREAT-Based Production System Compiler , 1991, IEEE Trans. Knowl. Data Eng..

[14]  Anind K. Dey,et al.  Investigating intelligibility for uncertain context-aware applications , 2011, UbiComp '11.

[15]  Grzegorz J. Nalepa,et al.  Challenges for Migration of Rule-Based Reasoning Engine to a Mobile Platform , 2014, MCSS.

[16]  Grzegorz J. Nalepa,et al.  Rule-based solution for context-aware reasoning on mobile devices , 2014, Comput. Sci. Inf. Syst..

[17]  Daniel P. Miranker,et al.  Effects of Database Size on Rule System Performance: Five Case Studies , 1991, VLDB.

[18]  Grzegorz J. Nalepa,et al.  Uncertain context data management in dynamic mobile environments , 2017, Future Gener. Comput. Syst..

[19]  Grzegorz J. Nalepa,et al.  Overview of Knowledge Formalization with XTT2 Rules , 2011, RuleML Europe.

[20]  Krzysztof Kaczor.  Practical Approach to Interoperability in Production Rule Bases with Subito , 2015, ICAISC.

[21]  Grzegorz J. Nalepa,et al.  HalVA - Rule Analysis Framework for XTT2 Rules , 2011, RuleML Europe.

[22]  Grzegorz J. Nalepa,et al.  Proposal of an Inference Engine Architecture for Business Rules and Processes , 2013, ICAISC.

[23]  Gregory D. Abowd,et al.  Providing architectural support for building context-aware applications , 2000 .

[24]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..