MapReduce-Based Implementation of a Rule System

As information and communication technologies advance, large amounts of data are created everyday. The demands for processing such big data are also increasing. To meet them, the MapReduce framework has been proposed and is now widely used. On the other hand, a rule-based system is used to implement such an intelligent system as an expert system. For applying a rule-based system to process large amounts of data, we propose a method that implements a rule system based on the MapReduce framework. We constructed a simple rule system using Hadoop, which is an open source implementation of the MapReduce framework, and compared several methods of executing a rule system. Our experimental results indicate the potential of a rule system implemented using the MapReduce framework.

[1]  Seokyong Hong,et al.  Efficient processing of RDF graph pattern matching on MapReduce platforms , 2011, DataCloud-SC '11.

[2]  Guido Governatori,et al.  Rule-Based Reasoning, Programming, and Applications - 5th International Symposium, RuleML 2011 - Europe, Barcelona, Spain, July 19-21, 2011. Proceedings , 2011, RuleML Europe.

[3]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[4]  Spyros Kotoulas,et al.  Scalable Nonmonotonic Reasoning over RDF Data Using MapReduce , 2012, SSWS+HPCSW@ISWC.

[5]  Toru Ishida,et al.  Parallel Rule Firing in Production Systems , 1991, IEEE Trans. Knowl. Data Eng..

[6]  Charles L. Forgy,et al.  Rete: A Fast Algorithm for the Many Patterns/Many Objects Match Problem , 1982, Artif. Intell..

[7]  Qi Zhang,et al.  A MapReduce-Based Architecture for Rule Matching in Production System , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[8]  Frank van Harmelen,et al.  WebPIE: A Web-scale Parallel Inference Engine using MapReduce , 2012, J. Web Semant..

[9]  Bhavani M. Thuraisingham,et al.  Heuristics-Based Query Processing for Large RDF Graphs Using Cloud Computing , 2011, IEEE Transactions on Knowledge and Data Engineering.

[10]  Costin Badica,et al.  Rule-Based Distributed and Agent Systems , 2011, RuleML Europe.

[11]  Cristina Sirangelo,et al.  Reasoning About Pattern-Based XML Queries , 2013, RR.

[12]  Michael Kifer,et al.  Rule Interchange Format: The Framework , 2008, RuleML.

[13]  Sang-goo Lee,et al.  SPARQL basic graph pattern processing with iterative MapReduce , 2010, MDAC '10.