An Accelerator for Rule Induction in Fuzzy Rough Theory

Rule-based classifier, that extract a subset of induced rules to efficiently learn/mine while preserving the discernibility information, plays a crucial role in human-explainable artificial intelligence. However, in this era of big data, rule induction on the whole datasets is computationally intensive. So far, to the best of our knowledge, no known method focusing on accelerating rule induction has been reported. This is the first study to consider the acceleration technique to reduce the scale of computation in rule induction. We propose an accelerator for rule induction based on fuzzy rough theory; the accelerator can avoid redundant computation and accelerate the building of a rule classifier. First, a rule induction method based on consistence degree, called consistence-based value reduction (CVR), is proposed and used as basis to accelerate. Second, we introduce a compacted search space termed key set, which only contains the key instances required to update the induced rule, to conduct value reduction. The monotonicity of key set ensures the feasibility of our accelerator. Third, a rule-induction accelerator is designed based on key set, and it is theoretically guaranteed to display the same results as the unaccelerated version. Specifically, the rank preservation property of key set ensures consistency between the rule induction achieved by the accelerator and the unaccelerated method. Finally, extensive experiments demonstrate that the proposed accelerator can perform remarkably faster than the unaccelerated rule-based classifier methods, especially on datasets with numerous instances.

[1]  Yi Cheng,et al.  Forward approximation and backward approximation in fuzzy rough sets , 2015, Neurocomputing.

[2]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[3]  Xizhao Wang,et al.  Attributes Reduction Using Fuzzy Rough Sets , 2008, IEEE Transactions on Fuzzy Systems.

[4]  Reza Tavakkoli-Moghaddam,et al.  Application of robust optimization for a product portfolio problem using an invasive weed optimization algorithm , 2019, Numerical Algebra, Control & Optimization.

[5]  Reza Tavakkoli-Moghaddam,et al.  A comprehensive model of demand prediction based on hybrid artificial intelligence and metaheuristic algorithms: A case study in dairy industry , 2018 .

[6]  Ching-Hsue Cheng,et al.  Fuzzy time-series model based on rough set rule induction for forecasting stock price , 2018, Neurocomputing.

[7]  D. Dubois,et al.  ROUGH FUZZY SETS AND FUZZY ROUGH SETS , 1990 .

[8]  Alireza Goli,et al.  Fuzzy Integrated Cell Formation and Production Scheduling Considering Automated Guided Vehicles and Human Factors , 2021, IEEE Transactions on Fuzzy Systems.

[9]  Gerhard-Wilhelm Weber,et al.  Multi-objective optimization for the reliable pollution-routing problem with cross-dock selection using Pareto-based algorithms , 2020 .

[10]  Reza Tavakkoli-Moghaddam,et al.  Hybrid artificial intelligence and robust optimization for a multi-objective product portfolio problem Case study: The dairy products industry , 2019, Comput. Ind. Eng..

[11]  Salvatore Greco,et al.  Rough sets theory for multicriteria decision analysis , 2001, Eur. J. Oper. Res..

[12]  Xizhao Wang,et al.  On the generalization of fuzzy rough sets , 2005, IEEE Transactions on Fuzzy Systems.

[13]  Reza Tavakkoli-Moghaddam,et al.  An integrated approach based on artificial intelligence and novel meta-heuristic algorithms to predict demand for dairy products: a case study , 2021, Network.

[14]  Wojciech Ziarko,et al.  DATA‐BASED ACQUISITION AND INCREMENTAL MODIFICATION OF CLASSIFICATION RULES , 1995, Comput. Intell..

[15]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.

[16]  André Langevin,et al.  Integrated production and material handling scheduling using mathematical programming and constraint programming , 2003, Eur. J. Oper. Res..

[17]  Xi-Zhao Wang,et al.  Improving Generalization of Fuzzy IF--THEN Rules by Maximizing Fuzzy Entropy , 2009, IEEE Transactions on Fuzzy Systems.

[18]  Been Kim,et al.  Towards A Rigorous Science of Interpretable Machine Learning , 2017, 1702.08608.

[19]  S. M. Hosseini,et al.  Sustainable supply chain network design using products’ life cycle in the aluminum industry , 2021, Environmental Science and Pollution Research.

[20]  Peter Clark,et al.  The CN2 Induction Algorithm , 1989, Machine Learning.

[21]  Didier Dubois,et al.  Putting Rough Sets and Fuzzy Sets Together , 1992, Intelligent Decision Support.

[22]  Xiaolong Wang,et al.  Mining Pinyin-to-character conversion rules from large-scale corpus: a rough set approach , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  Wei Wei,et al.  Accelerating incremental attribute reduction algorithm by compacting a decision table , 2018, Int. J. Mach. Learn. Cybern..

[24]  Jinhai Li,et al.  Parallel computing techniques for concept-cognitive learning based on granular computing , 2018, International Journal of Machine Learning and Cybernetics.

[25]  Xizhao Wang,et al.  Building a Rule-Based Classifier—A Fuzzy-Rough Set Approach , 2010, IEEE Transactions on Knowledge and Data Engineering.

[26]  Humberto Bustince,et al.  CFM-BD: A Distributed Rule Induction Algorithm for Building Compact Fuzzy Models in Big Data Classification Problems , 2019, IEEE Transactions on Fuzzy Systems.

[27]  Thomas de Quincey [C] , 2000, The Works of Thomas De Quincey, Vol. 1: Writings, 1799–1820.

[28]  Chun-Che Huang,et al.  Alternative rule induction methods based on incremental object using rough set theory , 2013, Appl. Soft Comput..

[29]  Xizhao Wang,et al.  Learning fuzzy rules from fuzzy samples based on rough set technique , 2007, Inf. Sci..

[30]  Alireza Goli,et al.  A Covering Tour Approach for Disaster Relief Locating and Routing with Fuzzy Demand , 2020, Int. J. Intell. Transp. Syst. Res..

[31]  Meikang Qiu,et al.  Distributed Feature Selection for Big Data Using Fuzzy Rough Sets , 2020, IEEE Transactions on Fuzzy Systems.

[32]  Miss A.O. Penney (b) , 1974, The New Yale Book of Quotations.

[33]  Roman Słowiński,et al.  Sequential covering rule induction algorithm for variable consistency rough set approaches , 2011, Inf. Sci..

[34]  Reza Tavakkoli-Moghaddam,et al.  Multiobjective fuzzy mathematical model for a financially constrained closed‐loop supply chain with labor employment , 2019, Comput. Intell..

[35]  Bao Qing Hu,et al.  Dominance-based rough fuzzy set approach and its application to rule induction , 2017, Eur. J. Oper. Res..

[36]  Jiye Liang,et al.  An accelerator for attribute reduction based on perspective of objects and attributes , 2013, Knowl. Based Syst..

[37]  Jacobus van Zyl,et al.  Fuzzy rule induction in a set covering framework , 2006, IEEE Transactions on Fuzzy Systems.

[38]  Bing Huang,et al.  Using a rough set model to extract rules in dominance-based interval-valued intuitionistic fuzzy information systems , 2013, Inf. Sci..

[39]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[40]  Andrzej Skowron,et al.  Rough sets: Some extensions , 2007, Inf. Sci..

[41]  Xizhao Wang,et al.  Incremental Perspective for Feature Selection Based on Fuzzy Rough Sets , 2018, IEEE Transactions on Fuzzy Systems.

[42]  Witold Pedrycz,et al.  An efficient accelerator for attribute reduction from incomplete data in rough set framework , 2011, Pattern Recognit..

[43]  Fariborz Jolai,et al.  Minimizing makespan on a three-machine flowshop batch scheduling problem with transportation using genetic algorithm , 2012, Appl. Soft Comput..

[44]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .