Evolutionary Design of Linguistic Fuzzy Regression Systems with Adaptive Defuzzification in Big Data Environments

This paper is positioned in the area of the use of cognitive computation techniques to design intelligent systems for big data scenarios, specifically the use of evolutionary algorithms to design data-driven linguistic fuzzy rule-based systems for regression and control. On the one hand, data-driven approaches have been extensively employed to create rule bases for fuzzy regression and control from examples. On the other, adaptive defuzzification is a well-known mechanism used to significantly improve the accuracy of fuzzy systems. When dealing with large-scale scenarios, the aforementioned methods must be redesigned to allow scalability. Our proposal is based on a distributed MapReduce schema, relying on two ideas: first, a simple adaptation of a classic data-driven method to quickly obtain a set of rules, and, second, a novel scalable strategy that uses evolutionary adaptive defuzzification to achieve better behavior through cooperation among rules. Some different regression problems were used to validate our methodology through an experimental study developed and included at the end of our paper. Therefore, the proposed approach allows scalability while tackling applications of linguistic fuzzy rule-based systems for regression with adaptive defuzzification in large-scale data scenarios. This paper thus examines the use of some relevant techniques for cognitive computing when working with a vast volume of examples, a common occurrence when dealing with the design of artificial intelligent systems that perform reasoning in a similar way as humans.

[1]  Tom White,et al.  Hadoop: The Definitive Guide , 2009 .

[2]  Francisco Herrera,et al.  A Review of the Application of Multiobjective Evolutionary Fuzzy Systems: Current Status and Further Directions , 2013, IEEE Transactions on Fuzzy Systems.

[3]  F. Herrera,et al.  Evolutionary Fuzzy Systems: A Case Study for Intrusion Detection Systems , 2018, Studies in Computational Intelligence.

[4]  Amir Hussain,et al.  Introduction: Dealing with Big Data-Lessons from Cognitive Computing , 2015, Cognitive Computation.

[5]  Antonio J. Rivera,et al.  MEFASD-BD: Multi-objective evolutionary fuzzy algorithm for subgroup discovery in big data environments - A MapReduce solution , 2017, Knowl. Based Syst..

[6]  Francisco Herrera,et al.  A taxonomy for the crossover operator for real‐coded genetic algorithms: An experimental study , 2003, Int. J. Intell. Syst..

[7]  Paul Zikopoulos,et al.  Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data , 2011 .

[8]  Hong-yu Zhang,et al.  A Neutrosophic Normal Cloud and Its Application in Decision-Making , 2016, Cognitive Computation.

[9]  María José del Jesús,et al.  A View on Fuzzy Systems for Big Data: Progress and Opportunities , 2016, Int. J. Comput. Intell. Syst..

[10]  Nicolás García-Pedrajas,et al.  Scaling up data mining algorithms: review and taxonomy , 2012, Progress in Artificial Intelligence.

[11]  Mahardhika Pratama,et al.  Development of C-Means Clustering Based Adaptive Fuzzy Controller for a Flapping Wing Micro Air Vehicle , 2018, J. Artif. Intell. Soft Comput. Res..

[12]  Sebastián Ventura,et al.  Exhaustive search algorithms to mine subgroups on Big Data using Apache Spark , 2017, Progress in Artificial Intelligence.

[13]  Francisco Herrera,et al.  A Fast and Scalable Multiobjective Genetic Fuzzy System for Linguistic Fuzzy Modeling in High-Dimensional Regression Problems , 2011, IEEE Transactions on Fuzzy Systems.

[14]  Harish Garg,et al.  Dual Hesitant Fuzzy Soft Aggregation Operators and Their Application in Decision-Making , 2018, Cognitive Computation.

[15]  María José del Jesús,et al.  Evolutionary Fuzzy Systems for Explainable Artificial Intelligence: Why, When, What for, and Where to? , 2019, IEEE Computational Intelligence Magazine.

[16]  María José del Jesús,et al.  Revisiting Evolutionary Fuzzy Systems: Taxonomy, applications, new trends and challenges , 2015, Knowl. Based Syst..

[17]  Hojjat Adeli,et al.  Nature Inspired Computing: An Overview and Some Future Directions , 2015, Cognitive Computation.

[18]  Kilho Shin,et al.  Improving the genetic bee colony optimization algorithm for efficient gene selection in microarray data , 2018, Progress in Artificial Intelligence.

[19]  Michela Antonelli,et al.  Genetic Training Instance Selection in Multiobjective Evolutionary Fuzzy Systems: A Coevolutionary Approach , 2012, IEEE Transactions on Fuzzy Systems.

[20]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[21]  Michela Antonelli,et al.  A distributed approach to multi-objective evolutionary generation of fuzzy rule-based classifiers from big data , 2017, Inf. Sci..

[22]  Antonio A. Márquez,et al.  An efficient adaptive fuzzy inference system for complex and high dimensional regression problems in linguistic fuzzy modelling , 2013, Knowl. Based Syst..

[23]  Francisco Herrera,et al.  An Insight into Bio-inspired and Evolutionary Algorithms for Global Optimization: Review, Analysis, and Lessons Learnt over a Decade of Competitions , 2018, Cognitive Computation.

[24]  Rafael Alcalá,et al.  METSK-HDe: A multiobjective evolutionary algorithm to learn accurate TSK-fuzzy systems in high-dimensional and large-scale regression problems , 2014, Inf. Sci..

[25]  Sanjay Ghemawat,et al.  MapReduce: a flexible data processing tool , 2010, CACM.

[26]  Francisco Herrera,et al.  Increasing fuzzy rules cooperation based on evolutionary adaptive inference systems , 2007, Int. J. Intell. Syst..

[27]  José A. Gámez,et al.  Learning compact zero-order TSK fuzzy rule-based systems for high-dimensional problems using an Apriori + local search approach , 2018, Inf. Sci..

[28]  María José del Jesús,et al.  KEEL: a software tool to assess evolutionary algorithms for data mining problems , 2008, Soft Comput..

[29]  Manuel Mucientes,et al.  Scalable modeling of thermal dynamics in buildings using fuzzy rules for regression , 2017, 2017 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[30]  A. A. Márquez,et al.  A scalable evolutionary linguistic fuzzy system with adaptive defuzzification in big data , 2017, 2017 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[31]  Amin Nobakhti,et al.  On Natural Based Optimization , 2010, Cognitive Computation.

[32]  Francisco Herrera,et al.  A Study on the Evolutionary Adaptive Defuzzification Methods in Fuzzy Modeling , 2004, Int. J. Hybrid Intell. Syst..

[33]  Mauro Dragoni,et al.  Applied cognitive computing: challenges, approaches, and real-world experiences , 2018, Progress in Artificial Intelligence.

[34]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[35]  Francisco Herrera,et al.  Big Data: Tutorial and guidelines on information and process fusion for analytics algorithms with MapReduce , 2018, Inf. Fusion.

[36]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[37]  Francisco Herrera,et al.  Genetic fuzzy systems: taxonomy, current research trends and prospects , 2008, Evol. Intell..

[38]  Francisco Herrera,et al.  A MapReduce Approach to Address Big Data Classification Problems Based on the Fusion of Linguistic Fuzzy Rules , 2015, Int. J. Comput. Intell. Syst..

[39]  Lei Liu,et al.  Emergent face orientation recognition with internal neurons of the developmental network , 2018, Progress in Artificial Intelligence.

[40]  Larry J. Eshelman The CHC Adaptive Search Algo-rithm , 1991 .

[41]  Sergio Ramírez-Gallego,et al.  Evolutionary Feature Selection for Big Data Classification: A MapReduce Approach , 2015 .

[42]  Michela Antonelli,et al.  An efficient multi-objective evolutionary fuzzy system for regression problems , 2013, Int. J. Approx. Reason..

[43]  Álvar Arnaiz-González,et al.  MR-DIS: democratic instance selection for big data by MapReduce , 2017, Progress in Artificial Intelligence.

[44]  Reynold Xin,et al.  Apache Spark , 2016 .

[45]  Peide Liu,et al.  Interval-Valued Intuitionistic Fuzzy Power Bonferroni Aggregation Operators and Their Application to Group Decision Making , 2017, Cognitive Computation.

[46]  Pietro Ducange,et al.  A MapReduce-based fuzzy associative classifier for big data , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[47]  Manuel Mucientes,et al.  S-FRULER: Scalable fuzzy rule learning through evolution for regression , 2016, Knowl. Based Syst..

[48]  Dong-Jo Park,et al.  Novel fuzzy logic control based on weighting of partially inconsistent rules using neural network , 2000, J. Intell. Fuzzy Syst..

[49]  Manuel Mucientes,et al.  A genetic fuzzy system for large-scale regression , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[50]  Miao Fan,et al.  Probabilistic Belief Embedding for Large-Scale Knowledge Population , 2016, Cognitive Computation.

[51]  S. García,et al.  An Extension on "Statistical Comparisons of Classifiers over Multiple Data Sets" for all Pairwise Comparisons , 2008 .

[52]  Fei Su,et al.  An Online Sequential Learning Non-parametric Value-at-Risk Model for High-Dimensional Time Series , 2018, Cognitive Computation.

[53]  Francisco Herrera,et al.  Cooperative Evolutionary Learning of Linguistic Fuzzy Rules and Parametric Aggregation Connectors for Mamdani Fuzzy Systems , 2007, IEEE Transactions on Fuzzy Systems.

[54]  María José del Jesús,et al.  Big Data with Cloud Computing: an insight on the computing environment, MapReduce, and programming frameworks , 2014, WIREs Data Mining Knowl. Discov..

[55]  Francisco Herrera,et al.  Cost-sensitive linguistic fuzzy rule based classification systems under the MapReduce framework for imbalanced big data , 2015, Fuzzy Sets Syst..

[56]  Aart J. C. Bik,et al.  Pregel: a system for large-scale graph processing , 2010, SIGMOD Conference.

[57]  David J. Sheskin,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 1997 .

[58]  Huayou Chen,et al.  On Intuitionistic Fuzzy Copula Aggregation Operators in Multiple- Attribute Decision Making , 2018, Cognitive Computation.

[59]  José Cristóbal Riquelme Santos,et al.  An approach to validity indices for clustering techniques in Big Data , 2018, Progress in Artificial Intelligence.