Learning opposites with evolving rules

The idea of opposition-based learning was introduced 10 years ago. Since then a noteworthy group of researchers has used some notions of oppositeness to improve existing optimization and learning algorithms. Among others, evolutionary algorithms, reinforcement agents, and neural networks have been reportedly extended into their “opposition-based” version to become faster and/or more accurate. However, most works still use a simple notion of opposites, namely linear (or type-I) opposition, that for each x ∈ [a; b] assigns its opposite as x̆I = a + b - x. This, of course, is a very naive estimate of the actual or true (non-linear) opposite x̆II, which has been called type-II opposite in literature. In absence of any knowledge about a function y = f(x) that we need to approximate, there seems to be no alternative to the naivety of type-I opposition if one intents to utilize oppositional concepts. But the question is if we can receive some level of accuracy increase and time savings by using the naive opposite estimate x̆I according to all reports in literature, what would we be able to gain, in terms of even higher accuracies and more reduction in computational complexity, if we would generate and employ true opposites? This work introduces an approach to approximate type-II opposites using evolving fuzzy rules when we first perform “opposition mining”. We show with multiple examples that learning true opposites is possible when we mine the opposites from the training data to subsequently approximate x̆II = f(x; y).

[1]  Shahryar Rahnamayan,et al.  Computing opposition by involving entire population , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[2]  E. Lughofer,et al.  Evolving fuzzy classifiers using different model architectures , 2008, Fuzzy Sets Syst..

[3]  Shahryar Rahnamayan,et al.  Center-based sampling for population-based algorithms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[4]  Shahryar Rahnamayan,et al.  Opposition-Based Differential Evolution Algorithms , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[5]  Jonathan Lawry,et al.  IEEE International Conference on Fuzzy Systems , 2017 .

[6]  Hamid R. Tizhoosh,et al.  EFIS—Evolving Fuzzy Image Segmentation , 2014, IEEE Transactions on Fuzzy Systems.

[7]  Hamid R. Tizhoosh,et al.  Opposition-Based Reinforcement Learning , 2006, J. Adv. Comput. Intell. Intell. Informatics.

[8]  Plamen P. Angelov,et al.  Evolving Fuzzy-Rule-Based Classifiers From Data Streams , 2008, IEEE Transactions on Fuzzy Systems.

[9]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[10]  Mario Ventresca,et al.  Opposite Transfer Functions and Backpropagation Through Time , 2007, 2007 IEEE Symposium on Foundations of Computational Intelligence.

[11]  Mario Ventresca,et al.  Oppositional Concepts in Computational Intelligence , 2008, Oppositional Concepts in Computational Intelligence.

[12]  Shahryar Rahnamayan,et al.  Oppositional fuzzy image thresholding , 2010, International Conference on Fuzzy Systems.

[13]  Edwin Lughofer,et al.  On-line evolving image classifiers and their application to surface inspection , 2010, Image Vis. Comput..

[14]  Shahryar Rahnamayan,et al.  Opposition versus randomness in soft computing techniques , 2008, Appl. Soft Comput..

[15]  Hamid R. Tizhoosh Opposite Fuzzy Sets with Applications in Image Processing , 2009, IFSA/EUSFLAT Conf..

[16]  Edwin Lughofer,et al.  Evolving Fuzzy Systems - Fundamentals, Reliability, Interpretability, Useability and Applications , 2015, IJCCI.

[17]  Shahryar Rahnamayan,et al.  Type-II opposition-based differential evolution , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[18]  Shahryar Rahnamayan,et al.  A novel population initialization method for accelerating evolutionary algorithms , 2007, Comput. Math. Appl..

[19]  Plamen P. Angelov,et al.  PANFIS: A Novel Incremental Learning Machine , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Plamen P. Angelov,et al.  A fuzzy controller with evolving structure , 2004, Inf. Sci..

[21]  Li Zhao,et al.  A review of opposition-based learning from 2005 to 2012 , 2014, Eng. Appl. Artif. Intell..

[22]  Shahryar Rahnamayan,et al.  Image thresholding using micro opposition-based Differential Evolution (Micro-ODE) , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[23]  Mahardhika Pratama,et al.  Generalized smart evolving fuzzy systems , 2015, Evol. Syst..

[24]  Kumaraswamy Ponnambalam,et al.  Oppositional extension of reinforcement learning techniques , 2014, Inf. Sci..

[25]  Hamid R. Tizhoosh,et al.  Quasi-global oppositional fuzzy thresholding , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[26]  Hamid R. Tizhoosh,et al.  Reinforcement Learning Based on Actions and Opposite Actions , 2005 .

[27]  Ronald R. Yager,et al.  A model of participatory learning , 1990, IEEE Trans. Syst. Man Cybern..

[28]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[29]  Shahryar Rahnamayan,et al.  An intuitive distance-based explanation of opposition-based sampling , 2012, Appl. Soft Comput..

[30]  H.R. Tizhoosh,et al.  Application of Opposition-Based Reinforcement Learning in Image Segmentation , 2007, 2007 IEEE Symposium on Computational Intelligence in Image and Signal Processing.

[31]  Arthur L. Dexter,et al.  On-line identification of computationally undemanding evolving fuzzy models , 2007, Fuzzy Sets Syst..

[32]  Shahryar Rahnamayan,et al.  Centroid Opposition-Based Differential Evolution , 2014, Int. J. Appl. Metaheuristic Comput..

[33]  Hamid R. Tizhoosh,et al.  Opposition-Based Learning: A New Scheme for Machine Intelligence , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[34]  Hamid R. Tizhoosh,et al.  Evolving fuzzy image segmentation , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[35]  Edwin Lughofer,et al.  Evolving Fuzzy Systems - Methodologies, Advanced Concepts and Applications , 2011, Studies in Fuzziness and Soft Computing.

[36]  Plamen P. Angelov,et al.  Identification of evolving fuzzy rule-based models , 2002, IEEE Trans. Fuzzy Syst..

[37]  Mario Ventresca,et al.  Simulated Annealing with Opposite Neighbors , 2007, 2007 IEEE Symposium on Foundations of Computational Intelligence.

[38]  Plamen P. Angelov Evolving fuzzy systems , 2008, Scholarpedia.

[39]  P. Angelov,et al.  Evolving rule-based models: A tool for intelligent adaptation , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).