Outlier robust fuzzy active learning method (ALM)

Active Learning Method (ALM) is a fuzzy learning method and is inspired by the approach of human's brain toward understanding complicated problems. In this algorithm, a Multi-Input Single-Output system is modeled by some Single-Input Single-Output sub-systems. Each sub-model tries to capture the input-output relationship of each sub-system on a plane called IDS plane. The output of the original system is then approximated by fuzzy aggregation of the output of all submodels. The most important step in ALM, though, is to choose an appropriate radius for ink drop spread, to achieve desirable result. In this paper, a novel method, based on the idea of K-Nearest Neighbor (KNN) algorithm, is proposed to locally choose appropriate radius for ink drop spread according to the density of the data points in each region of the IDS plane. It will be shown that by this criterion, not only the sparsity of data points in different regions of the dataset is taken into account, but also the algorithm will be equipped with the capability to identify and filter out the outliers. The mathematical analysis of this method is provided to confirm its validity and simulations were conducted on various datasets in order to evaluate its efficiency.

[1]  Rene Preusker,et al.  Application of the Active Learning Method for the estimation of geophysical variables in the Caspian Sea from satellite ocean colour observations , 2007 .

[2]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[3]  Farnood Merrikh-Bayat,et al.  Memristor Crossbar-Based Hardware Implementation of the IDS Method , 2010, IEEE Transactions on Fuzzy Systems.

[4]  Masayuki Murakami,et al.  A study on the modeling ability of the IDS method: A soft computing technique using pattern-based information processing , 2007, Int. J. Approx. Reason..

[5]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[6]  Farnood Merrikh-Bayat,et al.  Using a memristor crossbar structure to implement a novel adaptive real-time fuzzy modeling algorithm , 2013, Fuzzy Sets Syst..

[7]  S.B. Shouraki,et al.  Genetic Ink Drop Spread , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.

[8]  Nakaji Honda,et al.  Recursive Fuzzy Modeling Based on Fuzzy Interpolation , 1999, J. Adv. Comput. Intell. Intell. Informatics.

[9]  Saeed Bagheri Shouraki,et al.  Reinforcement Learning Based on Active Learning Method , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.

[10]  Saeed Bagheri Shouraki,et al.  An Optimal Hardware Implementation for Active Learning Method Based on Memristor Crossbar Structures , 2014, IEEE Systems Journal.

[11]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[12]  Masayuki Murakami,et al.  Classification performance of the IDS method based on the two-spiral benchmark , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.