An online rule weighting method to classify data streams

Evolving fuzzy rule-based structures represent extremely powerful methods for online classification of data streams. The fuzzy rules are generated, modified and removed automatically in these systems. One of the simplest but efficient algorithms of this type is evolving classifier (eClass) that constructs the rules without any prior knowledge, starting “from scratch”. However, this algorithm cannot cope properly with drift and shift in the concept of data. In this paper, we propose a new efficient online method to increase the performance of this algorithm by setting a suitable weight for each rule and handle the drift and shift in the concept of data. By adjusting proper weights, the zone of influence of each rule can be easily controlled and changed regarding the restyling of the environment. Our weight adjusting algorithm is based on an efficient batch mode weight adjusting method that is developed to be consistent with characteristics of data streams. The proposed algorithm is evaluated on some standard data sets of UCI Repository and some real world data streams, and compared with the eClass algorithm. The results show that the proposed algorithm outperforms the eClass approach, and has significant improvement in most cases.

[1]  Hisao Ishibuchi,et al.  Rule weight specification in fuzzy rule-based classification systems , 2005, IEEE Transactions on Fuzzy Systems.

[2]  Hisao Ishibuchi,et al.  Adaptive fuzzy rule-based classification systems , 1996, IEEE Trans. Fuzzy Syst..

[3]  Chengqi Zhang,et al.  A Novel Prototype Reduction Method for the K-Nearest Neighbor Algorithm with K >= 1 , 2010, PAKDD.

[4]  Plamen P. Angelov,et al.  Handling drifts and shifts in on-line data streams with evolving fuzzy systems , 2011, Appl. Soft Comput..

[5]  W. Marsden.  I and J , 2012 .

[6]  Plamen P. Angelov,et al.  An approach for fuzzy rule-base adaptation using on-line clustering , 2004, Int. J. Approx. Reason..

[7]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  Abraham Kandel,et al.  Real-time data mining of non-stationary data streams from sensor networks , 2008, Inf. Fusion.

[9]  Plamen P. Angelov,et al.  Architectures for evolving fuzzy rule-based classifiers , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[10]  Plamen Angelov,et al.  Evolving Rule-Based Models: A Tool For Design Of Flexible Adaptive Systems , 2002 .

[11]  Plamen P. Angelov,et al.  Evolving Fuzzy-Rule-Based Classifiers From Data Streams , 2008, IEEE Transactions on Fuzzy Systems.

[12]  Edwin Lughofer,et al.  An approach to model-based fault detection in industrial measurement systems with application to engine test benches , 2006 .

[13]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  D. Brzezinski.  MINING DATA STREAMS WITH CONCEPT DRIFT , 2010 .

[15]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[16]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[17]  Charles Elkan.  KDD'99 Knowledge Discovery Contest , 2000, SIGKDD Explor..

[18]  M. Zolghadri Jahromi,et al.  A cost sensitive learning algorithm for intrusion detection , 2010, 2010 18th Iranian Conference on Electrical Engineering.

[19]  Robert Ivor John,et al.  A method of learning weighted similarity function to improve the performance of nearest neighbor , 2009, Inf. Sci..

[20]  Carlo Zaniolo,et al.  An Adaptive Nearest Neighbor Classification Algorithm for Data Streams , 2005, PKDD.

[21]  Eghbal G. Mansoori,et al.  A weighting function for improving fuzzy classification systems performance , 2007, Fuzzy Sets Syst..

[22]  Mansoor Zolghadri Jahromi,et al.  A Novel Piecewise Linear Clustering Technique Based on Hyper Plane Adjustment , 2008, CSICC.

[23]  Mykola Pechenizkiy,et al.  Handling Local Concept Drift with Dynamic Integration of Classifiers: Domain of Antibiotic Resistance in Nosocomial Infections , 2006, 19th IEEE Symposium on Computer-Based Medical Systems (CBMS'06).

[24]  Plamen P. Angelov,et al.  Identification of evolving fuzzy rule-based models , 2002, IEEE Trans. Fuzzy Syst..

[25]  Mansoor Zolghadri Jahromi,et al.  A proposed method for learning rule weights in fuzzy rule-based classification systems , 2008, Fuzzy Sets Syst..

[26]  Seyed Mostafa Fakhrahmad,et al.  Constructing accurate fuzzy classifiers: A new adaptive method for rule-weight specification , 2008, Int. J. Knowl. Based Intell. Eng. Syst..