Semisupervised Dynamic Fuzzy K -Nearest Neighbors

This chapter presents a semi-supervised dynamic classification method to deal with the problem of diagnosis of industrial evolving systems. Indeed, when a functioning mode evolves, the system characteristics change and the observations, i.e. the patterns representing observations in the feature space, obtained on the system change too. Thus, each class membership function must be adapted to take into account these temporal changes and to keep representative patterns only. This requires an adaptive method with a mechanism for adjusting its parameters over time. The developed approach is named Semi-Supervised Dynamic Fuzzy K-Nearest Neighbors (SS-DFKNN) and comprises three phases: a detection phase to detect and confirm classes evolutions, an adaptation phase realized incrementally to update the evolved classes parameters and to create new classes if necessary and a validation phase to keep useful classes only. To illustrate this approach, the diagnosis of a welding system is realized to detect the weldings quality (good or bad), based on acoustic noises issued of weldings operations.

[1]  David G. Stork,et al.  Pattern Classification , 1973 .

[2]  S. Maouche,et al.  Self-adaptive kernel machine: online clustering in RKHS , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[3]  Plamen P. Angelov,et al.  A fuzzy controller with evolving structure , 2004, Inf. Sci..

[4]  Edwin Lughofer,et al.  Evolving Fuzzy Systems - Methodologies, Advanced Concepts and Applications , 2011, Studies in Fuzziness and Soft Computing.

[5]  Fabio Gagliardi Cozman,et al.  Semi-Supervised Learning of Mixture Models , 2003, ICML.

[6]  Plamen P. Angelov,et al.  Handling drifts and shifts in on-line data streams with evolving fuzzy systems , 2011, Appl. Soft Comput..

[7]  Hichem Frigui,et al.  A robust algorithm for automatic extraction of an unknown number of clusters from noisy data , 1996, Pattern Recognit. Lett..

[8]  I. Elmi,et al.  Adaptive K-NN for the detection of air pollutants with a sensor array , 2004, IEEE Sensors Journal.

[9]  Plamen Angelov,et al.  Evolving Intelligent Systems: Methodology and Applications , 2010 .

[10]  Hichem Frigui,et al.  Clustering by competitive agglomeration , 1997, Pattern Recognit..

[11]  G. Nakhaeizadeh,et al.  Dynamic Supervised Learning: Some Basic Issues and Application Aspects , 1997 .

[12]  Michael Werman,et al.  An On-Line Agglomerative Clustering Method for Nonstationary Data , 1999, Neural Computation.

[13]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Jan Kybic Incremental Updating of Nearest Neighbor-Based High-Dimensional Entropy Estimation , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[15]  Yang Song,et al.  IKNN: Informative K-Nearest Neighbor Pattern Classification , 2007, PKDD.

[16]  Gancho Vachkov Online Classification of Machine Operation Modes Based on Information Compression and Fuzzy Similarity Analysis , 2009, IFSA/EUSFLAT Conf..

[17]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[18]  Sargur N. Srihari,et al.  A fast algorithm for finding k-nearest neighbors with non-metric dissimilarity , 2002, Proceedings Eighth International Workshop on Frontiers in Handwriting Recognition.

[19]  D. Auslander,et al.  Adaptive classification of myocardial electrogram waveforms , 1994, IEEE Transactions on Biomedical Engineering.

[20]  C. W. Therrien,et al.  Decision, Estimation and Classification: An Introduction to Pattern Recognition and Related Topics , 1989 .

[21]  Fabio Gagliardi Cozman,et al.  Semi-Supervised Learning of Mixture Models and Bayesian Networks , 2003 .

[22]  Beatrice Gralton,et al.  Washington DC - USA , 2008 .

[23]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[24]  Nikola Kasabov,et al.  Evolving Connectionist Systems: The Knowledge Engineering Approach , 2007 .

[25]  Vincent Garcia,et al.  Suivi d'objets d'intérêt dans une séquence d'images : des points saillants aux mesures statistiques , 2008 .

[26]  Eyke Hüllermeier,et al.  Efficient instance-based learning on data streams , 2007, Intell. Data Anal..

[27]  Andrzej Bargiela,et al.  General fuzzy min-max neural network for clustering and classification , 2000, IEEE Trans. Neural Networks Learn. Syst..

[28]  Carlo Zaniolo,et al.  An Adaptive Nearest Neighbor Classification Algorithm for Data Streams , 2005, PKDD.