Multi-class Nearest Neighbour Classifier for Incomplete Data Handling

The basic nearest neighbour algorithm has been designed to work with complete data vectors. Moreover, it is assumed that each reference sample as well as classified sample belong to one and the only one class. In the paper this restriction has been dismissed. Through incorporation of certain elements of rough set and fuzzy set theories into k-nn classifier we obtain a sample based classifier with new features. In processing incomplete data, the proposed classifier gives answer in the form of rough set, i.e. indicated lower or upper approximation of one or more classes. The basic nearest neighbour algorithm has been designed to work with complete data vectors and assumed that each reference sample as well as classified sample belongs to one and the only one class. Indication of more than one class is a result of incomplete data processing as well as final reduction operation.

[1]  Thomas Villmann,et al.  Fuzzy Labeled Soft Nearest Neighbor Classification with Relevance Learning , 2005, Fourth International Conference on Machine Learning and Applications (ICMLA'05).

[2]  R. Scherer.  Neuro-fuzzy relational systems for nonlinear approximation and prediction , 2009 .

[3]  Marcin Gabryel,et al.  Modified Merge Sort Algorithm for Large Scale Data Sets , 2013, ICAISC.

[4]  Marcin Gabryel,et al.  Evolutionary Learning of Mamdani-Type Neuro-fuzzy Systems , 2006, ICAISC.

[5]  Marcin Gabryel,et al.  Object Detection by Simple Fuzzy Classifiers Generated by Boosting , 2013, ICAISC.

[6]  Z. Pawlak.  Rough Sets: Theoretical Aspects of Reasoning about Data , 1991 .

[7]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[8]  Robert Nowicki,et al.  Rough Neuro-Fuzzy Structures for Classification With Missing Data , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Piotr Duda,et al.  On Fuzzy Clustering of Data Streams with Concept Drift , 2012, ICAISC.

[10]  Piotr Duda,et al.  Adaptation of Decision Trees for Handling Concept Drift , 2013, ICAISC.

[11]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[12]  L. Rutkowski,et al.  Flexible Takagi-Sugeno fuzzy systems , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[13]  Marcin Korytkowski,et al.  From Ensemble of Fuzzy Classifiers to Single Fuzzy Rule Base Classifier , 2006, ICAISC.

[14]  Piotr Gawron,et al.  Dimensionality Reduction of Dynamic Mesh Animations Using HO-SVD , 2013, J. Artif. Intell. Soft Comput. Res..

[15]  Genaro Juárez Martínez,et al.  On the Dynamics of Cellular Automata with Memory , 2015, Fundam. Informaticae.

[16]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[17]  Piotr Duda,et al.  The CART decision tree for mining data streams , 2014, Inf. Sci..

[18]  Lukasz Laskowski,et al.  A novel hybrid-maximum neural network in stereo-matching process , 2012, Neural Computing and Applications.

[19]  Wesam M. Ashour,et al.  Dsmk-Means “Density-Based Split-And-Merge K-Means Clustering Algorithm” , 2013, J. Artif. Intell. Soft Comput. Res..

[20]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[21]  Marcin Gabryel,et al.  Evolutionary Designing of Logic-Type Fuzzy Systems , 2010, ICAISC.

[22]  Jaroslaw Bilski,et al.  Parallel Architectures for Learning the RTRN and Elman Dynamic Neural Networks , 2015, IEEE Transactions on Parallel and Distributed Systems.

[23]  Meng Joo Er,et al.  Online Speed Profile Generation for Industrial Machine Tool Based on Neuro-fuzzy Approach , 2010, ICAISC.

[24]  Magdalena Laskowska,et al.  Mesoporous silica SBA-15 functionalized by nickel–phosphonic units: Raman and magnetic analysis , 2014 .

[25]  Xiaoyong Du,et al.  Improving performance of the k-nearest neighbor classifier by tolerant rough sets , 2001, Proceedings of the Third International Symposium on Cooperative Database Systems for Advanced Applications. CODAS 2001.

[26]  Piotr Duda,et al.  A New Fuzzy Classifier for Data Streams , 2012, ICAISC.

[27]  Jaroslaw Bilski.  Momentum Modification of the RLS Algorithms , 2004, ICAISC.

[28]  Andrzej Bargiela,et al.  Granular clustering: a granular signature of data , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[29]  Ronald R. Yager,et al.  Using fuzzy methods to model nearest neighbor rules , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[30]  Lukasz Laskowski,et al.  Spin-glass Implementation of a Hopfield Neural Structure , 2014, ICAISC.

[31]  Davide Anguita,et al.  A Survey of old and New Results for the Test Error Estimation of a Classifier , 2013, J. Artif. Intell. Soft Comput. Res..

[32]  Piotr Duda,et al.  Decision Trees for Mining Data Streams Based on the Gaussian Approximation , 2014, IEEE Transactions on Knowledge and Data Engineering.

[33]  Robert Nowicki,et al.  On design of flexible neuro-fuzzy systems for nonlinear modelling , 2013, Int. J. Gen. Syst..

[34]  Rafał Scherer,et al.  A Fuzzy Relational System with Linguistic Antecedent Certainty Factors , 2003 .

[35]  Lukasz Laskowski,et al.  Objects Auto-selection from Stereo-Images Realised by Self-Correcting Neural Network , 2012, ICAISC.

[36]  Piotr Duda,et al.  Decision Trees for Mining Data Streams Based on the McDiarmid's Bound , 2013, IEEE Transactions on Knowledge and Data Engineering.

[37]  Robert Nowicki,et al.  On Combining Neuro-Fuzzy Architectures with the Rough Set Theory to Solve Classification Problems with Incomplete Data , 2008, IEEE Transactions on Knowledge and Data Engineering.

[38]  Naohiro Ishii,et al.  Modified Reduct: Nearest Neighbor Classification , 2012, 2012 IEEE/ACIS 11th International Conference on Computer and Information Science.

[39]  Robert Nowicki,et al.  On classification with missing data using rough-neuro-fuzzy systems , 2010, Int. J. Appl. Math. Comput. Sci..

[40]  Lukasz Laskowski,et al.  Self-Correcting Neural Network for Stereo-matching Problem Solving , 2015, Fundam. Informaticae.

[41]  Alexander I. Galushkin,et al.  The Parallel Approach to the Conjugate Gradient Learning Algorithm for the Feedforward Neural Networks , 2014, ICAISC.

[42]  Rafal Scherer,et al.  Fuzzy Number-Based Hierarchical Fuzzy System , 2004, ICAISC.

[43]  Manish Sarkar,et al.  Fuzzy-rough nearest neighbors algorithm , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[44]  Chris Cornelis,et al.  Fuzzy rough positive region based nearest neighbour classification , 2012, 2012 IEEE International Conference on Fuzzy Systems.

[45]  Saharon Shelah,et al.  Borel completeness of some ℵ₀-stable theories , 2015 .

[46]  Naohiro Ishii,et al.  Mapping of nearest neighbor for classification , 2013, 2013 IEEE/ACIS 12th International Conference on Computer and Information Science (ICIS).

[47]  Krystian Lapa,et al.  A new method for designing neuro-fuzzy systems for nonlinear modelling with interpretability aspects , 2014, Neurocomputing.

[48]  Ming He,et al.  Research on Attribute Reduction Using Rough Neighborhood Model , 2008, 2008 International Seminar on Business and Information Management.

[49]  Lukasz Laskowski,et al.  Functionalization of SBA-15 mesoporous silica by Cu-phosphonate units: Probing of synthesis route , 2014 .