Design methodology for Radial Basis Function Neural Networks classifier based on locally linear reconstruction and Conditional Fuzzy C-Means clustering

Abstract In this study, a new design method for Fuzzy Radial Basis Function Neural Networks classifier is proposed. The proposed approach is based on conditional Fuzzy C-Means clustering algorithm realized with the aid of auxiliary information, which is extracted by the locally linear reconstruction algorithm. Conditional Fuzzy C-Means can analyze the distribution of data (patterns) over the input space when being supervised by the auxiliary information. The conditional fuzzy C-Means clustering can substitute the conventional fuzzy C-Means clustering which has been usually used to define the radial basis functions over the input space. It is advocated that the auxiliary information extracted by using the locally linear reconstruction can determine which patterns among the entire data set are more important than the others. This assumption is based on the observation that the data, which cannot be fully reconstructed by the linear combination of their neighbors, may convey much more information than the other data to be reconstructed. It is well known that in the case of radial basis function neural networks classifier, the classification performance of this classifier is predominantly based on the distribution of the radial basis function over the input space. Several experiments are provided to verify the proposed design method for classification problems.

[1]  Sung-Kwun Oh,et al.  Optimized Polynomial Neural Network Classifier Designed with the Aid of Space Search Simultaneous Tuning Strategy and Data Preprocessing Techniques , 2017 .

[2]  Witold Pedrycz,et al.  Conditional Fuzzy C-Means , 1996, Pattern Recognit. Lett..

[3]  Carlos Renjifo,et al.  Improving radial basis function kernel classification through incremental learning and automatic parameter selection , 2008, Neurocomputing.

[4]  Witold Pedrycz,et al.  Image classification with the use of radial basis function neural networks and the minimization of the localized generalization error , 2007, Pattern Recognit..

[5]  Witold Pedrycz,et al.  Improving RBF networks performance in regression tasks by means of a supervised fuzzy clustering , 2006, Neurocomputing.

[6]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[7]  Haralambos Sarimveis,et al.  A hierarchical fuzzy-clustering approach to fuzzy modeling , 2005, Fuzzy Sets Syst..

[8]  Yoichi Hori,et al.  An Algorithm for Extracting Fuzzy Rules Based on RBF Neural Network , 2006, IEEE Transactions on Industrial Electronics.

[9]  José Neves,et al.  Simultaneous Evolution of Neural Network Topologies and Weights for Classification and Regression , 2005, IWANN.

[10]  Witold Pedrycz,et al.  Conditional fuzzy clustering in the design of radial basis function neural networks , 1998, IEEE Trans. Neural Networks.

[11]  Chuen-Tsai Sun,et al.  Neuro-fuzzy And Soft Computing: A Computational Approach To Learning And Machine Intelligence [Books in Brief] , 1997, IEEE Transactions on Neural Networks.

[12]  Witold Pedrycz,et al.  A granular-oriented development of functional radial basis function neural networks , 2008, Neurocomputing.

[13]  Sung-Kwun Oh,et al.  Polynomial-based radial basis function neural networks (P-RBF NNs) and their application to pattern classification , 2010, Applied Intelligence.

[14]  Ming Zeng,et al.  Incremental supervised locally linear embedding for machinery fault diagnosis , 2016, Eng. Appl. Artif. Intell..

[15]  Marco Pintore,et al.  Automatic design of growing radial basis function neural networks based on neighboorhood concepts , 2007 .