Ellipsoidal/radial basis functions neural networks enhanced with the Rvachev function method in application problems

Abstract A new type of multi-centered basis function neural networks (MCBFNNs), that are the generalization and extension of ellipsoidal/radial basis functions neural networks (E/RBFNNs), is introduced. This paper aims to further elaborate a method of supervised binary clusters classification and identification using Radial Basis Function Neural Networks (RBFNNs) enhanced with the Rvachev Function Method (RFM) in complex non-convex, disconnected domains. Practical numerical examples are presented only in particular cases of MCBFNNs for E/RBFNNs enhanced with the RFM. R -functions are used to construct complex pattern cluster domains, parameters of which are applied to E/RBFNNs to establish domain boundaries for pattern binary classification or parameters for systems identification. The error functional is a convex quadratic one with respect to weight functions which take weight values on the discrete connectors between neurons. The activation function of neurons of E/RBFNNs is the signum function, and, therefore, the error functional is non-smooth. The feed forward Neural Networks with the delta supervised learning rule during training phase is applied. The sub-gradient of the discretized error function is used rather than its gradient, because it is not smooth. The application of the RFM allows for the creation, implementation, and resolution of large heterogeneous Neural Networks capable of solving diverse sets of binary classification problems with greater accuracy. Numerical explorations in clustering and classification substantiate concepts and assumptions. Applications to human hearing sensitivity and identification of a dynamical system are presented on numerical examples.

[1]  Ludmila I. Kuncheva,et al.  Fuzzy Classifier Design , 2000, Studies in Fuzziness and Soft Computing.

[2]  B. Yegnanarayana,et al.  Artificial Neural Networks , 2004 .

[3]  Sheng Chen,et al.  Recursive hybrid algorithm for non-linear system identification using radial basis function networks , 1992 .

[4]  W Rutherford,et al.  A New Theory of Hearing. , 1886, Journal of anatomy and physiology.

[5]  Francesco Masulli,et al.  A survey of kernel and spectral methods for clustering , 2008, Pattern Recognit..

[6]  László G. Nyúl,et al.  Directional Convexity Measure for Binary Tomography , 2013, CIARP.

[7]  P. N. Suganthan,et al.  Robust growing neural gas algorithm with application in cluster analysis , 2004, Neural Networks.

[8]  Chidchanok Lursinsap,et al.  Very short time environmental sound classification based on spectrogram pattern matching , 2013, Inf. Sci..

[9]  H. Charles Romesburg,et al.  Cluster analysis for researchers , 1984 .

[10]  Holger Wendland,et al.  Scattered Data Approximation: Conditionally positive definite functions , 2004 .

[11]  Carl G. Looney,et al.  Pattern recognition using neural networks: theory and algorithms for engineers and scientists , 1997 .

[12]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[13]  David M. Skapura,et al.  Neural networks - algorithms, applications, and programming techniques , 1991, Computation and neural systems series.

[14]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[15]  Boris Mirkin,et al.  Mathematical Classification and Clustering , 1996 .

[16]  John A. Hartigan,et al.  Clustering Algorithms , 1975 .

[17]  U. Grenander.  Elements of Pattern Theory , 1996 .

[18]  David G. Stork,et al.  Pattern Classification , 1973 .

[19]  D. Green.  An introduction to hearing , 1976 .

[20]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.

[21]  Narasimhan Sundararajan,et al.  Radial Basis Function Neural Networks With Sequential Learning: Mran and Its Applications , 1999 .

[22]  G. Wahba,et al.  Multicategory Support Vector Machines , Theory , and Application to the Classification of Microarray Data and Satellite Radiance Data , 2004 .

[23]  R. Liboff.  Introductory quantum mechanics , 1980 .

[24]  P. Mikusinski,et al.  Introduction to Hilbert spaces with applications , 1990 .

[25]  Perry R. Cook,et al.  Towards Automatic Musical Instrument Timbre Recognition , 2010 .

[26]  Mark S. Varvak,et al.  Pattern Classification Using Radial Basis Function Neural Networks Enhanced with the Rvachev Function Method , 2011, CIARP.

[27]  Chris Schmandt.  Voice communication with computers: conversational systems , 1994 .

[28]  Martin D. Buhmann,et al.  Radial Basis Functions: Theory and Implementations: Preface , 2003 .

[29]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[30]  G. Békésy,et al.  Experiments in Hearing , 1963 .

[31]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[32]  Terrence L. Fine,et al.  Feedforward Neural Network Methodology , 1999, Information Science and Statistics.

[33]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[34]  Geoffrey J. McLachlan,et al.  Mixture models : inference and applications to clustering , 1989 .

[35]  D. L. Reilly,et al.  A neural model for category learning , 1982, Biological Cybernetics.

[36]  W. Yost.  Fundamentals of hearing: An introduction , 1977 .

[37]  Chidchanok Lursinsap,et al.  Handling imbalanced data sets with synthetic boundary data generation using bootstrap re-sampling and AdaBoost techniques , 2013, Pattern Recognit. Lett..

[38]  László Szilágyi,et al.  An Efficient Approach to Intensity Inhomogeneity Compensation Using c-Means Clustering Models , 2011, CIARP.

[39]  Clifford Lau,et al.  Neural Networks: Theoretical Foundations and Analysis , 1991 .

[40]  Hugo Fastl,et al.  Psychoacoustics: Facts and Models , 1990 .

[41]  Kishore Prahallad,et al.  AANN: an alternative to GMM for pattern recognition , 2002, Neural Networks.