Adapting radial basis function neural networks for one-class classification

One-class classification (OCC) is to describe one class of objects, called target objects, and discriminate them from all other possible patterns. In this paper, we propose to adapt radial basis function neural networks (RBFNNs) for OCC. First, target objects are mapped into a feature space by using neurons in the hidden layer of the RBFNNs. Then, we perform support vector domain description (SVDD) with linear kernel functions in the feature space to realize OCC. In addition, we also model, in the feature space, the closed sphere centered on the mean of target objects for OCC. Compared to the SVDD with nonlinear kernel functions, our methods can use flexible nonlinear mappings, which do not necessarily satisfy Mercerpsilas conditions. Moreover, we can also control the complexity of solutions easily by setting the number of neurons in the hidden layer of RBFNNs. Experimental results show that the classification accuracies of our methods can be close to, and even can reach those of the SVDD for most of results, but with typically much sparser models.

[1]  Doheon Lee,et al.  Improving support vector data description using local density degree , 2005, Pattern Recognit..

[2]  Li Zhang,et al.  Hidden space support vector machines , 2004, IEEE Transactions on Neural Networks.

[3]  Robert P. W. Duin,et al.  Support Vector Data Description , 2004, Machine Learning.

[4]  Ivor W. Tsang,et al.  SVDD-Based Pattern Denoising , 2007, Neural Computation.

[5]  Sameer Singh,et al.  Novelty detection: a review - part 2: : neural network based approaches , 2003, Signal Process..

[6]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[7]  David M. J. Tax,et al.  One-class classification , 2001 .

[8]  Daewon Lee,et al.  Domain described support vector classifier for multi-classification problems , 2007, Pattern Recognit..

[9]  Robert P. W. Duin,et al.  Support vector domain description , 1999, Pattern Recognit. Lett..

[10]  Hava T. Siegelmann,et al.  Support Vector Clustering , 2002, J. Mach. Learn. Res..

[11]  David Casasent,et al.  Radial basis function neural networks for nonlinear Fisher discrimination and Neyman-Pearson classification , 2003, Neural Networks.

[12]  Robert P. W. Duin,et al.  A Study On Combining Image Representations For Image Classification And Retrieval , 2004, Int. J. Pattern Recognit. Artif. Intell..

[13]  Dae-Won Kim,et al.  Density-Induced Support Vector Data Description , 2007, IEEE Transactions on Neural Networks.