Weightless neural networks for open set recognition

Open set recognition is a classification-like task. It is accomplished not only by the identification of observations which belong to targeted classes (i.e., the classes among those represented in the training sample which should be later recognized) but also by the rejection of inputs from other classes in the problem domain. The need for proper handling of elements of classes beyond those of interest is frequently ignored, even in works found in the literature. This leads to the improper development of learning systems, which may obtain misleading results when evaluated in their test beds, consequently failing to keep the performance level while facing some real challenge. The adaptation of a classifier for open set recognition is not always possible: the probabilistic premises most of them are built upon are not valid in a open-set setting. Still, this paper details how this was realized for WiSARD a weightless artificial neural network model. Such achievement was based on an elaborate distance-like computation this model provides and the definition of rejection thresholds during training. The proposed methodology was tested through a collection of experiments, with distinct backgrounds and goals. The results obtained confirm the usefulness of this tool for open set recognition.

[1]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[2]  Blaise Hanczar,et al.  Combination of One-Class Support Vector Machines for Classification with Reject Option , 2014, ECML/PKDD.

[3]  Peter L. Bartlett,et al.  Classification with a Reject Option using a Hinge Loss , 2008, J. Mach. Learn. Res..

[4]  Dimitris N. Metaxas,et al.  RO-SVM: Support Vector Machine with Reject Option for Image Categorization , 2006, BMVC.

[5]  Radu Herbei,et al.  Classification with reject option , 2006 .

[6]  Shehroz S. Khan,et al.  A Survey of Recent Trends in One Class Classification , 2009, AICS.

[7]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[8]  Thomas Martini Jørgensen,et al.  Discretization methods for encoding of continuous input variables for Boolean neural networks , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[9]  Terrance E. Boult,et al.  Probability Models for Open Set Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Anderson Rocha,et al.  Toward Open Set Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Chuan-jun Wen,et al.  Hierarchical Face Recognition Based on SVDD and SVM , 2009, 2009 International Conference on Environmental Science and Information Application Technology.

[12]  Eamonn J. Keogh,et al.  Time Series Classification under More Realistic Assumptions , 2013, SDM.

[13]  Heiko Wersing,et al.  Optimal local rejection for classifiers , 2016, Neurocomputing.

[14]  Ming Yuan,et al.  Classification Methods with Reject Option Based on Convex Risk Minimization , 2010, J. Mach. Learn. Res..

[15]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[16]  I. Aleksander,et al.  WISARD·a radical step forward in image recognition , 1984 .

[17]  Éric Gaussier,et al.  A Probabilistic Interpretation of Precision, Recall and F-Score, with Implication for Evaluation , 2005, ECIR.

[18]  Fabio Roli,et al.  Reject option with multiple thresholds , 2000, Pattern Recognit..

[19]  Massimo De Gregorio,et al.  Producing pattern examples from "mental" images , 2010, Neurocomputing.

[20]  Terrance E. Boult,et al.  Multi-class Open Set Recognition Using Probability of Inclusion , 2014, ECCV.

[21]  João Gama,et al.  A bounded neural network for open set recognition , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[22]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.

[23]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[24]  Yves Grandvalet,et al.  Support Vector Machines with a Reject Option , 2008, NIPS.

[25]  P. Mirowski,et al.  Statistical Machine Learning and Dissolved Gas Analysis: A Review , 2012, IEEE Transactions on Power Delivery.

[26]  Fabio Roli,et al.  Support Vector Machines with Embedded Reject Option , 2002, SVM.

[27]  A. Kolcz Application of the CMAC input encoding scheme in the N-tuple approximation net , 1994 .

[28]  Heiko Wersing,et al.  Efficient rejection strategies for prototype-based classification , 2015, Neurocomputing.

[29]  Witold Pedrycz,et al.  Classification with rejection based on various SVM techniques , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[30]  Robert P. W. Duin,et al.  Growing a multi-class classifier with a reject option , 2008, Pattern Recognit. Lett..