Classification of Volatile Organic Compounds with Incremental SVMs and RBF Networks

Support Vector Machines (SVMs) have been applied to solve the classification of volatile organic compounds (VOC) data in some recent studies. SVMs provide good generalization performance in detection and classification of VOC data. However, in many applications involving VOC data, it is not unusual for additional data, which may include new classes, to become available over time, which then requires an SVM classifier that is capable of incremental learning that does not suffer from loss of previously acquired knowledge. In our previous work, we have proposed the incremental SVM approach based on Learn++.MT. In this contribution, the ability of SVMLearn++.MT to incrementally classify VOC data is evaluated and compared against a similarly constructed Learn++.MT algorithm that uses radial basis function neural network as base classifiers.

[1]  Robi Polikar,et al.  Learn++.MT: A New Approach to Incremental Learning , 2004, Multiple Classifier Systems.

[2]  Erkki Oja,et al.  Artificial Neural Networks: Formal Models and Their Applications - ICANN 2005, 15th International Conference, Warsaw, Poland, September 11-15, 2005, Proceedings, Part II , 2005, International Conference on Artificial Neural Networks.

[3]  R. French Catastrophic forgetting in connectionist networks , 1999, Trends in Cognitive Sciences.

[4]  Julian W. Gardner,et al.  A brief history of electronic noses , 1994 .

[5]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[6]  R. French,et al.  Catastrophic Forgetting in Connectionist Networks: Causes, Consequences and Solutions , 1994 .

[7]  Zeki Erdem,et al.  Reducing the Effect of Out-Voting Problem in Ensemble Based Incremental Support Vector Machines , 2005, ICANN.

[8]  D. DeCoste,et al.  Support vector machines and kernel fisher discriminants: a case study using electronic nose data , 2001 .

[9]  S. Sathiya Keerthi,et al.  Evaluation of simple performance measures for tuning SVM hyperparameters , 2003, Neurocomputing.

[10]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[11]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[12]  Vasant Honavar,et al.  Learn++: an incremental learning algorithm for supervised neural networks , 2001, IEEE Trans. Syst. Man Cybern. Part C.

[13]  Vasant Honavar,et al.  Detection and identification of odorants using an electronic nose , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[14]  N. Ancona,et al.  Support vector machines for olfactory signals recognition , 2003 .