A SVM active learning method based on confidence, KNN and diversity

Audio is an important part of multimedia, and it has many useful applications in real life. Audio event classification is a key technology in audio management and application. Supervised audio event classification requires labeling large amounts of samples, while manual labeling is a very time-consuming work. In this paper we propose SVMCKNND, an active learning method for SVM classifier, to deal with the labeling problem in audio event classification. For SVMCKNND, in each iteration, first, a low-confidence region is delimited; then based on KNN, the samples that are more likely to be on the true class boundary are taken as the informative ones; finally, redundancy that exists in the informative samples is reduced to further decrease manual labeling workload. Experimental results show that SVMCKNND performs better than another two SVM active learning algorithms, especially in classifying small-sample audio events.

[1]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[2]  Xiaowei Xu,et al.  Representative Sampling for Text Classification Using Support Vector Machines , 2003, ECIR.

[3]  Y. Leng,et al.  A BIC Based Initial Training Set Selection Algorithm for Active Learning and Its Application in Audio Detection , 2013 .

[4]  Liang Liu,et al.  Event classification for living environment surveillance using audio sensor networks , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[5]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[6]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[7]  Jingbo Zhu,et al.  Active Learning With Sampling by Uncertainty and Density for Data Annotations , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[8]  Lorenzo Bruzzone,et al.  A Fast Cluster-Assumption Based Active-Learning Technique for Classification of Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Ishwar K. Sethi,et al.  Confidence-based active learning , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Feng Su Auditory scene analysis and recognition with LDA topic model , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[11]  William J. Emery,et al.  SVM Active Learning Approach for Image Classification Using Spatial Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.