Complexity-Constrained Feature Selection for Classification

Continuous monitoring of audio-visual context on mobile devices requires algorithms with gentle demands on computational resources. Existing feature selection strategies for classification do not account for the complexity associated with feature extraction. We present a complexity-constrained feature selection algorithm that is independent of the classifier architecture and demonstrate that it leads to superior feature sets if the allowed computational complexity is limited.

[1]  Roberto Battiti,et al.  Using mutual information for selecting features in supervised neural net learning , 1994, IEEE Trans. Neural Networks.

[2]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Vesa T. Peltonen,et al.  Audio-based context recognition , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[4]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[5]  F. Fleuret Fast Binary Feature Selection with Conditional Mutual Information , 2004, J. Mach. Learn. Res..

[6]  Ron Kohavi,et al.  Irrelevant Features and the Subset Selection Problem , 1994, ICML.