Generative and discriminant feature extraction with supervised learning

Standard unsupervised feature extraction methods such as PCA and ICA provide representative features and latent variables which minimizes the data reconstruction error. These generative features may be common to all data, and may not be optimal for classification tasks. The discriminate ICA (dICA) and discriminant NMF (dNMF) had recently been proposed which jointly maximizes Fisher linear discriminant and Negentropy of the extracted features. Motivated by independence among features and modified Fisher linear discriminant, the new algorithm extracts features with both generative and discriminant powers. Then, the features are further fine-tuned by supervised learning. Experimental results show excellent recognition performance with these features.