Selecting discriminative features with discriminative multiple canonical correlation analysis for multi-feature information fusion

In this paper, it presents a novel approach for selecting discriminative features in multimodal information fusion based discriminative multiple canonical correlation analysis (DMCCA), which is the generalized form of canonical correlation analysis (CCA), multiple canonical correlation analysis (MCCA) and discriminative canonical correlation analysis (DCCA). The proposed approach identifies the discriminative features from the multi-feature in Fractional Fourier Transform (FRFT) domain, which are capable of simultaneously maximizing the within-class correlation and minimizing the between-class correlation, leading to better utilization of the multi-feature information and producing more effective pattern recognition results. The effectiveness of the introduced solution is demonstrated through extensive experimentation on a visual based emotion recognition problem.

[1]  Vince D. Calhoun,et al.  Joint Blind Source Separation by Multiset Canonical Correlation Analysis , 2009, IEEE Transactions on Signal Processing.

[2]  Yan Liu,et al.  A new method of feature fusion and its application in image recognition , 2005, Pattern Recognit..

[3]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[4]  Ling Guan,et al.  Multimodal information fusion for selected multimedia applications , 2010, Int. J. Multim. Intell. Secur..

[5]  Allan Aasbjerg Nielsen,et al.  Multiset canonical correlations analysis and multispectral, truly multitemporal remote sensing data , 2002, IEEE Trans. Image Process..

[6]  Jing-Yu Yang,et al.  Kernelized discriminative canonical correlation analysis , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.

[7]  Gérard Chollet,et al.  Audio-Visual Speech Synchrony Measure for Talking-Face Identity Verification , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[8]  Soo-Chang Pei,et al.  Two dimensional discrete fractional Fourier transform , 1998, Signal Process..

[9]  H. Ozaktas,et al.  Fourier transforms of fractional order and their optical interpretation , 1993 .

[10]  Colin Fyfe,et al.  Kernel and Nonlinear Canonical Correlation Analysis , 2000, IJCNN.

[11]  Horst Bischof,et al.  Appearance models based on kernel canonical correlation analysis , 2003, Pattern Recognit..

[12]  Lei Gao,et al.  Recognizing Human Emotional State Based on the Phase Information of the Two Dimensional Fractional Fourier Transform , 2010, PCM.

[13]  Lei Gao,et al.  Discriminative Multiple Canonical Correlation Analysis for Multi-feature Information Fusion , 2012, 2012 IEEE International Symposium on Multimedia.

[14]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[15]  Cagatay Candan,et al.  The discrete fractional Fourier transform , 2000, IEEE Trans. Signal Process..

[16]  Luís B. Almeida,et al.  The fractional Fourier transform and time-frequency representations , 1994, IEEE Trans. Signal Process..

[17]  Jian Yang,et al.  Feature fusion: parallel strategy vs. serial strategy , 2003, Pattern Recognit..

[18]  Vince D. Calhoun,et al.  Canonical Correlation Analysis for Data Fusion and Group Inferences , 2010, IEEE Signal Processing Magazine.

[19]  Ling Guan,et al.  Recognizing Human Emotional State From Audiovisual Signals , 2008, IEEE Transactions on Multimedia.

[20]  A. Lohmann.  Image rotation, Wigner rotation, and the fractional Fourier transform , 1993 .

[21]  Ignacio Santamaría,et al.  Canonical correlation analysis (CCA) algorithms for multiple data sets: Application to blind SIMO equalization , 2005, 2005 13th European Signal Processing Conference.

[22]  A. Murat Tekalp,et al.  Audiovisual Synchronization and Fusion Using Canonical Correlation Analysis , 2007, IEEE Transactions on Multimedia.