Feature-level fusion of mental task’s brain signal for an efficient identification system

Abstract In this research, we have explored the canonical correlation analysis (CCA) to improve the performance of the identification system that involves multiple correlated modalities. In particular, we consider the electroencephalogram signal of different mental task performed by the subject such as breathing, mental mathematics, and geometric figure rotation, visual counting and mental letter composing. Our motivation based on the fusion of feature vector of mental task using canonical correlation analysis, where feature set extraction using empirical mode decomposition and information theoretic measure and statistical measurement. In order to classify the fused vector from different mental, we have used linear vector quantization (LVQ) neural network and its extension LVQ2. The results of the experiments testing the performance have been evaluated with two profiles of the database. We have observed canonical correlation-based fusion providing the better results in comparison with simple fusion rule. The novelty of this research is the new feature generation using fused feature of distinct mental task based on CCA.

[1]  Manuel Graña,et al.  Neuro-evolutionary mobile robot egomotion estimation with a 3D ToF camera , 2011, Neural Computing and Applications.

[2]  Keigo Watanabe,et al.  Controlling a robot manipulator with fuzzy voice commands using a probabilistic neural network , 2007, Neural Computing and Applications.

[3]  Abhishek Vaish,et al.  Brainwave based user identification system: A pilot study in robotics environment , 2015, Robotics Auton. Syst..

[4]  Weiming Liu,et al.  A novel feature selection algorithm based on LVQ hypothesis margin , 2013, Neural Computing and Applications.

[5]  G.K. Singhal,et al.  Person Identification Using Evoked Potentials and Peak Matching , 2007, 2007 Biometrics Symposium.

[6]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[7]  Shaocheng Tong,et al.  Adaptive neural control using reinforcement learning for a class of robot manipulator , 2014, Neural Computing and Applications.

[8]  A. Murat Tekalp,et al.  Audiovisual Synchronization and Fusion Using Canonical Correlation Analysis , 2007, IEEE Transactions on Multimedia.

[9]  Abhishek Vaish,et al.  Brainwave's energy feature extraction using wavelet transform , 2014, 2014 IEEE Students' Conference on Electrical, Electronics and Computer Science.

[10]  Phalguni Gupta,et al.  Feature level fusion of face and palmprint biometrics by isomorphic graph-based improved K-medoids partitioning , 2010 .

[11]  Robert M. Haralick,et al.  A Metric for Comparing Relational Descriptions , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Hongbo Wang,et al.  Self-localization and obstacle avoidance for a mobile robot , 2009, Neural Computing and Applications.

[13]  Yoshio Inoue,et al.  Identification of a golf swing robot using soft computing approach , 2011, Neural Computing and Applications.

[14]  Phalguni Gupta,et al.  Feature Level Fusion of Face and Palmprint Biometrics , 2010, SSPR/SPR.

[15]  Günther Palm,et al.  A neural framework for adaptive robot control , 2009, Neural Computing and Applications.

[16]  Tsung-Hsien Yang,et al.  Combining GRN Modeling and Demonstration-Based Programming for Robot Control , 2009, EANN.

[17]  Bingrong Hong,et al.  Multi-robot task allocation using CNP combines with neural network , 2012, Neural Computing and Applications.

[18]  Jian Yang,et al.  Feature fusion: parallel strategy vs. serial strategy , 2003, Pattern Recognit..

[19]  Jian Yang,et al.  Generalized K-L transform based combined feature extraction , 2002, Pattern Recognit..

[20]  Erol Sahin,et al.  Steering self-organized robot flocks through externally guided individuals , 2010, Neural Computing and Applications.

[21]  Qiang Zhou,et al.  A novel multiset integrated canonical correlation analysis framework and its application in feature fusion , 2011, Pattern Recognit..

[22]  Phalguni Gupta,et al.  Feature Level Fusion of Face and Palmprint Biometrics by Isomorphic Graph-Based Improved K-Medoids Partitioning , 2010, AST/UCMA/ISA/ACN.

[23]  Fei Su,et al.  EEG-based Personal Identification: from Proof-of-Concept to A Practical System , 2010, 2010 20th International Conference on Pattern Recognition.

[24]  Elio Tuci,et al.  On the evolution of homogeneous two-robot teams: clonal versus aclonal approaches , 2014, Neural Computing and Applications.

[25]  T. Asano,et al.  ENTROPY , RELATIVE ENTROPY , AND MUTUAL INFORMATION , 2008 .

[26]  Yaonan Wang,et al.  Neural network-based self-learning control for power transmission line deicing robot , 2011, Neural Computing and Applications.

[27]  V. Kamakshi Prasad,et al.  Speaker Identification Using Empirical Mode Decomposition-Based Voice Activity Detection Algorithm under Realistic Conditions , 2014, J. Intell. Syst..

[28]  Abhishek Vaish,et al.  Feature extraction using emprical mode decomposition for biometric system , 2014, 2014 International Conference on Signal Propagation and Computer Technology (ICSPCT 2014).

[29]  Ching Y. Suen,et al.  A Method of Combining Multiple Experts for the Recognition of Unconstrained Handwritten Numerals , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Massimo Tistarelli,et al.  Robust Multi-modal and Multi-unit Feature Level Fusion of Face and Iris Biometrics , 2009, ICB.

[31]  Se-Young Oh,et al.  An optimized modular neural network controller based on environment classification and selective sensor usage for mobile robot reactive navigation , 2006, Neural Computing and Applications.

[32]  Z. Keirn,et al.  A new mode of communication between man and his surroundings , 1990, IEEE Transactions on Biomedical Engineering.

[33]  C. A. Murthy,et al.  Generation of new points for training set and feature-level fusion in multimodal biometric identification , 2013, Machine Vision and Applications.

[34]  S. Sigurdsson,et al.  Reliability of quantitative EEG features , 2007, Clinical Neurophysiology.