CTNN: A Convolutional Tensor-Train Neural Network for Multi-Task Brainprint Recognition

Brainprint is a new type of biometric in the form of EEG, directly linking to intrinsic identity. Currently, most methods for brainprint recognition are based on traditional machine learning and only focus on a single brain cognition task. Due to the ability to extract high-level features and latent dependencies, deep learning can effectively overcome the limitation of specific tasks, but numerous samples are required for model training. Therefore, brainprint recognition in realistic scenes with multiple individuals and small amounts of samples in each class is challenging for deep learning. This paper proposes a Convolutional Tensor-Train Neural Network (CTNN) for the multi-task brainprint recognition with small number of training samples. Firstly, local temporal and spatial features of the brainprint are extracted by the convolutional neural network (CNN) with depthwise separable convolution mechanism. Afterwards, we implement the TensorNet (TN) via low-rank representation to capture the multilinear intercorrelations, which integrates the local information into a global one with very limited parameters. The experimental results indicate that CTNN has high recognition accuracy over 99% on all four datasets, and it exploits brainprint under multi-task efficiently and scales well on training samples. Additionally, our method can also provide an interpretable biomarker, which shows specific seven channels are dominated for the recognition tasks.

[1]  Klaus-Robert Müller,et al.  Interpretable deep neural networks for single-trial EEG classification , 2016, Journal of Neuroscience Methods.

[2]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[3]  Zhanpeng Jin,et al.  Brainprint: Assessing the uniqueness, collectability, and permanence of a novel method for ERP biometrics , 2015, Neurocomputing.

[4]  Zijing Mao,et al.  EEG-based biometric identification with convolutional neural network , 2019, Multimedia Tools and Applications.

[5]  Shinji Watanabe,et al.  High-accuracy user identification using EEG biometrics , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[6]  Yunhao Liu,et al.  MindID: Person Identification from Brain Waves through Aention-based Recurrent Neural Network , 2017 .

[7]  Danilo P. Mandic,et al.  Biometrics from Brain Electrical Activity: A Machine Learning Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Xin-She Yang,et al.  EEG-based person identification through Binary Flower Pollination Algorithm , 2016, Expert Syst. Appl..

[9]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update , 2018, Journal of neural engineering.

[10]  Han-Jeong Hwang,et al.  Individual identification based on resting-state EEG , 2018, 2018 6th International Conference on Brain-Computer Interface (BCI).

[11]  Ramaswamy Palaniappan,et al.  A new method to identify individuals using signals from the brain , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[12]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[13]  Xianzhi Wang,et al.  A survey on deep learning-based non-invasive brain signals: recent advances and new frontiers , 2019, Journal of neural engineering.

[14]  A. Prasad Vinod,et al.  EEG-Based Biometric Authentication Using Gamma Band Power During Rest State , 2017, Circuits, Systems, and Signal Processing.

[15]  Hubert Cecotti,et al.  Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[17]  Na Lu,et al.  A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzmann Machines , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Fabio Babiloni,et al.  Human Brain Distinctiveness Based on EEG Spectral Coherence Connectivity , 2014, IEEE Transactions on Biomedical Engineering.

[19]  Samuel K. Moore "Brainprint" biometric id hits 100% accuracy [News] , 2016 .

[20]  Alexander Novikov,et al.  Tensorizing Neural Networks , 2015, NIPS.

[21]  R. Palaniappan Vision Related Brain Activity for Biometric Authentication , 2006, IECON 2006 - 32nd Annual Conference on IEEE Industrial Electronics.

[22]  Danilo P. Mandic,et al.  Compression and Interpretability of Deep Neural Networks via Tucker Tensor Layer: From First Principles to Tensor Valued Back-Propagation , 2019 .

[23]  Yifan Sun,et al.  Wide Compression: Tensor Ring Nets , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[24]  Vidya Manian,et al.  Automatic person authentication using fewer channel EEG motor imagery , 2016, 2016 World Automation Congress (WAC).

[25]  Ramaswamy Palaniappan,et al.  Individual identification technique using visual evoked potential signals , 2002 .

[26]  Gian Luca Marcialis,et al.  An EEG-Based Biometric System Using Eigenvector Centrality in Resting State Brain Networks , 2015, IEEE Signal Processing Letters.

[27]  Heung-Il Suk,et al.  Person authentication from neural activity of face-specific visual self-representation , 2013, Pattern Recognit..

[28]  Suppawong Tuarob,et al.  EEG-Based Person Authentication Method Using Deep Learning with Visual Stimulation , 2019, 2019 11th International Conference on Knowledge and Smart Technology (KST).

[29]  Benny P. L. Lo,et al.  EEG-based user identification system using 1D-convolutional long short-term memory neural networks , 2019, Expert Syst. Appl..

[30]  José del R. Millán,et al.  Person Authentication Using Brainwaves (EEG) and Maximum A Posteriori Model Adaptation , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Qiaonan Fan,et al.  Task-free brainprint recognition based on low-rank and sparse decomposition model , 2019, Int. J. Data Min. Bioinform..

[32]  Ugur Halici,et al.  A novel deep learning approach for classification of EEG motor imagery signals , 2017, Journal of neural engineering.

[33]  Nikolaos V. Boulgouris,et al.  Gait Recognition Using HMMs and Dual Discriminative Observations for Sub-Dynamics Analysis , 2013, IEEE Transactions on Image Processing.

[34]  Yi Zhang,et al.  A Review of Recent Advances in Identity Identification Technology Based on Biological Features , 2018 .

[35]  Danilo P. Mandic,et al.  EEG Based Biometric Framework for Automatic Identity Verification , 2007, J. VLSI Signal Process..

[36]  Hema A. Murthy,et al.  Task-Independent EEG based Subject Identification using Auditory Stimulus , 2018, Workshop on Speech, Music and Mind (SMM 2018).

[37]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[38]  Andrzej Cichocki,et al.  Tensor Networks for Dimensionality Reduction and Large-scale Optimization: Part 1 Low-Rank Tensor Decompositions , 2016, Found. Trends Mach. Learn..

[39]  Volker Tresp,et al.  Tensor-Train Recurrent Neural Networks for Video Classification , 2017, ICML.

[40]  Ramaswamy Palaniappan,et al.  Recognising Individuals Using Their Brain Patterns , 2005, Third International Conference on Information Technology and Applications (ICITA'05).

[41]  Yufei Huang,et al.  EEG-based biometric identification with deep learning , 2017, 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER).

[42]  Stephen M. Gordon,et al.  EEGNet: A Compact Convolutional Neural Network for EEG-based Brain-Computer Interfaces , 2021 .

[43]  Klaus-Robert Müller,et al.  A convolutional neural network for steady state visual evoked potential classification under ambulatory environment , 2017, PloS one.