Steady-State Motion Visual Evoked Potential (SSMVEP) Enhancement Method Based on Time-Frequency Image Fusion

The steady-state motion visual evoked potential (SSMVEP) collected from the scalp suffers from strong noise and is contaminated by artifacts such as the electrooculogram (EOG) and the electromyogram (EMG). Spatial filtering methods can fuse the information of different brain regions, which is beneficial for the enhancement of the active components of the SSMVEP. Traditional spatial filtering methods fuse electroencephalogram (EEG) in the time domain. Based on the idea of image fusion, this study proposed an SSMVEP enhancement method based on time-frequency (T-F) image fusion. The purpose is to fuse SSMVEP in the T-F domain and improve the enhancement effect of the traditional spatial filtering method on SSMVEP active components. Firstly, two electrode signals were transformed from the time domain to the T-F domain via short-time Fourier transform (STFT). The transformed T-F signals can be regarded as T-F images. Then, two T-F images were decomposed via two-dimensional multiscale wavelet decomposition, and both the high-frequency coefficients and low-frequency coefficients of the wavelet were fused by specific fusion rules. The two images were fused into one image via two-dimensional wavelet reconstruction. The fused image was subjected to mean filtering, and finally, the fused time-domain signal was obtained by inverse STFT (ISTFT). The experimental results show that the proposed method has better enhancement effect on SSMVEP active components than the traditional spatial filtering methods. This study indicates that it is feasible to fuse SSMVEP in the T-F domain, which provides a new idea for SSMVEP analysis.

[1]  Gert Pfurtscheller,et al.  Mining multi-channel EEG for its information content: an ANN-based method for a brain-computer interface , 1998, Neural Networks.

[2]  Guanghua Xu,et al.  The Role of Visual Noise in Influencing Mental Load and Fatigue in a Steady-State Motion Visual Evoked Potential-Based Brain-Computer Interface , 2017, Sensors.

[3]  Ximei Zhao,et al.  Panchromatic and multi-spectral image fusion method based on two-step sparse representation and wavelet transform , 2017, 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[4]  Rik Pintelon,et al.  Welch Method Revisited: Nonparametric Power Spectrum Estimation Via Circular Overlap , 2010, IEEE Transactions on Signal Processing.

[5]  Bin Zhang,et al.  Study on image fusion based on different fusion rules of wavelet transform , 2010, 2010 3rd International Conference on Advanced Computer Theory and Engineering(ICACTE).

[6]  Chun-Yi Su,et al.  Mind Control of a Robotic Arm With Visual Fusion Technology , 2018, IEEE Transactions on Industrial Informatics.

[7]  J R Wolpaw,et al.  Spatial filter selection for EEG-based communication. , 1997, Electroencephalography and clinical neurophysiology.

[8]  G Calhoun,et al.  Brain-computer interfaces based on the steady-state visual-evoked response. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[9]  K Joseph Abraham Sundar,et al.  Multi-sensor image fusion based on empirical wavelet transform , 2017, 2017 International Conference on Electrical, Electronics, Communication, Computer, and Optimization Techniques (ICEECCOT).

[10]  Ivan Volosyak,et al.  Multiple Channel Detection of Steady-State Visual Evoked Potentials for Brain-Computer Interfaces , 2007, IEEE Transactions on Biomedical Engineering.

[11]  Shutao Li,et al.  Multifocus image fusion by combining curvelet and wavelet transform , 2008, Pattern Recognit. Lett..

[12]  J. Wolpaw,et al.  Multichannel EEG-based brain-computer communication. , 1994, Electroencephalography and clinical neurophysiology.

[13]  Xiaorong Gao,et al.  Frequency and Phase Mixed Coding in SSVEP-Based Brain--Computer Interface , 2011, IEEE Transactions on Biomedical Engineering.

[14]  Reinhold Scherer,et al.  Steady-state visual evoked potential (SSVEP)-based communication: impact of harmonic frequency components , 2005, Journal of neural engineering.

[15]  Giuseppe Andreoni,et al.  A Robust and Self-Paced BCI System Based on a Four Class SSVEP Paradigm: Algorithms and Protocols for a High-Transfer-Rate Direct Brain Communication , 2009, Comput. Intell. Neurosci..

[16]  Eduardo Caicedo Bravo,et al.  Feature extraction techniques based on power spectrum for a SSVEP-BCI , 2014, 2014 IEEE 23rd International Symposium on Industrial Electronics (ISIE).

[17]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[18]  Long Chen,et al.  A visual parallel-BCI speller based on the time–frequency coding strategy , 2014, Journal of neural engineering.

[19]  Guanghua Xu,et al.  Four Novel Motion Paradigms Based on Steady-State Motion Visual Evoked Potential , 2018, IEEE Transactions on Biomedical Engineering.

[20]  Wei Wu,et al.  Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs , 2007, IEEE Transactions on Biomedical Engineering.

[21]  Bhawani Shankar,et al.  Multi Focus Image Fusion using Combined Median and Average Filter based Hybrid Stationary Wavelet Transform and Principal Component Analysis , 2018 .

[22]  Carl D. Meyer,et al.  Matrix Analysis and Applied Linear Algebra , 2000 .

[23]  Heung-No Lee,et al.  Noise robustness analysis of sparse representation based classification method for non-stationary EEG signal classification , 2015, Biomed. Signal Process. Control..