A Single-Channel Consumer-Grade EEG Device for Brain–Computer Interface: Enhancing Detection of SSVEP and Its Amplitude Modulation

Brain-Computer interfaces (BCIs) play a significant role in easing neuromuscular patients on controlling computers and prosthetics. Due to their high signal-to-noise ratio, steady-state visually evoked potentials (SSVEPs) has been widely used to build BCIs. However, currently developed algorithms do not predict the modulation of SSVEP amplitude, which is known to change as a function of stimulus luminance contrast. In this study, we aim to develop an integrated approach to simultaneously estimate the frequency and contrast-related amplitude modulations of the SSVEP signal. To achieve that, we developed a behavioral task in which human participants focused on a visual flicking target which the luminance contrast can change through time in several ways. SSVEP signals from 16 subjects were then recorded from electrodes placed at the central occipital site using a low-cost, consumer-grade EEG. Our results demonstrate that the filter bank canonical correlation analysis (FBCCA) performed well in SSVEP frequency recognition, while the support vector regression (SVR) outperformed the other supervised machine learning algorithms in predicting the contrast-dependent amplitude modulations of the SSVEPs. These findings indicate the applicability and strong performance of our integrated method at simultaneously predicting both frequency and amplitude of visually evoked signals, and have proven to be useful for advancing SSVEP-based applications.

[1]  J. Wolpaw,et al.  Clinical Applications of Brain-Computer Interfaces: Current State and Future Prospects , 2009, IEEE Reviews in Biomedical Engineering.

[2]  Justin M. Ales,et al.  The steady-state visual evoked potential in vision research: A review. , 2015, Journal of vision.

[3]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[4]  Shangkai Gao,et al.  A practical VEP-based brain-computer interface. , 2006, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[5]  Yijun Wang,et al.  Visual and Auditory Brain–Computer Interfaces , 2014, IEEE Transactions on Biomedical Engineering.

[6]  Fanglin Chen,et al.  A Speedy Hybrid BCI Spelling Approach Combining P300 and SSVEP , 2014, IEEE Transactions on Biomedical Engineering.

[7]  Matthias M. Müller,et al.  The time course of cortical facilitation during cued shifts of spatial attention , 1998, Nature Neuroscience.

[8]  P. Varona,et al.  Assisted closed-loop optimization of SSVEP-BCI efficiency , 2012, Front. Neural Circuits.

[9]  J. Serences,et al.  Having More Choices Changes How Human Observers Weight Stable Sensory Evidence , 2018, The Journal of Neuroscience.

[10]  Robert Tibshirani,et al.  Discriminant Adaptive Nearest Neighbor Classification and Regression , 1995, NIPS.

[11]  Fanglin Chen,et al.  A novel hybrid BCI speller based on the incorporation of SSVEP into the P300 paradigm , 2013, Journal of neural engineering.

[12]  Marcia Grabowecky,et al.  Attention induces synchronization-based response gain in steady-state visual evoked potentials , 2007, Nature Neuroscience.

[13]  G. Pfurtscheller,et al.  Information transfer rate in a five-classes brain-computer interface , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  E. Donchin,et al.  The contingent negative variation and the late positive wave of the average evoked potential. , 1970, Electroencephalography and clinical neurophysiology.

[15]  Debi Prosad Dogra,et al.  EEG-Based Age and Gender Prediction Using Deep BLSTM-LSTM Network Model , 2019, IEEE Sensors Journal.

[16]  Gina M. Notaro,et al.  Simultaneous EEG, eye-tracking, behavioral, and screen-capture data during online German language learning , 2018, Data in brief.

[17]  P. Welch.  The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[18]  Peng Wang,et al.  Training -Free Steady-State Visual Evoked Potential Brain–Computer Interface Based on Filter Bank Canonical Correlation Analysis and Spatiotemporal Beamforming Decoding , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Wei Wu,et al.  Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs , 2007, IEEE Transactions on Biomedical Engineering.

[20]  J. Schoffelen,et al.  Prestimulus Oscillatory Activity in the Alpha Band Predicts Visual Discrimination Ability , 2008, The Journal of Neuroscience.

[21]  F. D. Silva,et al.  EEG and MEG: Relevance to Neuroscience , 2013, Neuron.

[22]  Gernot R. Müller-Putz,et al.  Control of an Electrical Prosthesis With an SSVEP-Based BCI , 2008, IEEE Transactions on Biomedical Engineering.

[23]  S. A. Hillyard,et al.  Sustained division of the attentional spotlight , 2003, Nature.

[24]  Carmen C. Y. Poon,et al.  Unobtrusive and Multimodal Wearable Sensing to Quantify Anxiety , 2016, IEEE Sensors Journal.

[25]  Douglas C. Montgomery,et al.  Introduction to Linear Regression Analysis, Solutions Manual (Wiley Series in Probability and Statistics) , 2007 .

[26]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[27]  Xingyu Wang,et al.  A comparison of three electrode channels selection methods applied to SSVEP BCI , 2011, 2011 4th International Conference on Biomedical Engineering and Informatics (BMEI).

[28]  J. Wolpaw,et al.  Towards an independent brain–computer interface using steady state visual evoked potentials , 2008, Clinical Neurophysiology.

[29]  Ali Hassan Sodhro,et al.  A Joint Transmission Power Control and Duty-Cycle Approach for Smart Healthcare System , 2019, IEEE Sensors Journal.

[30]  Usman Rashid,et al.  An EEG Experimental Study Evaluating the Performance of Texas Instruments ADS1299 , 2018, Sensors.

[31]  Yuan-Pin Lin,et al.  A mobile SSVEP-based brain-computer interface for freely moving humans: The robustness of canonical correlation analysis to motion artifacts , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[32]  D.J. McFarland,et al.  The wadsworth BCI research and development program: at home with BCI , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Meng Wang,et al.  A Wearable SSVEP-Based BCI System for Quadcopter Control Using Head-Mounted Device , 2018, IEEE Access.

[34]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[35]  E. Vogel,et al.  Visual working memory capacity: from psychophysics and neurobiology to individual differences , 2013, Trends in Cognitive Sciences.

[36]  Kiran George,et al.  Home automation system using brain computer interface paradigm based on auditory selection attention , 2018, 2018 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).

[37]  Dibyendu Roy,et al.  Readability Analysis Based on Cognitive Assessment Using Physiological Sensing , 2019, IEEE Sensors Journal.

[38]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[39]  Michael A. Casey,et al.  Assessing Feedback Response With a Wearable Electroencephalography System , 2019, Front. Hum. Neurosci..

[40]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[41]  D J McFarland,et al.  Brain-computer interface research at the Wadsworth Center. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[42]  Benjamin S. Mashford,et al.  A Robust Low-Cost EEG Motor Imagery-Based Brain-Computer Interface , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[43]  A. Wilkins,et al.  Photic‐ and Pattern‐induced Seizures: A Review for the Epilepsy Foundation of America Working Group , 2005, Epilepsia.

[44]  L. Cohen,et al.  Brain–computer interfaces: communication and restoration of movement in paralysis , 2007, The Journal of physiology.

[45]  Syed Muhammad Anwar,et al.  A Hybrid Scheme for Drowsiness Detection Using Wearable Sensors , 2019, IEEE Sensors Journal.

[46]  C. Braun,et al.  Hand Movement Direction Decoded from MEG and EEG , 2008, The Journal of Neuroscience.

[47]  Thomas C. Sprague,et al.  Functional MRI and EEG Index Complementary Attentional Modulations , 2019, The Journal of Neuroscience.

[48]  Amr Mohamed,et al.  Scalable real-time energy-efficient EEG compression scheme for wireless body area sensor network , 2015, Biomed. Signal Process. Control..

[49]  Bin He,et al.  Brain–Computer Interfaces Using Sensorimotor Rhythms: Current State and Future Perspectives , 2014, IEEE Transactions on Biomedical Engineering.

[50]  Ioannis Kompatsiaris,et al.  A Bayesian Multiple Kernel Learning Algorithm for SSVEP BCI Detection , 2019, IEEE Journal of Biomedical and Health Informatics.

[51]  Thomas C. Sprague,et al.  Changing the Spatial Scope of Attention Alters Patterns of Neural Gain in Human Cortex , 2014, The Journal of Neuroscience.

[52]  Brendan Z. Allison,et al.  Journal of Neuroscience Methods , 2022 .

[53]  Hsuan-Tien Lin,et al.  A note on Platt’s probabilistic outputs for support vector machines , 2007, Machine Learning.

[54]  Guanghua Xu,et al.  A Convolutional Neural Network for the Detection of Asynchronous Steady State Motion Visual Evoked Potential , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[55]  Xiaogang Chen,et al.  Filter bank canonical correlation analysis for implementing a high-speed SSVEP-based brain–computer interface , 2015, Journal of neural engineering.

[56]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[57]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[58]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.

[59]  Xiaogang Chen,et al.  A Benchmark Dataset for SSVEP-Based Brain–Computer Interfaces , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[60]  T. J. Sullivan,et al.  A user-friendly SSVEP-based brain–computer interface using a time-domain classifier , 2010, Journal of neural engineering.

[61]  W. Klimesch.  Alpha-band oscillations, attention, and controlled access to stored information , 2012, Trends in Cognitive Sciences.

[62]  Toby P. Breckon,et al.  On the Relative Contribution of Deep Convolutional Neural Networks for SSVEP-Based Bio-Signal Decoding in BCI Speller Applications , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[63]  Tzyy-Ping Jung,et al.  Measuring Steady-State Visual Evoked Potentials from non-hair-bearing areas , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[64]  Xin Liu,et al.  FPGA-based real-time compressed sensing of multichannel EEG signals for wireless body area networks , 2019, Biomed. Signal Process. Control..

[65]  Guanglin Li,et al.  Medical Information Security for Wearable Body Sensor Networks in Smart Healthcare , 2019, IEEE Consumer Electronics Magazine.

[66]  Yuan-Ting Zhang,et al.  Heartbeats Based Biometric Random Binary Sequences Generation to Secure Wireless Body Sensor Networks , 2018, IEEE Transactions on Biomedical Engineering.

[67]  Yijun Wang,et al.  Brain-Computer Interfaces Based on Visual Evoked Potentials , 2008, IEEE Engineering in Medicine and Biology Magazine.

[68]  Hubert Cecotti,et al.  A Self-Paced and Calibration-Less SSVEP-Based Brain–Computer Interface Speller , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.