Spatio-Temporal Dynamics of Visual Imagery for Intuitive Brain-Computer Interface

Visual imagery is an intuitive brain-computer interface paradigm, referring to the emergence of the visual scene. Despite its convenience, analysis of its intrinsic characteristics is limited. In this study, we demonstrate the effect of time interval and channel selection that affects the decoding performance of the multi-class visual imagery. We divided the epoch into time intervals of 0–1 s and 1–2 s and performed six-class classification in three different brain regions: whole brain, visual cortex, and prefrontal cortex. In the time interval, 0–1 s group showed 24.2 % of average classification accuracy, which was significantly higher than the 1–2 s group in the prefrontal cortex. In the three different regions, the classification accuracy of the prefrontal cortex showed significantly higher performance than the visual cortex in 0–1 s interval group, implying the cognitive arousal during the visual imagery. This finding would provide crucial information in improving the decoding performance.

[1]  Klaus-Robert Müller,et al.  A convolutional neural network for steady state visual evoked potential classification under ambulatory environment , 2017, PloS one.

[2]  Dinggang Shen,et al.  Extraction of dynamic functional connectivity from brain grey matter and white matter for MCI classification , 2017, Human brain mapping.

[3]  Siamac Fazli,et al.  Subject-dependent classification for robust idle state detection using multi-modal neuroimaging and data-fusion techniques in BCI , 2015, Pattern Recognit..

[4]  A. Norcia,et al.  A Representational Similarity Analysis of the Dynamics of Object Processing Using Single-Trial EEG Classification , 2015, PloS one.

[5]  Jussi T. Lindgren,et al.  Attending to Visual Stimuli versus Performing Visual Imagery as a Control Strategy for EEG-based Brain-Computer Interfaces , 2018, Scientific Reports.

[6]  Hyoung Joong Kim,et al.  A High-Security EEG-Based Login System with RSVP Stimuli and Dry Electrodes , 2016, IEEE Transactions on Information Forensics and Security.

[7]  Heung-Il Suk,et al.  Subject and class specific frequency bands selection for multiclass motor imagery classification , 2011, Int. J. Imaging Syst. Technol..

[8]  Seong-Whan Lee,et al.  Decoding Three-Dimensional Trajectory of Executed and Imagined Arm Movements From Electroencephalogram Signals , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  Seong-Whan Lee,et al.  Changes of Functional and Effective Connectivity in Smoking Replenishment on Deprived Heavy Smokers: A Resting-State fMRI Study , 2013, PloS one.

[10]  Dinggang Shen,et al.  Canonical feature selection for joint regression and multi-class identification in Alzheimer’s disease diagnosis , 2015, Brain Imaging and Behavior.

[11]  Chang-Hyun Park,et al.  Motor imagery learning across a sequence of trials in stroke patients. , 2015, Restorative neurology and neuroscience.

[12]  Dinggang Shen,et al.  Improved image registration by sparse patch-based deformation estimation , 2015, NeuroImage.

[13]  John Williamson,et al.  A High Performance Spelling System based on EEG-EOG Signals With Visual Feedback , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  Necmettin Firat Ozkan,et al.  Classification of BCI Users Based on Cognition , 2018, Comput. Intell. Neurosci..

[15]  B. Gulyás,et al.  Visual imagery and visual representation , 1994, Trends in Neurosciences.

[16]  João Andrade,et al.  Pure visual imagery as a potential approach to achieve three classes of control for implementation of BCI in non-motor disorders , 2017, Journal of neural engineering.

[17]  Aimin Wang,et al.  Index finger motor imagery EEG pattern recognition in BCI applications using dictionary cleaned sparse representation-based classification for healthy people. , 2017, The Review of scientific instruments.

[18]  Klaus-Robert Müller,et al.  Motion-Based Rapid Serial Visual Presentation for Gaze-Independent Brain-Computer Interfaces , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Richard A. Andersen,et al.  Toward More Versatile and Intuitive Cortical Brain–Machine Interfaces , 2014, Current Biology.

[20]  Anna Gawlinski,et al.  Communication boards in critical care: patients' views. , 2006, Applied nursing research : ANR.

[21]  K. Müller,et al.  Effect of higher frequency on the classification of steady-state visual evoked potentials , 2016, Journal of neural engineering.

[22]  Xiaorong Gao,et al.  One-Versus-the-Rest(OVR) Algorithm: An Extension of Common Spatial Patterns(CSP) Algorithm to Multi-class Case , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[23]  Seong-Whan Lee,et al.  EEG Representations of Spatial and Temporal Features in Imagined Speech and Overt Speech , 2019, ACPR.

[24]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[25]  Ji-Hoon Jeong,et al.  Towards an EEG-based Intuitive BCI Communication System Using Imagined Speech and Visual Imagery , 2019, 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC).

[26]  A. Ishai,et al.  Introduction Short-and Long-term Memory , 2022 .

[27]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[28]  Floris P. de Lange,et al.  Differential temporal dynamics during visual imagery and perception , 2017, bioRxiv.

[29]  Giulio Tononi,et al.  Reversal of cortical information flow during visual imagery as compared to visual perception , 2014, NeuroImage.

[30]  Heung-Il Suk,et al.  Non-homogeneous spatial filter optimization for ElectroEncephaloGram (EEG)-based motor imagery classification , 2013, Neurocomputing.

[31]  Seong-Whan Lee,et al.  Network Properties in Transitions of Consciousness during Propofol-induced Sedation , 2017, Scientific Reports.

[32]  Stefan Haufe,et al.  Detection of braking intention in diverse situations during simulated driving based on EEG feature combination , 2015, Journal of neural engineering.

[33]  Klaus-Robert Müller,et al.  An Efficient ERP-Based Brain-Computer Interface Using Random Set Presentation and Face Familiarity , 2014, PloS one.