Pure visual imagery as a potential approach to achieve three classes of control for implementation of BCI in non-motor disorders

OBJECTIVE The achievement of multiple instances of control with the same type of mental strategy represents a way to improve flexibility of brain-computer interface (BCI) systems. Here we test the hypothesis that pure visual motion imagery of an external actuator can be used as a tool to achieve three classes of electroencephalographic (EEG) based control, which might be useful in attention disorders. APPROACH We hypothesize that different numbers of imagined motion alternations lead to distinctive signals, as predicted by distinct motion patterns. Accordingly, a distinct number of alternating sensory/perceptual signals would lead to distinct neural responses as previously demonstrated using functional magnetic resonance imaging (fMRI). We anticipate that differential modulations should also be observed in the EEG domain. EEG recordings were obtained from twelve participants using three imagery tasks: imagery of a static dot, imagery of a dot with two opposing motions in the vertical axis (two motion directions) and imagery of a dot with four opposing motions in vertical or horizontal axes (four directions). The data were analysed offline. MAIN RESULTS An increase of alpha-band power was found in frontal and central channels as a result of visual motion imagery tasks when compared with static dot imagery, in contrast with the expected posterior alpha decreases found during simple visual stimulation. The successful classification and discrimination between the three imagery tasks confirmed that three different classes of control based on visual motion imagery can be achieved. The classification approach was based on a support vector machine (SVM) and on the alpha-band relative spectral power of a small group of six frontal and central channels. Patterns of alpha activity, as captured by single-trial SVM closely reflected imagery properties, in particular the number of imagined motion alternations. SIGNIFICANCE We found a new mental task based on visual motion imagery with potential for the implementation of multiclass (3) BCIs. Our results are consistent with the notion that frontal alpha synchronization is related with high internal processing demands, changing with the number of alternation levels during imagery. Together, these findings suggest the feasibility of pure visual motion imagery tasks as a strategy to achieve multiclass control systems with potential for BCI and in particular, neurofeedback applications in non-motor (attentional) disorders.

[1]  Neil Burgess,et al.  Intrusive Images in Psychological Disorders , 2010, Psychological review.

[2]  Saskia Haegens,et al.  Inter- and intra-individual variability in alpha peak frequency , 2014, NeuroImage.

[3]  E. Holmes,et al.  Imagery rescripting in cognitive behaviour therapy: images, treatment techniques and outcomes. , 2007, Journal of behavior therapy and experimental psychiatry.

[4]  Hyunjoong Kim,et al.  Functional Analysis I , 2017 .

[5]  Andrew Mathews,et al.  Mental imagery in emotion and emotional disorders. , 2010, Clinical psychology review.

[6]  Klaus-Robert Müller,et al.  Introduction to machine learning for brain imaging , 2011, NeuroImage.

[7]  Dean J Krusienski,et al.  Brain-computer interfaces in medicine. , 2012, Mayo Clinic proceedings.

[8]  David Melcher,et al.  Brain networks for visual creativity: a functional connectivity study of planning a visual artwork , 2016, Scientific Reports.

[9]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[10]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[11]  M. Castelo‐Branco,et al.  Comparison of a row-column speller vs. a novel lateral single-character speller: Assessment of BCI for severe motor disabled patients , 2012, Clinical Neurophysiology.

[12]  Niels Birbaumer,et al.  Brain oscillatory signatures of motor tasks. , 2015, Journal of neurophysiology.

[13]  M. Landy,et al.  Orientation-selective adaptation to first- and second-order patterns in human visual cortex. , 2006, Journal of neurophysiology.

[14]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[15]  Michitaka Hirose,et al.  Brain-Computer Interfaces, Virtual Reality, and Videogames , 2008, Computer.

[16]  Ali Bahramisharif,et al.  Brain-computer interfacing using modulations of alpha activity induced by covert shifts of attention , 2011, Journal of NeuroEngineering and Rehabilitation.

[17]  Jonathan D. Cohen,et al.  Closed-loop training of attention with real-time brain imaging , 2015, Nature Neuroscience.

[18]  F. Mormann,et al.  Seizure prediction: the long and winding road. , 2007, Brain : a journal of neurology.

[19]  S. Makeig.  Auditory event-related dynamics of the EEG spectrum and effects of exposure to tones. , 1993, Electroencephalography and clinical neurophysiology.

[20]  Michael Rose,et al.  A Brain-Computer-Interface for the Detection and Modulation of Gamma Band Activity , 2013, Brain sciences.

[21]  Urbano Nunes,et al.  A two-step automatic sleep stage classification method with dubious range detection , 2015, Comput. Biol. Medicine.

[22]  A. Dale,et al.  Functional analysis of primary visual cortex (V1) in humans. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[23]  K. Rottner,et al.  How distinct Arp2/3 complex variants regulate actin filament assembly , 2015, Nature Cell Biology.

[24]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[25]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[26]  Ruimin Wang,et al.  Classification of Four-Class Motor Imagery Employing Single-Channel Electroencephalography , 2014, PloS one.

[27]  Urbano Nunes,et al.  Automatic sleep staging: A computer assisted approach for optimal combination of features and polysomnographic channels , 2013, Expert Syst. Appl..

[28]  Ann Hackmann,et al.  Reflecting on imagery: A clinical perspective and overview of the special issue of Memory on mental imagery and memory in psychopathology , 2004, Memory.

[29]  Teresa Sousa,et al.  Control of Brain Activity in hMT+/V5 at Three Response Levels Using fMRI-Based Neurofeedback/BCI , 2016, PloS one.

[30]  D. L. Schomer,et al.  Niedermeyer's Electroencephalography: Basic Principles, Clinical Applications, and Related Fields , 2012 .

[31]  W. Klimesch,et al.  EEG alpha synchronization and functional coupling during top‐down processing in a working memory task , 2005, Human brain mapping.

[32]  Yong Gyu Lim,et al.  Brain–computer interfaces using capacitive measurement of visual or auditory steady-state responses , 2013, Journal of neural engineering.

[33]  N. Birbaumer,et al.  Brain-computer communication: self-regulation of slow cortical potentials for verbal communication. , 2001, Archives of physical medicine and rehabilitation.

[34]  Gert Pfurtscheller,et al.  Characterization of four-class motor imagery EEG data for the BCI-competition 2005 , 2005, Journal of neural engineering.

[35]  S. Kosslyn,et al.  Mental Imagery: Functional Mechanisms and Clinical Applications , 2015, Trends in Cognitive Sciences.

[36]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[37]  A. Karim,et al.  Neural Internet: Web Surfing with Brain Potentials for the Completely Paralyzed , 2006, Neurorehabilitation and neural repair.

[38]  Mikhail A. Lebedev,et al.  Neurofeedback Therapy for Enhancing Visual Attention: State-of-the-Art and Challenges , 2016, Front. Neurosci..

[39]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[40]  P. Welch.  The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[41]  D. Liberati,et al.  Brain Computer Interfacing , 2007 .

[42]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[43]  G. Pfurtscheller,et al.  EEG-based discrimination between imagination of right and left hand movement. , 1997, Electroencephalography and clinical neurophysiology.

[44]  Robert T. Thibault,et al.  The self-regulating brain and neurofeedback: Experimental science and clinical promise , 2016, Cortex.

[45]  Marc M. Van Hulle,et al.  Simultaneous Detection of P300 and Steady-State Visually Evoked Potentials for Hybrid Brain-Computer Interface , 2015, PloS one.

[46]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[47]  G. Pfurtscheller,et al.  Imagery of motor actions: differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG. , 2005, Brain research. Cognitive brain research.

[48]  R D Pascual-Marqui,et al.  Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. , 2002, Methods and findings in experimental and clinical pharmacology.

[49]  David Gaffan,et al.  Medial temporal and prefrontal function: Recent behavioural disconnection studies in the macaque monkey , 2008, Cortex.

[50]  M. Benedek,et al.  EEG alpha synchronization is related to top-down processing in convergent and divergent thinking , 2011, Neuropsychologia.

[51]  A. Burgess,et al.  Paradox lost? Exploring the role of alpha oscillations during externally vs. internally directed attention and the implications for idling and inhibition hypotheses. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[52]  Sabine Windmann,et al.  Creative Thinking in Adolescents with Attention Deficit Hyperactivity Disorder (ADHD) , 2006, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[53]  Teresa Sousa,et al.  Visual motion imagery neurofeedback based on the hMT+/V5 complex: evidence for a feedback-specific neural circuit involving neocortical and cerebellar regions , 2015, Journal of neural engineering.

[54]  Wolfgang Klimesch,et al.  Alpha Oscillations and Early Stages of Visual Encoding , 2011, Front. Psychology.

[55]  Akio Kimura,et al.  Brain-computer interface with somatosensory feedback improves functional recovery from severe hemiplegia due to chronic stroke , 2014, Front. Neuroeng..

[56]  M. Castelo‐Branco,et al.  Neural Signals Evoked by Stimuli of Increasing Social Scene Complexity Are Detectable at the Single-Trial Level and Right Lateralized , 2015, PloS one.

[57]  W. A. Sarnacki,et al.  Electroencephalographic (EEG) control of three-dimensional movement , 2010, Journal of neural engineering.

[58]  W. Klimesch.  Alpha-band oscillations, attention, and controlled access to stored information , 2012, Trends in Cognitive Sciences.

[59]  Urbano Nunes,et al.  A New Hybrid Motion Planner: Applied in a Brain-Actuated Robotic Wheelchair , 2016, IEEE Robotics & Automation Magazine.

[60]  Anthony Randal McIntosh,et al.  The Role of Anterior Cingulate Cortex in Working Memory is Shaped by Functional Connectivity , 2005, Journal of Cognitive Neuroscience.

[61]  John J. Foxe,et al.  The Role of Alpha-Band Brain Oscillations as a Sensory Suppression Mechanism during Selective Attention , 2011, Front. Psychology.

[62]  W. Klimesch,et al.  EEG alpha oscillations: The inhibition–timing hypothesis , 2007, Brain Research Reviews.

[63]  Shlomit Yuval-Greenberg,et al.  Saccadic spike potentials in gamma-band EEG: Characterization, detection and suppression , 2010, NeuroImage.

[64]  W. Klimesch.  EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[65]  José del R. Millán,et al.  Transferring brain-computer interfaces beyond the laboratory: Successful application control for motor-disabled users , 2013, Artif. Intell. Medicine.

[66]  N. Birbaumer,et al.  Brain–computer interfaces for communication and rehabilitation , 2016, Nature Reviews Neurology.

[67]  Jonathan R Wolpaw,et al.  Effects of training pre-movement sensorimotor rhythms on behavioral performance , 2015, Journal of neural engineering.

[68]  R. Ramírez-Mendoza,et al.  Motor imagery based brain–computer interfaces: An emerging technology to rehabilitate motor deficits , 2015, Neuropsychologia.

[69]  S. Swinnen,et al.  The role of anterior cingulate cortex and precuneus in the coordination of motor behaviour , 2005, The European journal of neuroscience.

[70]  David J. Heeger,et al.  Pattern-motion responses in human visual cortex , 2002, Nature Neuroscience.

[71]  D. Lehmann,et al.  Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain. , 1994, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.