Self-induced emotions as alternative paradigm for driving brain–computer interfaces

Abstract A Brain–Computer Interface (BCI) uses measurements of the voluntary brain activity for driving a communication system; it requires the activation of mental tasks. In the last few years, a new paradigm of activation has been used, consisting in the autonomous brain activation through self-induced emotions, remembered on autobiographical basis. In the present paper, such paradigm is implemented and the resulting BCI system is described, from the classification strategy to the graphic user interface necessary for synchronising mental tasks and collecting EEG signals derived by emotions. Moreover, the proposed BCI is used for collecting and classifying signals, from 10 healthy subjects, of two different emotional states: the disgust produced by remembering a bad odour and the good sensation produced by remembering the odour of a good fragrance, with respect to relax. The classifications are performed in a binary mode, by recognising disgust from relax and good sensation from relax, yielding an accuracy greater than 85%.

[1]  R. Henkin,et al.  Lateralization of Brain Activation to Imagination and Smell of Odors Using Functional Magnetic Resonance Imaging (fMRI): Left Hemispheric Localization of Pleasant and Right Hemispheric Localization of Unpleasant Odors , 2001, Journal of computer assisted tomography.

[2]  Wolfgang Rosenstiel,et al.  An MEG-based brain–computer interface (BCI) , 2007, NeuroImage.

[3]  Xingyu Wang,et al.  A P300 Brain-Computer Interface Based on a Modification of the Mismatch Negativity Paradigm , 2015, Int. J. Neural Syst..

[4]  Sara Basso Moro,et al.  A novel semi-immersive virtual reality visuo-motor task activates ventrolateral prefrontal cortex: a functional near-infrared spectroscopy study , 2016, Journal of neural engineering.

[5]  Daniela Iacoviello,et al.  Parametric characterization of the form of the human pupil from blurred noisy images , 2005, Comput. Methods Programs Biomed..

[6]  Wolfgang Grodd,et al.  Principles of a brain-computer interface (BCI) based on real-time functional magnetic resonance imaging (fMRI) , 2004, IEEE Transactions on Biomedical Engineering.

[7]  B. Blankertz,et al.  A New Auditory Multi-Class Brain-Computer Interface Paradigm: Spatial Hearing as an Informative Cue , 2010, PloS one.

[8]  J. Mourino,et al.  Asynchronous BCI and local neural classifiers: an overview of the adaptive brain interface project , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  Brendan Z. Allison,et al.  Noninvasive Brain-Computer Interfaces , 2014, Encyclopedia of Computational Neuroscience.

[10]  Andrea Petracca,et al.  A real-time classification algorithm for EEG-based BCI driven by self-induced emotions , 2015, Comput. Methods Programs Biomed..

[11]  Michael D. Robinson,et al.  Measures of emotion: A review , 2009, Cognition & emotion.

[12]  Benjamin Blankertz,et al.  Towards a Cure for BCI Illiteracy , 2009, Brain Topography.

[13]  Danilo Avola,et al.  Design of an efficient framework for fast prototyping of customized human-computer interfaces and virtual environments for rehabilitation , 2013, Comput. Methods Programs Biomed..

[14]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[15]  Marco Ferrari,et al.  Prefrontal Cortex Activated Bilaterally by a Tilt Board Balance Task: A Functional Near-Infrared Spectroscopy Study in a Semi-Immersive Virtual Reality Environment , 2013, Brain Topography.

[16]  Gernot R. Müller-Putz,et al.  The auditory p300-based SSBCI: A door to minimally conscious patients? , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Andrea Petracca,et al.  A Modular Framework for EEG Web Based Binary Brain Computer Interfaces to Recover Communication Abilities in Impaired People , 2015, Journal of Medical Systems.

[18]  Lizette Heine,et al.  Exploration of Functional Connectivity During Preferred Music Stimulation in Patients with Disorders of Consciousness , 2015, Front. Psychol..

[19]  Andrea Petracca,et al.  EEG-detected olfactory imagery to reveal covert consciousness in minimally conscious state , 2015, Brain injury.

[20]  Andrea Petracca,et al.  Classification strategies for a single-trial binary Brain Computer Interface based on remembering unpleasant odors , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[21]  Valentina Quaresima,et al.  A low-cost real time virtual system for postural stability assessment at home , 2014, Comput. Methods Programs Biomed..

[22]  M. Boly,et al.  Cerebral processing in the minimally conscious state , 2004, Neurology.

[23]  Wei Wang,et al.  rtMEG: A Real-Time Software Interface for Magnetoencephalography , 2011, Comput. Intell. Neurosci..

[24]  Andrea Petracca,et al.  A Classification Algorithm for Electroencephalography Signals by Self-Induced Emotional Stimuli , 2016, IEEE Transactions on Cybernetics.

[25]  Daniela Iacoviello,et al.  Robust real time eye tracking for computer interface for disabled people , 2009, Comput. Methods Programs Biomed..

[26]  Niels Birbaumer,et al.  fMRI Brain-Computer Interface: A Tool for Neuroscientific Research and Treatment , 2007, Comput. Intell. Neurosci..

[27]  Ronald M. Aarts,et al.  A Survey of Stimulation Methods Used in SSVEP-Based BCIs , 2010, Comput. Intell. Neurosci..

[28]  T. Chau,et al.  A Review of EEG-Based Brain-Computer Interfaces as Access Pathways for Individuals with Severe Disabilities , 2013, Assistive technology : the official journal of RESNA.

[29]  Daniela Iacoviello,et al.  Optimal segmentation of pupillometric images for estimating pupil shape parameters , 2006, Comput. Methods Programs Biomed..

[30]  Marco Ferrari,et al.  Prefrontal Cortex Activation Upon a Demanding Virtual Hand-Controlled Task: A New Frontier for Neuroergonomics , 2016, Front. Hum. Neurosci..

[31]  Richard F. Gunst,et al.  Applied Regression Analysis , 1999, Technometrics.

[32]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[33]  G. Schalk,et al.  Brain-Computer Interfaces Using Electrocorticographic Signals , 2011, IEEE Reviews in Biomedical Engineering.

[34]  Tiago H. Falk,et al.  Mental Task Evaluation for Hybrid NIRS-EEG Brain-Computer Interfaces , 2017, Comput. Intell. Neurosci..

[35]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.

[36]  Andrea Petracca,et al.  A Poll Oriented Classifier for Affective Brain Computer Interfaces , 2015, NEUROTECHNIX.

[37]  Marco Ferrari,et al.  A semi-immersive virtual reality incremental swing balance task activates prefrontal cortex: A functional near-infrared spectroscopy study , 2014, NeuroImage.

[38]  J. Russell A circumplex model of affect. , 1980 .

[39]  Giuseppe Placidi,et al.  A Brain Computer Interface by EEG Signals from Self-induced Emotions , 2017 .

[40]  N. Draper,et al.  Applied Regression Analysis: Draper/Applied Regression Analysis , 1998 .

[41]  Danilo Avola,et al.  Basis for the implementation of an EEG-based single-trial binary brain computer interface through the disgust produced by remembering unpleasant odors , 2015, Neurocomputing.

[42]  Andrea Petracca,et al.  Classification of Emotional Signals from the DEAP dataset , 2016, NEUROTECHNIX.

[43]  John J. B. Allen,et al.  Frontal EEG asymmetry as a moderator and mediator of emotion , 2004, Biological Psychology.

[44]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[45]  S. Gielen,et al.  The brain–computer interface cycle , 2009, Journal of neural engineering.

[46]  Andrzej Cichocki,et al.  An improved P300 pattern in BCI to catch user’s attention , 2017, Journal of neural engineering.

[47]  Keum-Shik Hong,et al.  fNIRS-based brain-computer interfaces: a review , 2015, Front. Hum. Neurosci..