Cortically coupled computer vision with Emotiv headset using distractor variables

Visual search tasks can take long amounts of time and the more complicated the image is the longer it takes to find a target. Therefore, it is of interest to come up with a system that can augment a searcher's vision, in relation to speed, enabling the searcher to find the target faster than through normal means. Audition and vision are important for both communicative and informational purposes and therefore neurological signatures related to such abilities can greater increase cognitive infocommunicative devices. The P300 neurological response is a well known event-related potential that identifies the recognition of a target in such a search task. Clinical electroencephalogram (EEG) technology has previously been used to detect the P300 signature in response to target recognition during a Rapid Serial Visual Presentation (RSVP). Following the oddball paradigm, this study uses the 14-electrode Emotiv EPOC to detect the P300 in eight subjects performing a novel Where's Waldo target recognition task with the success criterion to optimize their completion time. In this paradigm, the number of targets and distractors are varied following a geometric distribution in order to have the participants engage in the task throughout the session. Although the Emotiv EPOC is crude in comparison to other EEG systems such as those with 256 electrodes, our results show better search times compared to baseline, and thus proves the feasibility of augmented vision even with such a limited system.

[1]  Eric Leuthardt,et al.  An EEG-based brain computer interface for rehabilitation and restoration of hand control following stroke using ipsilateral cortical physiology , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  N. Bigdely-Shamlo,et al.  Brain Activity-Based Image Classification From Rapid Serial Visual Presentation , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  P. Baranyi,et al.  Definition and synergies of cognitive infocommunications , 2012 .

[4]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[5]  Shaohan Hu,et al.  NeuroPhone: brain-mobile phone interface using a wireless EEG headset , 2010, MobiHeld '10.

[6]  Vicente Alarcon-Aquino,et al.  P-300 Rhythm Detection Using ANFIS Algorithm and Wavelet Feature Extraction in EEG Signals , 2010 .

[7]  L. Parra,et al.  Ieee Signal Processing Magazine, Accepted for Publication, August 2007 Spatio-temporal Linear Decoding of Brain State: Application to Performance Augmentation in High-throughput Tasks , 2022 .

[8]  Shih-Fu Chang,et al.  Brain state decoding for rapid image retrieval , 2009, ACM Multimedia.

[9]  Misha Pavel,et al.  Rapid image analysis using neural signals , 2008, CHI Extended Abstracts.

[10]  Claus Bahlmann,et al.  In a Blink of an Eye and a Switch of a Transistor: Cortically Coupled Computer Vision , 2010, Proceedings of the IEEE.

[11]  P. Sajda,et al.  Cortically coupled computer vision for rapid image search , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Lucas C. Parra,et al.  Bilinear Discriminant Component Analysis , 2007, J. Mach. Learn. Res..

[13]  P. Sajda,et al.  Spatiotemporal Linear Decoding of Brain State , 2008, IEEE Signal Processing Magazine.