Object Segmentation in Images using EEG Signals

This paper explores the potential of brain-computer interfaces in segmenting objects from images. Our approach is centered around designing an effective method for displaying the image parts to the users such that they generate measurable brain reactions. When an image region, specifically a block of pixels, is displayed we estimate the probability of the block containing the object of interest using a score based on EEG activity. After several such blocks are displayed, the resulting probability map is binarized and combined with the GrabCut algorithm to segment the image into object and background regions. This study shows that BCI and simple EEG analysis are useful in locating object boundaries in images.

[1]  Desney S. Tan,et al.  Combining brain computer interfaces with vision for object categorization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  R. Hebbalaguppe,et al.  How interaction methods affect image segmentation: User experience in the task , 2013, 2013 1st IEEE Workshop on User-Centered Computer Vision (UCCV).

[3]  Srivas Chennu,et al.  Bedside detection of awareness in the vegetative state: a cohort study , 2011, The Lancet.

[4]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[5]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[6]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[7]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[8]  Dèlia Fernández Cañellas.  Modeling temporal dependency of brain responses to rapidly presented stimuli in ERP based BCIs , 2013 .

[9]  Claus Bahlmann,et al.  In a Blink of an Eye and a Switch of a Transistor: Cortically Coupled Computer Vision , 2010, Proceedings of the IEEE.

[10]  Redwan Alqasemi,et al.  A vision based P300 Brain Computer Interface for grasping using a wheelchair-mounted robotic arm , 2013, 2013 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[11]  Noel E. O'Connor,et al.  A comparative evaluation of interactive segmentation algorithms , 2010, Pattern Recognit..

[12]  Touradj Ebrahimi,et al.  Implicit retrieval of salient images using Brain Computer Interface , 2010, 2010 IEEE International Conference on Image Processing.

[13]  Misha Pavel,et al.  A framework for rapid visual image search using single-trial brain evoked responses , 2011, Neurocomputing.

[14]  F. Gerstenbrand,et al.  Varieties of the locked-in syndrome , 1979, Journal of Neurology.

[15]  David D. Cox,et al.  Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures , 2013, ICML.

[16]  Rajesh P. N. Rao,et al.  Control of a humanoid robot by a noninvasive brain–computer interface in humans , 2008, Journal of neural engineering.

[17]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[18]  N. Bigdely-Shamlo,et al.  Brain Activity-Based Image Classification From Rapid Serial Visual Presentation , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Robert Spence,et al.  Rapid, Serial and Visual: A Presentation Technique with Potential , 2002, Inf. Vis..

[20]  Brian Roark,et al.  Offline analysis of context contribution to ERP-based typing BCI performance. , 2013, Journal of neural engineering.

[21]  Marina Schmid,et al.  An Introduction To The Event Related Potential Technique , 2016 .

[22]  Xian-Sheng Hua,et al.  Bridging the Semantic Gap via Functional Brain Imaging , 2012, IEEE Transactions on Multimedia.

[23]  Shih-Fu Chang,et al.  Brain state decoding for rapid image retrieval , 2009, ACM Multimedia.

[24]  Alan F. Smeaton,et al.  Optimising the number of channels in EEG-augmented image search , 2011, BCS HCI.

[25]  Ning Zhong,et al.  EEG/ERP Meets ACT-R: A Case Study for Investigating Human Computation Mechanism , 2009, Brain Informatics.