Design and implementation of an eye gesture perception system based on electrooculography

Abstract People with motor diseases have suffered from deprivation of both verbal and non-verbal communication abilities. Fortunately, some of them still retain coordination of brain and eye-motor. To establish a stable communication way for these disabled people, this paper presents an eye gesture perception system based on Electrooculography (EOG). In order to implement a high-accuracy of unit saccadic EOG signals recognition, we propose a new feature extraction algorithm based on Common Spatial Pattern (CSP). We first establish a CSP spatial filter bank corresponding to 8 saccadic tasks (i.e., up, down, left, right, right-up, left-up, right-down, and left-down), then use it to linearly project raw EOG signals and treat the outputs as feature parameters. Furthermore, eye gestures recognition has been carried out by identifying and merging unit saccadic segments in terms of pre-defined time sequences. Experiential results over 10 subjects show that the recognition precision of unit saccadic EOG and eye gesture are 96.8% and 95.0% respectively, which reveal the proposed system has a good performance of eye gestures perception.

[1]  Gerhard Tröster,et al.  Eye Movement Analysis for Activity Recognition Using Electrooculography , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Doru Talaba,et al.  EOG-based visual navigation interface development , 2012, Expert Syst. Appl..

[3]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[4]  M. Mazo,et al.  System for assisted mobility using eye movements based on electrooculography , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  N. Birbaumer Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. , 2006, Psychophysiology.

[6]  Antoine Souloumiac,et al.  Jacobi Angles for Simultaneous Diagonalization , 1996, SIAM J. Matrix Anal. Appl..

[7]  Thiago Santini,et al.  Bayesian identification of fixations, saccades, and smooth pursuits , 2015, ETRA.

[8]  Xiaorong Gao,et al.  One-Versus-the-Rest(OVR) Algorithm: An Extension of Common Spatial Patterns(CSP) Algorithm to Multi-class Case , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[9]  Wei Wu,et al.  Probabilistic Common Spatial Patterns for Multichannel EEG Analysis , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Päivi Majaranta,et al.  Eye Tracking and Eye-Based Human–Computer Interaction , 2014 .

[11]  Bangyan Zhou,et al.  [Channel Selection for Multi-class Motor Imagery Based on Common Spatial Pattern]. , 2015, Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi.

[12]  Wenhao Zhang,et al.  Eye center localization and gaze gesture recognition for human-computer interaction. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[13]  Laurent Bougrain,et al.  A comparison between different Multiclass Common Spatial Pattern approaches for identification of motor imagery tasks , 2014 .

[14]  Andreas Bulling,et al.  Eye gesture recognition on portable devices , 2012, UbiComp '12.

[15]  Lingling Chen,et al.  Statistical background model-based target detection , 2015, Pattern Analysis and Applications.

[16]  Hans-Werner Gellersen,et al.  EyeContext: recognition of high-level contextual cues from human visual behaviour , 2013, CHI.

[17]  Luciano Boquete,et al.  EOG-based eye movements codification for human computer interaction , 2012, Expert Syst. Appl..

[18]  Manuel Mazo,et al.  Wheelchair Guidance Strategies Using EOG , 2002, J. Intell. Robotic Syst..

[19]  Marcus Nyström,et al.  An adaptive algorithm for fixation, saccade, and glissade detection in eyetracking data , 2010, Behavior research methods.

[20]  Zhao Lv,et al.  A novel eye movement detection algorithm for EOG driven human computer interface , 2010, Pattern Recognit. Lett..

[21]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Wolfgang Rosenstiel,et al.  Driver-Activity Recognition in the Context of Conditionally Autonomous Driving , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[23]  Zhiwei Zhu,et al.  Combining Kalman filtering and mean shift for real time eye tracking under active IR illumination , 2002, Object recognition supported by user interaction for service robots.

[24]  Sima Soltani,et al.  Design of a novel wearable human computer interface based on electrooculograghy , 2013, 2013 21st Iranian Conference on Electrical Engineering (ICEE).

[25]  Wolfgang Rosenstiel,et al.  Bayesian online clustering of eye movement data , 2012, ETRA.

[26]  Keng Peng Tee,et al.  EEG-Based Classification of Fast and Slow Hand Movements Using Wavelet-CSP Algorithm , 2013, IEEE Transactions on Biomedical Engineering.

[27]  Andreas Bulling,et al.  Discovery of everyday human activities from long-term visual behaviour using topic models , 2015, UbiComp.

[28]  Oleg V. Komogortsev,et al.  Using machine learning to detect events in eye-tracking data , 2018, Behavior research methods.

[29]  Gaetano Zaccara,et al.  Eye movement abnormalities in anorexia nervosa , 1998, Psychiatry Research.

[30]  Mélodie Vidal,et al.  Analysing EOG signal features for the discrimination of eye movements with wearable devices , 2011, PETMEI '11.

[31]  M. Miyashita,et al.  Mouse cursor control system using electrooculogram signals , 2010, 2010 World Automation Congress.

[32]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[33]  Dongheng Li,et al.  Starburst: A robust algorithm for video-based eye tracking , 2005 .

[34]  Chun-Liang Hsu,et al.  EOG-based Human-Computer Interface system development , 2010, Expert Syst. Appl..

[35]  Pornchai Phukpattaranont,et al.  Robust Eye Movement Recognition Using EOG Signal for Human-Computer Interface , 2011, ICSECS.

[36]  R. A. Clement,et al.  Natural coordinates for specification of eye movements , 1991, Vision Research.

[37]  Thiago Santini,et al.  ElSe: ellipse selection for robust pupil detection in real-world environments , 2015, ETRA.

[38]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[39]  Serkan Gurkan,et al.  Design of a Novel Efficient Human–Computer Interface: An Electrooculagram Based Virtual Keyboard , 2010, IEEE Transactions on Instrumentation and Measurement.