A dual model approach to EOG-based human activity recognition

Abstract Ongoing eyeball activities can be recorded as Electrooculography (EOG) to discover the links between human activities and eye movements. In the present work, we propose a dual model to achieve human activity recognition (HAR) under a specific task background. Specifically, the “EOG Signals Recognition (ESR)” model is used to recognize basic eye movement unit signals collected under different activities; the “Activities Relationship (AR)” model is utilized to describe the contextual relationship among different activities. Furthermore, we introduce a confidence parameter to comprehensively analyze and judge outputs of the above two models. To evaluate the performance of the proposed algorithm, the experiments have been performed under an office scene over 8 subjects. The average recognition accuracy achieves 88.15% according to 3 types of activities (i.e., reading, writing, and resting). Experimental results reveal that the EOG-based dual model HAR algorithm presents an excellent classification performance.

[1]  Sudesh Pundir,et al.  ROC Curve and AUC for A Left-Truncated Sample from Rayleigh Distribution , 2015 .

[2]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[3]  Syed Abdul Rahman Al-Haddad,et al.  Multiclass Support Vector Machines for Classification of ECG Data with Missing Values , 2015, Appl. Artif. Intell..

[4]  Xu Sun,et al.  A Fast Algorithm for Unbiased Estimation of Variance of AUC Based on Dynamic Programming , 2016, IEEE Access.

[5]  K. Latha,et al.  Feature Selection in Classification of Eye Movements Using Electrooculography for Activity Recognition , 2014, Comput. Math. Methods Medicine.

[6]  Chang-Hwan Im,et al.  Real-Time “Eye-Writing” Recognition Using Electrooculogram , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  M. Miyashita,et al.  Mouse cursor control system using electrooculogram signals , 2010, 2010 World Automation Congress.

[8]  Marcello Federico,et al.  Bayesian estimation methods for n-gram language model adaptation , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[9]  Jelena Graovac A variant of n-gram based language- independent text categorization , 2014, Intell. Data Anal..

[10]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[11]  R. Schleicher,et al.  Blinks and saccades as indicators of fatigue in sleepiness warners: looking tired? , 2022 .

[12]  Juan E. Tapiador,et al.  A Survey of Wearable Biometric Recognition Systems , 2016, ACM Comput. Surv..

[13]  Yasuharu Koike,et al.  Online classification algorithm for eye-movement-based communication systems using two temporal EEG sensors , 2015, Biomed. Signal Process. Control..

[14]  Amit Konar,et al.  Eye movement sequence analysis using electrooculogram to assist autistic children , 2014, Biomed. Signal Process. Control..

[15]  E. Gordon,et al.  Defining the temporal threshold for ocular fixation in free-viewing visuocognitive tasks , 2003, Journal of Neuroscience Methods.

[16]  Tusar Kanti Mishra,et al.  Human recognition system for outdoor videos using Hidden Markov model , 2014 .

[17]  Mengmeng Zhang,et al.  Research on Activity Recognition Method based on Human Motion Trajectory Features , 2012 .

[18]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[19]  Xiaopei Wu,et al.  A novel saccade signals detection algorithm for EOG-based Human Activity Recognition , 2015 .

[20]  Gerhard Tröster,et al.  Eye Movement Analysis for Activity Recognition Using Electrooculography , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[22]  Davide Anguita,et al.  Transition-Aware Human Activity Recognition Using Smartphones , 2016, Neurocomputing.

[23]  Nurul Muthmainnah Mohd Noor,et al.  Study the different level of eye movement based on electrooculography (EOG) technique , 2016, 2016 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES).

[24]  Amit Konar,et al.  Electrooculogram based cognitive context recognition , 2014, International Conference on Electronics, Communication and Instrumentation (ICECI).

[25]  Lianwen Jin,et al.  Ensemble Manifold Rank Preserving for Acceleration-Based Human Activity Recognition , 2016, IEEE Transactions on Neural Networks and Learning Systems.