Human Implicit Intent Discrimination Using EEG and Eye Movement

In this paper, we propose a new human implicit intent understanding model based on multi-modal information, which is a combination of eye movement data and brain wave signal obtained from eye-tracker and Electroencephalography (EEG) sensors respectively. From the eye movement data, we extract human implicit intention related to features such as fixation count and fixation duration corresponding to the areas of interest (AOI). Also, we analyze the EEG signals based on phase synchrony method. Combining the eye movement and EEG information, we train several classifiers such as support vector machine classifier, Gaussian Mixture Model and Naive Bayesian, which can successfully identify the human’s implicit intention into two defined categories, i.e. navigational and informational intentions. Experimental results show that the human implicit intention can be better understood using multimodal information.

[1]  Farrah Wong,et al.  Intention reading towards engineering applications for the elderly and people with disabilities , 2006 .

[2]  F. Varela,et al.  Measuring phase synchrony in brain signals , 1999, Human brain mapping.

[3]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[4]  H Suzuki,et al.  Phase relationships of alpha rhythm in man. , 1974, The Japanese journal of physiology.

[5]  Minho Lee,et al.  Phase Synchrony for Human Implicit Intent Differentiation , 2013, ICONIP.

[6]  Shanbao Tong,et al.  Phase Synchronization Analysis of EEG Signals: An Evaluation Based on Surrogate Tests , 2012, IEEE Transactions on Biomedical Engineering.

[7]  Li Sun,et al.  ECG Analysis Using Multiple Instance Learning for Myocardial Infarction Detection , 2012, IEEE Transactions on Biomedical Engineering.

[8]  Nicu Sebe,et al.  Multimodal Human Computer Interaction: A Survey , 2005, ICCV-HCI.

[9]  Cynthia Breazeal,et al.  Social interactions in HRI: the robot view , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Ricardo Carelli,et al.  Human-machine interfaces based on EMG and EEG applied to robotic systems , 2008, Journal of NeuroEngineering and Rehabilitation.

[11]  Y. Wang,et al.  Phase synchrony in subject-specific reactive band of EEG for classification of motor imagery tasks , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[12]  Minho Lee,et al.  Human intention recognition based on eyeball movement pattern and pupil size variation , 2014, Neurocomputing.

[13]  Amanda Spink,et al.  Determining the informational, navigational, and transactional intent of Web queries , 2008, Inf. Process. Manag..