New computer interface combining gaze tracking and brainwave measurements

We present a new computer interface that combines gaze tracking with brainwave measurements in an integrated head-mounted device. This interface is novel in the following four ways compared to previous works. First, because the system is designed as a single head-mounted device, both the brainwave data and eye images for gaze tracking can be acquired by wearing only one device that includes a sensing node and an eye image-capturing camera. Second, the noise in the brainwave data caused by blinking is removed by a blink detection system in the eye camera. Third, the sensitivity of a gaze-based navigation speed is appropriately controlled on the basis of the level of attention estimated by analyzing the brainwave. Fourth, performance and usability of the interface are validated by objective evaluating and subjective surveys. From experimental results, we confirmed that the proposed system shows promising performance and usability as a new computer interface1.

[1]  Kang Ryoung Park,et al.  A realistic game system using multi-modal user interfaces , 2010, IEEE Transactions on Consumer Electronics.

[2]  Hafiz Adnan Habib,et al.  Infotainment devices control by eye gaze and gesture recognition fusion , 2008, IEEE Transactions on Consumer Electronics.

[3]  Youngmo Han.  A low-cost visual motion data glove as an input device to interpret human hand gestures , 2010, IEEE Transactions on Consumer Electronics.

[4]  Kang Ryoung Park,et al.  Robust gaze-tracking method by using frontal-viewing and eye-tracking cameras , 2009 .

[5]  Du-Sik Park,et al.  3D user interface combining gaze and hand gestures for large-scale display , 2010, CHI EA '10.

[6]  Kang Ryoung Park,et al.  Noise Reduction of EEG Signal Based on Head Movement Estimation by Using Frontal Viewing Camera , 2012 .

[7]  Kang Ryoung Park,et al.  Gaze tracking system at a distance for controlling IPTV , 2010, IEEE Transactions on Consumer Electronics.

[8]  Kang Ryoung Park,et al.  Experimental investigations of pupil accommodation factors. , 2011, Investigative ophthalmology & visual science.

[9]  Refet Firat Yazicioglu,et al.  A low-power, wireless, 8-channel EEG monitoring headset , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[10]  Kang Ryoung Park,et al.  A robust gaze detection method by compensating for facial movements based on corneal specularities , 2008, Pattern Recognit. Lett..

[11]  Saul Greenberg,et al.  Multimodal multiplayer tabletop gaming , 2007, CIE.

[12]  Fulvio Corno,et al.  Multimodal Gaze Interaction in 3D Virtual Environments , 2008 .

[13]  Tieniu Tan,et al.  Key Techniques and Methods for Imaging Iris in Focus , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[14]  Fulvio Corno,et al.  Integrated speech and gaze control for realistic desktop environments , 2008, ETRA '08.

[15]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Jeong-Hoon Shin,et al.  Analysis of EEG Characteristics during Acupuncture Stimulations Using Spectrogram Analysis and Correlation Coefficient , 2009, 2009 International Conference on New Trends in Information and Service Science.

[17]  Chong Jin Ong,et al.  Automatic EEG Artifact Removal: A Weighted Support Vector Machine Approach With Error Correction , 2009, IEEE Transactions on Biomedical Engineering.

[18]  Mincheol Whang,et al.  A brain–computer interface method combined with eye tracking for 3D interaction , 2010, Journal of Neuroscience Methods.

[19]  Jianjun Wang,et al.  A review of the commercial brain-computer interface technology from perspective of industrial robotics , 2010, 2010 IEEE International Conference on Automation and Logistics.