A Novel Gaze Tracking Method Based on the Generation of Virtual Calibration Points

Most conventional gaze-tracking systems require that users look at many points during the initial calibration stage, which is inconvenient for them. To avoid this requirement, we propose a new gaze-tracking method with four important characteristics. First, our gaze-tracking system uses a large screen located at a distance from the user, who wears a lightweight device. Second, our system requires that users look at only four calibration points during the initial calibration stage, during which four pupil centers are noted. Third, five additional points (virtual pupil centers) are generated with a multilayer perceptron using the four actual points (detected pupil centers) as inputs. Fourth, when a user gazes at a large screen, the shape defined by the positions of the four pupil centers is a distorted quadrangle because of the nonlinear movement of the human eyeball. The gaze-detection accuracy is reduced if we map the pupil movement area onto the screen area using a single transform function. We overcame this problem by calculating the gaze position based on multi-geometric transforms using the five virtual points and the four actual points. Experiment results show that the accuracy of the proposed method is better than that of other methods.

[1]  Jie Zhu,et al.  Subpixel eye gaze tracking , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[2]  Hidekazu Yoshikawa,et al.  Construction of the measurement system and its experimental study for diagnosing cerebral functional disorders using eye-sensing HMD , 2002, Proceedings of the 41st SICE Annual Conference. SICE 2002..

[3]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[4]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[5]  Alberto Del Bimbo,et al.  Interacting through eyes , 1997, Robotics Auton. Syst..

[6]  Ohno Takehiko A gaze tracking system for everyday gaze interaction , 2002 .

[7]  Kang Ryoung Park,et al.  A robust gaze detection method by compensating for facial movements based on corneal specularities , 2008, Pattern Recognit. Lett..

[8]  John Paulin Hansen,et al.  Evaluation of a low-cost open-source gaze tracker , 2010, ETRA.

[9]  Aude Billard,et al.  A wearable gaze tracking system for children in unconstrained environments , 2011, Comput. Vis. Image Underst..

[10]  Hua Cai,et al.  An integrated head pose and eye gaze tracking approach to non-intrusive visual attention measurement for wide FOV simulators , 2010, Virtual Reality.

[11]  Sheng-Wen Shih,et al.  A novel approach to 3-D gaze tracking using stereo cameras , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[12]  Naoki Mukawa,et al.  FreeGaze: a gaze tracking system for everyday gaze interaction , 2002, ETRA.

[13]  Yoshinobu Ebisawa,et al.  Easy eye-gaze calibration using a moving visual target in the head-free remote eye-gaze detection system , 2008, 2008 IEEE Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems.

[14]  Ju Liu,et al.  A gaze tracking scheme for eye-based intelligent control , 2010, 2010 8th World Congress on Intelligent Control and Automation.

[15]  Shumin Zhai,et al.  Keeping an eye for HCI , 1999, XII Brazilian Symposium on Computer Graphics and Image Processing (Cat. No.PR00481).

[16]  Paolo Dario,et al.  Prototype of a vision-based gaze-driven man-machine interface , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[17]  Hidekazu Yoshikawa,et al.  A new adaptive CAI system based on bio-informatic sensing: study on real-time method of analyzing ocular information by using eye-sensing HMD and method of adaptive CAI system configuration , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[18]  Kang Ryoung Park,et al.  New computer interface combining gaze tracking and brainwave measurements , 2011, IEEE Transactions on Consumer Electronics.

[19]  Kang Ryoung Park,et al.  Gaze Detection by Wearable Eye-Tracking and NIR LED-Based Head-Tracking Device Based on SVR , 2012 .

[20]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[21]  Chern-Sheng Lin An eye behavior measuring device for VR system , 2002 .

[22]  Daniel Memmert,et al.  The effects of eye movements, age, and expertise on inattentional blindness , 2006, Consciousness and Cognition.

[23]  Yoshinobu Ebisawa,et al.  Noncontact video-based eye-gaze detection method allowing large head displacements , 1996, Proceedings of 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[24]  Kang Ryoung Park,et al.  3D gaze tracking method using Purkinje images on eye optical model and pupil , 2012 .

[25]  Charles Leave Neural Networks: Algorithms, Applications and Programming Techniques , 1992 .

[26]  Jian-Gang Wang,et al.  Study on eye gaze estimation , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[27]  Carlos Hitoshi Morimoto,et al.  A computer vision framework for eye gaze tracking , 2003, 16th Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI 2003).

[28]  Myung Jin Chung,et al.  A novel non-intrusive eye gaze estimation using cross-ratio under large head motion , 2005, Comput. Vis. Image Underst..

[29]  David M. Skapura,et al.  Neural networks - algorithms, applications, and programming techniques , 1991, Computation and neural systems series.

[30]  Kang Ryoung Park,et al.  Robust gaze-tracking method by using frontal-viewing and eye-tracking cameras , 2009 .

[31]  Mohan M. Trivedi,et al.  Head Pose Estimation for Driver Assistance Systems: A Robust Algorithm and Experimental Evaluation , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[32]  Kang Ryoung Park,et al.  Experimental investigations of pupil accommodation factors. , 2011, Investigative ophthalmology & visual science.

[33]  Moshe Eizenman,et al.  An Automatic Personal Calibration Procedure for Advanced Gaze Estimation Systems , 2010, IEEE Transactions on Biomedical Engineering.