3D gaze tracking method using Purkinje images on eye optical model and pupil

Gaze tracking is to detect the position a user is looking at. Most research on gaze estimation has focused on calculating the X, Y gaze position on a 2D plane. However, as the importance of stereoscopic displays and 3D applications has increased greatly, research into 3D gaze estimation of not only the X, Y gaze position, but also the Z gaze position has gained attention for the development of next-generation interfaces. In this paper, we propose a new method for estimating the 3D gaze position based on the illuminative reflections (Purkinje images) on the surface of the cornea and lens by considering the 3D optical structure of the human eye model. This research is novel in the following four ways compared with previous work. First, we theoretically analyze the generated models of Purkinje images based on the 3D human eye model for 3D gaze estimation. Second, the relative positions of the first and fourth Purkinje images to the pupil center, inter-distance between these two Purkinje images, and pupil size are used as the features for calculating the Z gaze position. The pupil size is used on the basis of the fact that pupil accommodation happens according to the gaze positions in the Z direction. Third, with these features as inputs, the final Z gaze position is calculated using a multi-layered perceptron (MLP). Fourth, the X, Y gaze position on the 2D plane is calculated by the position of the pupil center based on a geometric transform considering the calculated Z gaze position. Experimental results showed that the average errors of the 3D gaze estimation were about 0.961 (0.48 cm) on the X-axis, 1.601 (0.77 cm) on the Y-axis, and 4.59 cm along the Z-axis in 3D space. & 2011 Elsevier Ltd. All rights reserved.

[1]  Peter D. Lawrence,et al.  3D point-of-gaze estimation on a volumetric display , 2008, ETRA '08.

[2]  A. Sugimoto,et al.  Active wearable vision sensor: recognition of human activities and environments , 2004, International Conference on Informatics Research for Development of Knowledge Society Infrastructure, 2004. ICKS 2004..

[3]  Masatsugu Kidode,et al.  Estimation of 3D gazed position using view lines , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[4]  Kang Ryoung Park,et al.  Robust gaze-tracking method by using frontal-viewing and eye-tracking cameras , 2009 .

[5]  Kang Ryoung Park,et al.  New computer interface combining gaze tracking and brainwave measurements , 2011, IEEE Transactions on Consumer Electronics.

[6]  Myung Jin Chung,et al.  A novel non-intrusive eye gaze estimation using cross-ratio under large head motion , 2005, Comput. Vis. Image Underst..

[7]  Elaine L. Zanutto.  A Comparison of Propensity Score and Linear Regression Analysis of Complex Survey Data , 2021, Journal of Data Science.

[8]  Helge J. Ritter,et al.  A neural network for 3D gaze recording with binocular eye trackers , 2006, Int. J. Parallel Emergent Distributed Syst..

[9]  Kang Ryoung Park,et al.  Fake iris detection method using Purkinje images based on gaze position , 2008 .

[10]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[11]  Kang Ryoung Park,et al.  A realistic game system using multi-modal user interfaces , 2010, IEEE Transactions on Consumer Electronics.

[12]  Kang Ryoung Park,et al.  Experimental investigations of pupil accommodation factors. , 2011, Investigative ophthalmology & visual science.

[13]  Junseok Park,et al.  Robust Gaze Tracking Method for Stereoscopic Virtual Reality Systems , 2007, HCI.

[14]  Chern-Sheng Lin,et al.  A novel device for head gesture measurement system in combination with eye-controlled human-machine interface , 2006 .

[15]  Mohan M. Trivedi,et al.  Head Pose Estimation for Driver Assistance Systems: A Robust Algorithm and Experimental Evaluation , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[16]  Kang Ryoung Park,et al.  A robust gaze detection method by compensating for facial movements based on corneal specularities , 2008, Pattern Recognit. Lett..

[17]  K. Zou,et al.  Correlation and simple linear regression. , 2003, Radiology.

[18]  Paul Wintz,et al.  Digital image processing (2nd ed.) , 1987 .

[19]  Chern-Sheng Lin,et al.  Design of a computer game using an eye-tracking device for eye's activity rehabilitation , 2004 .

[20]  Gerhard Tröster,et al.  Wearable EOG goggles: Seamless sensing and context-awareness in everyday environments , 2009, J. Ambient Intell. Smart Environ..

[21]  Yong-Moo Kwon,et al.  3D Gaze Estimation and Interaction to Stereo Dispaly , 2006, Int. J. Virtual Real..

[22]  Marc Erich Latoschik,et al.  Evaluation of Binocular Eye Trackers and Algorithms for 3D Gaze Interaction in Virtual Reality Environments , 2008, J. Virtual Real. Broadcast..

[23]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[24]  Jian-Gang Wang,et al.  Study on eye gaze estimation , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[25]  Kang Ryoung Park,et al.  Gaze tracking system at a distance for controlling IPTV , 2010, IEEE Transactions on Consumer Electronics.

[26]  Katsuro Inoue,et al.  Quick Button Selection with Eye Gazing for General GUI Environment , 2000 .

[27]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[28]  David M. Skapura,et al.  Neural networks - algorithms, applications, and programming techniques , 1991, Computation and neural systems series.

[29]  Mincheol Whang,et al.  A brain–computer interface method combined with eye tracking for 3D interaction , 2010, Journal of Neuroscience Methods.

[30]  L. Young,et al.  Survey of eye movement recording methods , 1975 .

[31]  G. Breinin,et al.  The effect of pupil size on accommodation, convergence, and the AC/A ratio. , 1962, Investigative ophthalmology.