Robust Gaze Tracking Method for Stereoscopic Virtual Reality Systems

In this paper, we propose a new face and eye gaze tracking method that works by attaching gaze tracking devices to stereoscopic shutter glasses. This paper presents six advantages over previous works. First, through using the proposed method with stereoscopic VR systems, users feel more immersed and comfortable. Second, by capturing reflected eye images with a hot mirror, we were able to increase eye gaze accuracy in a vertical direction. Third, by attaching the infrared passing filter and using an IR illuminator, we were able to obtain robust gaze tracking performance irrespective of environmental lighting conditions. Fourth, we used a simple 2D-based eye gaze estimation method based on the detected pupil center and the 'geometric transform' process. Fifth, to prevent gaze positions from being unintentionally moved by natural eye blinking, we discriminated between different kinds of eye blinking by measuring pupil sizes. This information was also used for button clicking or mode toggling. Sixth, the final gaze position was calculated by the vector summation of face and eye gaze positions and allowing for natural face and eye movements. Experimental results showed that the face and eye gaze estimation error was less than one degree.

[1]  Sheng-Wen Shih,et al.  A novel approach to 3-D gaze tracking using stereo cameras , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[2]  Juhnyoung Lee,et al.  Data Engineering Issues in E-Commerce and Services, Second International Workshop, DEECS 2006, San Francisco, CA, USA, June 26, 2006, Proceedings , 2006, DEECS.

[3]  John Daugman.  How iris recognition works , 2004 .

[4]  Kang Ryoung Park,et al.  A Study on Eye Gaze Estimation Method Based on Cornea Model of Human Eye , 2007, MIRAGE.

[5]  Mark R. Cutkosky,et al.  Electrorheological fluid-based robotic fingers with tactile sensing , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[6]  Paul Wintz,et al.  Digital image processing (2nd ed.) , 1987 .

[7]  Yoseph Bar-Cohen,et al.  Virtual reality robotic operation simulations using MEMICA Haptic System , 2000 .

[8]  Myung Jin Chung,et al.  Non-contact eye gaze tracking system by mapping of corneal reflections , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[9]  Kang Ryoung Park,et al.  Fake Iris Detection by Using Purkinje Image , 2006, ICB.

[10]  Kang Ryoung Park,et al.  A Study on Fake Iris Detection based on the Reflectance of the Iris to the Sclera for Iris Recognition , 2005 .

[11]  Kang Ryoung Park,et al.  A Study on Manipulating Method of 3D Game in HMD Environment by using Eye Tracking , 2008 .

[12]  Anand K. Gramopadhye,et al.  Use of Computer Based Training for Aircraft Inspectors: Findings and Recommendations , 2000 .

[13]  Yongjoo Cho,et al.  3D View Controlling by Using Eye Gaze Tracking in First Person Shooting Game , 2005 .

[14]  Dan Stoianovici,et al.  Effect of a Pneumatically Driven Haptic Interface on the Perceptional Capabilities of Human Operators , 1998, Presence.