Development of gaze tracking interface for controlling 3D contents

Abstract Nowadays, the stereoscopic 3D technology is being used in variety of applications including, but not limited to, architecture, design, games, and medicine. The technologies that utilize the concepts of virtual reality have the tendency to be generic and provide the users with a realistic interaction with the environment. In order to control stereoscopic images, conventional methods had to use devices such as keyboard and/or mouse for the input control signal. However, it is challenging for users to control stereoscopic images by using these types of devices and it is difficult to obtain a desired accuracy due to the errors existing in the device. In addition, the major factor is that these methods do not allow users to feel the contents in a realistic manner. In this paper, a gaze tracking interface (line of sight) is developed to control the stereoscopic 3D contents. The proposed method is natural, intuitive, and more efficient compared to the conventional methods that use keyboard and mouse. Controlling various 3D contents including S3D games, tele-operated surgery, military training, and pilot simulation will be achievable through the proposed method.

[1]  Kang Ryoung Park,et al.  Facial and Eye Gaze Detection , 2002, Biologically Motivated Computer Vision.

[2]  J.R. LaCourse,et al.  An eye movement communication-control system for the disabled , 1990, IEEE Transactions on Biomedical Engineering.

[3]  Johnalan Keegan,et al.  An electrooculogram-based binary saccade sequence classification (BSSC) technique for augmentative communication and control , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Vladimir Pavlovic,et al.  Toward multimodal human-computer interface , 1998, Proc. IEEE.

[5]  C. E. Johanson,et al.  Effects of phencyclidine, secobarbital and diazepam on eye tracking in rhesus monkeys , 2004, Psychopharmacology.

[6]  Hiroyuki Nakamura,et al.  Design of eye movement monitoring system for practical environment , 1991, Medical Imaging.

[7]  Allen R. Hanson,et al.  Sensitivity of the pose refinement problem to accurate estimation of camera parameters , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[8]  Junseok Park,et al.  Robust Gaze Tracking Method for Stereoscopic Virtual Reality Systems , 2007, HCI.

[9]  Roger Y. Tsai,et al.  Techniques for calibration of the scale factor and image center for high accuracy 3D machine vision metrology , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[10]  Kang Ryoung Park,et al.  A robust eye gaze tracking method based on a virtual eyeball model , 2008, Machine Vision and Applications.

[11]  H. M. Karara,et al.  Direct Linear Transformation from Comparator Coordinates into Object Space Coordinates in Close-Range Photogrammetry , 2015 .

[12]  Robert J. K. Jacob,et al.  Evaluation of eye gaze interaction , 2000, CHI.

[13]  H. Hatze,et al.  High-precision three-dimensional photogrammetric calibration and object space reconstruction using a modified DLT-approach. , 1988, Journal of biomechanics.

[14]  T M McLaughlin,et al.  A technique for obtainng spatial kinematic parameters of segments of biomechanical systems from cinematographic data. , 1980, Journal of biomechanics.

[15]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[16]  Kang Ryoung Park,et al.  A Study on Eye Gaze Estimation Method Based on Cornea Model of Human Eye , 2007, MIRAGE.

[17]  John W. Melvin,et al.  BIOMECHANICS APPLICATIONS OF DIRECT LINEAR TRANSFORMATION IN CLOSE-RANGE PHOTOGRAMMETRY , 1978 .

[18]  Kang Ryoung Park,et al.  Vision-based gaze estimation method for stereoscopic display systems , 2007, IFAC HMS.

[19]  Mark S. Sanders,et al.  Human Factors in Engineering and Design , 1957 .

[20]  Roel Vertegaal,et al.  An eye for an eye: a performance evaluation comparison of the LC technologies and Tobii eye trackers , 2004, ETRA.

[21]  Raymond L. Czaplewski,et al.  Misclassification Bias in Areal Estimates , 1992 .

[22]  Katsuro Inoue,et al.  Quick Button Selection with Eye Gazing for General GUI Environment , 2000 .

[23]  Giancarlo Ferrigno,et al.  Elite: A Digital Dedicated Hardware System for Movement Analysis Via Real-Time TV Signal Processing , 1985, IEEE Transactions on Biomedical Engineering.

[24]  Roger Y. Tsai,et al.  Techniques for Calibration of the Scale Factor and Image Center for High Accuracy 3-D Machine Vision Metrology , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  K. S. Park,et al.  An efficient camera calibration method for vision-based head tracking , 2000, Int. J. Hum. Comput. Stud..

[26]  K. S. Park,et al.  A simple vision-based head tracking method for eye-controlled human/computer interface , 2001, Int. J. Hum. Comput. Stud..