Model based 3D gaze estimation for provision of virtual eye contact

In recent years, video communication has received a rapidly increasing interest on the market. Still unsolved is the problem of eye contact. The conferee still needs to decide whether to look into the camera or directly to the screen. Recently, a solution to this problem was presented which is based on a real-time 3D modeling of the conferees [1]. In order to achieve direct eye contact the authors defined a virtual camera directly on the screen in the eyes of the remote conferee. This paper discusses the problem of adequately positioning this virtual camera. A new approach will be presented which performs an eye and gaze tracking directly on the real-time 3D model rather than on the 2D image. Our methods not only provides robust and highly accurate results but is also able to additionally measure the distance between the conferees eye and the display with high precision.

[1]  Roel Vertegaal,et al.  GAZE-2: conveying eye contact in group video conferencing using eye-controlled camera direction , 2003, CHI '03.

[2]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[3]  Kentaro Toyama,et al.  Gaze Awareness for Video-Conferencing: A Software Approach , 2000, IEEE Multim..

[4]  Oliver Schreer,et al.  Patch-sweeping with robust prior for high precision depth estimation in real-time systems , 2011, 2011 18th IEEE International Conference on Image Processing.

[5]  Ingemar J. Cox,et al.  Teleconferencing eye contract using a virtual camera , 1993, INTERCHI Adjunct Proceedings.

[6]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Oliver Schreer,et al.  Real-time patch sweeping for high-quality depth estimation in 3D video conferencing applications , 2011, Electronic Imaging.

[8]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Lothar Mühlbach,et al.  Telepresence in Videocommunications: A Study on Stereoscopy and Individual Eye Contact , 1995, Hum. Factors.