Gaze control using human eye movements

In this paper, we propose a visual servoing of the orientation of a camera mounted on a robot, using human eye movements. The study aims at the remote survey of sensitive sites or the intervention in contaminated nuclear sites. Visual data stemmed from an eye-tracker, providing the direction of the look of an operator, is generally noisy and sometimes inconsistent. Filtering, smoothing and stabilizing these eye tracker data are thus necessary in order to move the camera in the direction specified by the operator's eye. The visual servoing control scheme, as well as experimental results, are also presented.

[1]  Minoru Asada,et al.  Visual servoing utilizing zoom mechanism , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[2]  Takeo Kanade,et al.  Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision , 1993, IEEE Trans. Robotics Autom..

[3]  Gregory D. Hager,et al.  Real-time tracking of image regions with changes in geometry and illumination , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[5]  Koichi Hashimoto,et al.  Visual Servoing: Real-Time Control of Robot Manipulators Based on Visual Sensory Feedback , 1993 .

[6]  Peter K. Allen,et al.  Automated tracking and grasping of a moving object with a robotic hand-eye system , 1993, IEEE Trans. Robotics Autom..

[7]  Seth Hutchinson,et al.  Visual compliance: task-directed visual servo control , 1994, IEEE Trans. Robotics Autom..

[8]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[9]  Bernard Espiau Asservissement visuel et commande de la distance focale , 1995 .