Visuo-motor coordination of a humanoid robot head with human-like vision in face tracking

The application of robots in contact with humans, in services or assistance, implies the realization of effective and acceptable human-robot interaction. In humans, vision plays a significant role in social interaction, like for example in the recognition of faces and expressions, as well as in gesture understanding. Visuo-motor coordination of eye and neck movements in humans presents high performances in terms of accuracy, speed, effectiveness. This is due to the mechanical, cinematic, and dynamic features of the head muscular-skeletal apparatus and to the peculiar processing of visual data, detected with a space variant resolution. The work presented in this paper aims at employing retina-like cameras in human-like robotic head, reproducing similar degrees of freedom, ranges of motion, speeds, and accelerations of human neck and eye movements, in order to improve visuo-motor coordination. The use of retina-like cameras allows a faster human-like processing of visual information, better suited for the control of head movements. On the other hand, retina-like cameras provide high resolution information only in a small area of the image and thus need to be dynamically focused on the points of interest. Experimental trials were focused on the capability of identifying and tracking human faces, as a first step of human-robot interaction. Preliminary experimental results show the feasibility of a smooth face tracking, by a closed control loop for the head movements, based on retina-like vision.

[1]  Giulio Sandini,et al.  Space variant imaging , 1995 .

[2]  E. Guglielmelli,et al.  Robotics in medicine , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[3]  Kazuhiro Kosuge,et al.  Manipulation of a large object by multiple DR Helpers in cooperation with a human , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[4]  Paolo Dario,et al.  Design and experiments on a personal robotic assistant , 1998, Adv. Robotics.

[5]  Martha J. Farah,et al.  The Cognitive Neuroscience of Vision , 2000 .

[6]  Francesco Mondada,et al.  Active perception, navigation, homing, and grasping: an autonomous perspective , 1994, Proceedings of PerAc '94. From Perception to Action.

[7]  Cynthia Breazeal,et al.  Designing sociable robots , 2002 .

[8]  R. Carpenter,et al.  Movements of the Eyes , 1978 .

[9]  R. Bajcsy.  Active perception , 1988 .

[10]  Shigeki Sugano,et al.  Acquisition of internal representation in robots - toward human-robot communication using primitive language , 2000, Adv. Robotics.

[11]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[12]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[13]  Paolo Dario,et al.  Adaptable semi-autonomy in personal robots , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[14]  Shigeki Sugano,et al.  Human-humanoid physical interaction realizing force following and task fulfillment , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[15]  Qian Chen,et al.  Active camera guided manipulation , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[16]  Benedetto Allotta,et al.  Robotics for medical applications , 1996, IEEE Robotics Autom. Mag..

[17]  Giulio Sandini,et al.  A retina-like CMOS sensor and its applications , 2000, Proceedings of the 2000 IEEE Sensor Array and Multichannel Signal Processing Workshop. SAM 2000 (Cat. No.00EX410).

[18]  Giulio Sandini,et al.  Development and Robotics , 2001 .

[19]  A. Takanishi,et al.  Development of a new human-like head robot WE-4 , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.