A person following behaviour for a mobile robot

In this paper, a person following behaviour for a mobile robot is presented. The head of the person is located using skin colour detection. Then, a control loop is fed with the camera movements required to put the upper part of the person in the center of the image. The algorithm was tested in different rooms of a research lab. It performed well in all lighting conditions except in direct sunlight. Since the background and lighting cannot be controlled, the vision algorithm must be robust to such changes. However, since the computing power is quite limited, the algorithm must have as low complexity as possible.

[1]  Dana H. Ballard,et al.  Animate Vision , 1991, Artif. Intell..

[2]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[3]  Henrik I. Christensen,et al.  Triangulation based fusion of ultrasonic sensor data , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[4]  James L. Crowley.  Vision for man-machine interaction , 1995, Robotics Auton. Syst..

[5]  Shaogang Gong,et al.  Tracking and segmenting people in varying lighting conditions using colour , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[6]  John R. Kender,et al.  Finding skin in color images , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[7]  Anup Basu,et al.  Motion Tracking with an Active Camera , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Pattie Maes,et al.  Designing autonomous agents: Theory and practice from biology to engineering and back , 1990, Robotics Auton. Syst..

[9]  Giulio Sandini,et al.  Visual Behaviors for Docking , 1997, Comput. Vis. Image Underst..

[10]  José Santos-Victor,et al.  Robust visual tracking by an active observer , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[11]  James L. Crowley,et al.  Integration and control of reactive visual processes , 1994, Robotics Auton. Syst..

[12]  Peter K. Allen,et al.  Design of a partitioned visual feedback controller , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[13]  Tomas Uhlin,et al.  Closing the loop: detection and pursuit of a moving object by a moving observer , 1996, Image Vis. Comput..

[14]  Atsuto Maki,et al.  Phase-Based Disparity Estimation in Binocular Tracking , 1993 .