Tracking and pursuing persons with a mobile robot

In this paper we address the problem of detecting, tracking, and pursuing persons with a mobile robot in real-time. Our system consists of two cooperatively interacting parts: A visual gaze holding process using an active stereo vision system and a component controlling the trajectory of the robot. The detection process is based on an approach which combines color, motion, and contour information. Additionally, facial features and depth information are integrated to increase the robustness of detection. For navigation a potential field method is used taking into account the path of the person going ahead as well as a local environment map built by means of laser range sensor data. Consequently, stationary and dynamic obstacles can be avoided during the process of pursuit. The system is able to operate at approximately human walking rates.

[1]  Roberto Cipolla,et al.  Feature-based human face detection , 1997, Image Vis. Comput..

[2]  Shaogang Gong,et al.  Tracking and segmenting people in varying lighting conditions using colour , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[3]  K. Rohr.  Towards model-based recognition of human movements in image sequences , 1994 .

[4]  Paul W. Fieguth,et al.  Color-based tracking of heads and other mobile objects at video frame rates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Christian Schlegel,et al.  Vision Based Person Tracking with a Mobile Robot , 1998, BMVC.

[6]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[7]  Jake K. Aggarwal,et al.  Human motion analysis: a review , 1997, Proceedings IEEE Nonrigid and Articulated Motion Workshop.

[8]  James L. Crowley,et al.  Multi-modal tracking of faces for video communications , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1986 .

[10]  Yehezkel Yeshurun,et al.  Preprocessing of Face Images: Detection of Features and Pose Normalization , 1998, Comput. Vis. Image Underst..

[11]  J. Sklansky,et al.  Segmentation of people in motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[12]  Anup Basu,et al.  Motion Tracking with an Active Camera , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Joachim Denzler,et al.  Active Rays: A New Approach to Contour Tracking , 1996 .