Real-time tracking of multiple people through stereo vision

People tracking is an important functionality for many applications that require to analyze the interaction between people and the environment. These applications range from security and environmental surveillance, to ambient intelligence applications. In this paper we describe a real-time People Localization and Tracking (PLT) System, based on a calibrated fixed stereo vision sensor. The system is able to locate and track multiple people in the environment, by using three different representations of the information coming from a stereo vision sensor: the left intensity image, the disparity image, and the 3-D world locations of measured points, as well as people modeling techniques in order to re-acquire people that are temporary occluded during tracking. Experimental results show that the system is able to track multiple people moving in an area approximately 3 x 8 meters in front of the sensor with high reliability and good precision.

[1]  Seong-Whan Lee,et al.  Multiple people tracking using an appearance model based on temporal color , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[2]  Larry S. Davis,et al.  M2Tracker: A Multi-view Approach to Segmenting and Tracking People in a Cluttered Scene Using Region-Based Stereo , 2002, ECCV.

[3]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[4]  Gérard G. Medioni,et al.  Object reacquisition using invariant appearance model , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[5]  J. Krumm,et al.  Multi-camera multi-person tracking for EasyLiving , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[6]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[7]  Larry S. Davis,et al.  W4S: A real-time system detecting and tracking people in 2 1/2D , 1998, ECCV.

[8]  Stuart J. Russell,et al.  Image Segmentation in Video Sequences: A Probabilistic Approach , 1997, UAI.

[9]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Ramakant Nevatia,et al.  Tracking multiple humans in crowded environment , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[11]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[12]  R. Y. Tsai,et al.  An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision , 1986, CVPR 1986.

[13]  Rainer Stiefelhagen,et al.  Towards vision-based 3-D people tracking in a smart room , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[14]  Amedeo Cesta,et al.  Towards ambient intelligence for the domestic care of the elderly , 2005 .

[15]  Jiang Li,et al.  Color based multiple people tracking , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[16]  Larry S. Davis,et al.  An appearance-based body model for multiple people tracking , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[17]  Kurt Konolige,et al.  Small Vision Systems: Hardware and Implementation , 1998 .

[18]  Trevor Darrell,et al.  Plan-view trajectory estimation with dense stereo background models , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[19]  Michael Harville,et al.  Foreground segmentation using adaptive mixture models in color and depth , 2001, Proceedings IEEE Workshop on Detection and Recognition of Events in Video.

[20]  Trevor Darrell,et al.  Integrated Person Tracking Using Stereo, Color, and Pattern Detection , 2000, International Journal of Computer Vision.