Identification and tracking using laser and vision of people maneuvering in crowded environments

This paper presents a people tracker that uses a two-layered laser range sensor (LRS) and a fisheye camera. The LRS detects waists and knees of people, and the camera captures color images of torsos of people detected by the LRS. From the data of people's position obtained by the LRS and the color histogram obtained by the camera, heuristic-rule-based and global-nearest-neighbor-based data association can identify multiple people in crowded environments. The identified people are tracked via a model-based tracker; an interacting multiple model estimator is applied to track people maneuvers, such as walking, running, sudden starting/stopping, and sudden turning. Simulation and experimental results show that our people identification and tracking method provides better performance than conventional methods.

[1]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[2]  Huosheng Hu,et al.  Multisensor-Based Human Detection and Tracking for Mobile Service Robots , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Erwin Prassler,et al.  Tracking Multiple Moving Objects for Real-Time Robot Navigation , 2000, Auton. Robots.

[4]  George W. Irwin,et al.  Manoeuvring Target Tracking Using a Multiple-Model Bootstrap Filter , 2001, Sequential Monte Carlo Methods in Practice.

[5]  Xuan Song,et al.  Bayesian fusion of laser and vision for multiple People Detection and tracking , 2008, 2008 SICE Annual Conference.

[6]  Tzvetan Semerdjiev,et al.  A study of a target tracking algorithm using global nearest neighbor approach , 2003, CompSysTech '03.

[7]  R. Kurazume,et al.  Target tracking using SIR and MCMC particle filters by multiple cameras and laser range finders , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Wolfram Burgard,et al.  People Tracking with Mobile Robots Using Sample-Based Joint Probabilistic Data Association Filters , 2003, Int. J. Robotics Res..

[9]  Shin'ichi Yuta,et al.  Fusion of double layered multiple laser range finders for people detection from a mobile robot , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[10]  Jan-Olof Eklundh,et al.  Detecting and tracking moving objects from a mobile platform using a laser range scanner , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[11]  Thierry Chateau,et al.  A method based on multilayer laserscanner to detect and track pedestrians in urban environment , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[12]  Masafumi Hashimoto,et al.  A Laser Based Multi-Target Tracking for Mobile Robot , 2006, IAS.

[13]  Amir Averbuch,et al.  Interacting Multiple Model Methods in Target Tracking: A Survey , 1988 .

[14]  Y. Bar-Shalom.  Tracking and data association , 1988 .

[15]  Juan I. Nieto,et al.  Multiple target tracking using Sequential Monte Carlo Methods and statistical data association , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[16]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .

[17]  Ryosuke Shibasaki,et al.  Multi-modal tracking of people using laser scanners and video camera , 2008, Image Vis. Comput..

[18]  Sebastian Thrun,et al.  Online simultaneous localization and mapping with detection and tracking of moving objects: theory and results from a ground vehicle in crowded urban areas , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[19]  H. Kuhn.  The Hungarian method for the assignment problem , 1955 .

[20]  Masafumi Hashimoto,et al.  People tracking with multiple laser range sensors , 2007, ICMIT: Mechatronics and Information Technology.

[21]  Maja J. Mataric,et al.  A laser-based people tracker , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).