Vision and RFID-based person tracking in crowds from a mobile robot

This paper deals with the tracking of persons in a human cluttered environment. It is performed by an active perception system, consisting of a camera mounted on a pan-tilt unit and a 360° RFID detection system which are embedded on a mobile robot. Particle filters enable the fusion of heterogeneous data into the proposal distribution from which the particles are sampled. The information provided by the tracker is then used to build sensor-based dedicated control laws in order to make the robot follow the RFID tagged person. Finally, experiments on our mobile robot are presented in order to highlight the relevance and complementarity of the developed perceptual functions.

[1]  Paul A. Viola,et al.  Fast Multi-view Face Detection , 2003 .

[2]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[3]  Tatsuya Nomura,et al.  Analysis of People Trajectories with Ubiquitous Sensors in a Science Museum , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[4]  Grzegorz Cielniak,et al.  Improved data association and occlusion handling for vision-based people tracking by mobile robots , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Dieter Fox,et al.  Knowledge Compilation Properties of Trees-of-BDDs, Revisited , 2009, IJCAI.

[6]  Ben J. A. Kröse,et al.  Part based people detection using 2D range data and images , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Michael Isard,et al.  ICONDENSATION: Unifying Low-Level and High-Level Tracking in a Stochastic Framework , 1998, ECCV.

[8]  Frédéric Lerasle,et al.  Human / robot visual interaction for a tour-guide robot , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Rachid Alami,et al.  An Architecture for Autonomy , 1998, Int. J. Robotics Res..

[10]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[11]  Peter Corke,et al.  Visual Control of Robots: High-Performance Visual Servoing , 1996 .

[12]  Frédéric Lerasle,et al.  A Tuning Strategy for Face Recognition in Robotic Application , 2009, VISAPP.

[13]  Wolfram Burgard,et al.  Mapping and localization with RFID technology , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[14]  Jungho Lee,et al.  Object tracking method using back-projection of multiple color histogram models , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[15]  Patrick Pérez,et al.  Data fusion for visual tracking with particles , 2004, Proceedings of the IEEE.