Robot and obstacles localization and tracking with an external camera ring

In this paper a ring of calibrated and synchronized cameras is used for achieving robot and obstacle localization inside a common observed area. To avoid complex appearance matching derived from the wide-baseline arrangement of cameras, a metric occupancy grid is obtained by intersection of silhouettes projected onto the floor. A particle filter is proposed for tracking multiple objects by using the grid as observation data. A clustering algorithm is included in the filter to increase the robustness and adaptability of the multimodal estimation task. To preserve identity of the robot from the set of tracked objects, odometry readings are used to compute a maximum likelihood (ML) global trajectory identification. As a proof of concept, real results are obtained in a long sequence with a mobile robot moving in a human-cluttered scene.

[1]  L. Davis,et al.  M2Tracker: A Multi-View Approach to Segmenting and Tracking People in a Cluttered Scene , 2003, International Journal of Computer Vision.

[2]  C. Hue,et al.  A particle filter to track multiple objects , 2001, Proceedings 2001 IEEE Workshop on Multi-Object Tracking.

[3]  Hideki Hashimoto,et al.  Intelligent Space and Mobile Robots , 2005, The Industrial Information Technology Handbook.

[4]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[5]  Michael Isard,et al.  BraMBLe: a Bayesian multiple-blob tracker , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[6]  Ramakant Nevatia,et al.  Tracking multiple humans in crowded environment , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[7]  Dieter Fox,et al.  Knowledge Compilation Properties of Trees-of-BDDs, Revisited , 2009, IJCAI.

[8]  Patrick Pérez,et al.  Maintaining multimodality through mixture tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  Mubarak Shah,et al.  A Multiview Approach to Tracking People in Crowded Scenes Using a Planar Homography Constraint , 2006, ECCV.

[10]  Gregory D. Hager,et al.  Probabilistic Data Association Methods for Tracking Complex Visual Objects , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Marta Marrón,et al.  "XPFCP": An Extended Particle Filter for Tracking Multiple and Dynamic Objects in Complex Environments , 2005, ISIE 2005.

[12]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Pascal Fua,et al.  Robust People Tracking with Global Trajectory Optimization , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[14]  Rainer Stiefelhagen,et al.  Towards vision-based 3-D people tracking in a smart room , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[15]  Y. Bar-Shalom.  Tracking and data association , 1988 .

[16]  Trevor Darrell,et al.  A Probabilistic Framework for Multi-modal Multi-Person Tracking , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[17]  K. Otsuka,et al.  Multiview occlusion analysis for tracking densely populated objects based on 2-D visual angles , 2004, CVPR 2004.

[18]  Jean-Marc Odobez,et al.  Using particles to track varying numbers of interacting people , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  J.C. Garcia,et al.  A probabilistic multimodal algorithm for trackingg multiple and dynamic objects , 2004, Proceedings World Automation Congress, 2004..

[20]  Liqiang Feng,et al.  Measurement and correction of systematic odometry errors in mobile robots , 1996, IEEE Trans. Robotics Autom..

[21]  Isaac Cohen,et al.  Jeju Island , Korea TRACKING PEOPLE IN CROWDED SCENES ACROSS MULTIPLE CAMERAS , 2004 .