Range-Based People Detection and Tracking for Socially Enabled Service Robots

With a growing number of robots deployed in populated environments, the ability to detect and track humans, recognize their activities, attributes and social relations are key components for future service robots. In this article we will consider fundamentals towards these goals and present several results using 2D range data.We first propose a learning method to detect people in sensory data based on a set of boosted features. The method largely outperforms the state of the art that typically relies on hand-tuned classifiers. Then, we present a person tracking approach based on the detection and fusion of leg tracks. To deal with the frequent occlusion and self-occlusion of legs, we extend a Multi-Hypothesis Tracking (MHT) approach by the ability to explicitly reason about and deal with adaptive occlusion probabilities. Finally, we address the problem of tracking groups of people, a first step towards the recognition of social relations. We further extend the MHT approach by a multiple model hypothesis stage able to reflect split/merge events in group formation processes. The proposed extension is mathematically elegant, runs in real-time and further allows to accurately estimate the number of people in each group. The article concludes with prospects and suggestions for future research.

[1]  Ryosuke Shibasaki,et al.  Laser-based Interacting People Tracking Using Multi-level Observations , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Frank Dellaert,et al.  MCMC Data Association and Sparse Factorization Updating for Real Time Multitarget Tracking with Merged and Multiple Measurements , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Biswajit Bose,et al.  Multi-class object tracking algorithm that handles fragmentation and grouping , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Dirk Schulz,et al.  A Probabilistic Exemplar Approach to Combine Laser and Vision for Person Tracking , 2006, Robotics: Science and Systems.

[5]  Wolfram Burgard,et al.  Semantic Place Classification of Indoor Environments with Mobile Robots Using Boosting , 2005, AAAI.

[6]  Rama Chellappa,et al.  A Multiple-Hypothesis Approach for Multiobject Visual Tracking , 2007, IEEE Transactions on Image Processing.

[7]  Wolfram Burgard,et al.  People Tracking with Mobile Robots Using Sample-Based Joint Probabilistic Data Association Filters , 2003, Int. J. Robotics Res..

[8]  Wolfram Burgard,et al.  Multi-model Hypothesis Group Tracking and Group Size Estimation , 2010, Int. J. Soc. Robotics.

[9]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[10]  Wolfram Burgard,et al.  Supervised Learning of Places from Range Data using AdaBoost , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[11]  Henrik I. Christensen,et al.  Tracking for following and passing persons , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Andreas Zell,et al.  Real-time object tracking for soccer-robots without color information , 2004, Robotics Auton. Syst..

[13]  Ingemar J. Cox,et al.  An Efficient Implementation of Reid's Multiple Hypothesis Tracking Algorithm and Its Evaluation for the Purpose of Visual Tracking , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Wolfram Burgard,et al.  Efficient people tracking in laser range data using a multi-hypothesis leg-tracker with adaptive occlusion probabilities , 2008, 2008 IEEE International Conference on Robotics and Automation.

[15]  Pólo de Coimbra,et al.  Segmentation and Geometric Primitives Extraction from 2D Laser Range Data for Mobile Robot Applications , 2005 .

[16]  M. Kleinehagenbrock,et al.  Person tracking with a mobile robot based on multi-modal anchoring , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[17]  Wolfram Burgard,et al.  Multiple Hypothesis Tracking of Clusters of People , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  K. G. Murty An Algorithm for Ranking All the Assignment in Order of Increasing Cost , 1968 .

[19]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[20]  Vincent Kanade,et al.  Clustering Algorithms , 2021, Wireless RF Energy Transfer in the Massive IoT Era.

[21]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[22]  Azriel Rosenfeld,et al.  Tracking Groups of People , 2000, Comput. Vis. Image Underst..

[23]  Cristiano Premebida Segmentation and Geometric Primitives Extraction from 2D Laser Range Data for Mobile Robot Applications , 2005 .

[24]  G. Aloupis On Computing Geometric Estimators of Location , 2001 .

[25]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[26]  Gregory D. Hager,et al.  Probabilistic data association methods in visual tracking of groups , 2004, CVPR 2004.

[27]  Ingemar J. Cox,et al.  On Finding Ranked Assignments With Application to Multi-Target Tracking and Motion Correspondence , 1995 .

[28]  Matthias Scheutz,et al.  Fast, reliable, adaptive, bimodal people tracking for indoor environments , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[29]  Wolfram Burgard,et al.  Tracking groups of people with a multi-model hypothesis tracker , 2009, 2009 IEEE International Conference on Robotics and Automation.

[30]  Wolfram Burgard,et al.  Using Boosted Features for the Detection of People in 2D Range Data , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[31]  L. Kleeman,et al.  A Multiple Hypothesis Walking Person Tracker with Switched Dynamic Model , 2004 .

[32]  YangQuan Chen,et al.  Some sensing and perception techniques for an omnidirectional ground vehicle with a laser scanner , 2002, Proceedings of the IEEE Internatinal Symposium on Intelligent Control.

[33]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[34]  Wolfram Burgard,et al.  Map building with mobile robots in dynamic environments , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[35]  K. Arras Feature-based robot navigation in known and unknown environments , 2003 .

[36]  Maja J. Mataric,et al.  A laser-based people tracker , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[37]  Universityof SouthernCalifornia LosAngeles Laser-based People Tracking , 2002 .

[38]  Ben J. A. Kröse,et al.  Keeping Track of Humans: Have I Seen This Person Before? , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[39]  Erwin Prassler,et al.  Fast and robust tracking of multiple moving objects with a laser range finder , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[40]  António E. Ruano,et al.  Fast Line, Arc/Circle and Leg Detection from Laser Scan Data in a Player Driver , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[41]  Katta G. Murty,et al.  Letter to the Editor - An Algorithm for Ranking all the Assignments in Order of Increasing Cost , 1968, Oper. Res..

[42]  Ryosuke Shibasaki,et al.  Tracking multiple people using laser and vision , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.