People Tracking on a Mobile Companion Robot

Developing methods for people tracking on mobile robots is of great interest to engineers and scientists alike. Plenty of research is focused on pedestrian tracking in public areas. Yet, fewer work exists on practical people tracking in home environments with non-static cameras. This paper presents a real time people tracking system for mobile robots that filters asynchronous, multi-modal detections using a Kalman filter for each person. It allows for upright and sitting pose people tracking in home environments. We evaluate the performance of the tracking system using different detection modalities and compared it to state-of-the-art people detection methods. Evaluation was done on a newly collected indoor data set which we made publicly available for comparison and benchmarking.

[1]  Subhransu Maji,et al.  Detecting People Using Mutually Consistent Poselet Activations , 2010, ECCV.

[2]  A. James Stewart,et al.  Uncertainty propagation and analysis of image-guided surgery , 2011, Medical Imaging.

[3]  Christian Vollmer,et al.  Estimation of human upper body orientation for mobile robotics using an SVM decision tree on monocular images , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Pietro Perona,et al.  The Fastest Pedestrian Detector in the West , 2010, BMVC.

[5]  Luc Van Gool,et al.  Coupled Object Detection and Tracking from Static Cameras and Moving Vehicles , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Wolfram Burgard,et al.  Using Boosted Features for the Detection of People in 2D Range Data , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[7]  Bastian Leibe,et al.  Real-Time Multi-Person Tracking with Time-Constrained Detection , 2011, BMVC.

[8]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[9]  Luc Van Gool,et al.  Online Multiperson Tracking-by-Detection from a Single, Uncalibrated Camera , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Horst-Michael Groß,et al.  MIRA - middleware for robotic applications , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Huosheng Hu,et al.  A Bank of Unscented Kalman Filters for Multimodal Human Perception with Mobile Service Robots , 2010, Int. J. Soc. Robotics.

[14]  David A. McAllester,et al.  Cascade object detection with deformable part models , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Roland Siegwart,et al.  A Layered Approach to People Detection in 3D Range Data , 2010, AAAI.

[16]  Rainer Stiefelhagen,et al.  Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics , 2008, EURASIP J. Image Video Process..

[17]  Luc Van Gool,et al.  Pedestrian detection at 100 frames per second , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Jianguo Zhang,et al.  The PASCAL Visual Object Classes Challenge , 2006 .

[19]  Andrew Zisserman,et al.  Progressive search space reduction for human pose estimation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Luc Van Gool,et al.  A mobile vision system for robust multi-person tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[22]  Grzegorz Cielniak,et al.  Improved data association and occlusion handling for vision-based people tracking by mobile robots , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Horst-Michael Groß,et al.  Further progress towards a home robot companion for people with mild cognitive impairment , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[24]  Pablo O. Arambel,et al.  Estimation under unknown correlation: covariance intersection revisited , 2002, IEEE Trans. Autom. Control..

[25]  Deva Ramanan,et al.  Efficiently Scaling up Crowdsourced Video Annotation , 2012, International Journal of Computer Vision.

[26]  Horst-Michael Groß,et al.  Playing hide and seek with a mobile companion robot , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.