Person Following Using Histograms of Oriented Gradients

In order for robots to effectively interact with people in close proximity, the systems must first be able to detect, track, and follow people. This paper describes results from the development of a mobile robot which will follow a single, unmarked pedestrian using vision. This work demonstrates an improvement over existing pedestrian following applications because (1) it uses sufficiently strong classifiers such that it does not need to adapt to any particular pedestrian, (2) uses only vision and does not rely on any laser range devices, (3) provides a single point benchmark for the level of performance required from a detector to achieve pedestrian following, and (4) its performance is characterized over several kilometers in both rainy and dry weather conditions. The system leverages Histograms of Oriented Gradients (HOG) features for pedestrian detection at over 8 Hz using video from a monochrome camera. The pedestrian’s heading is combined with distance from stereo depth data to yield a 3D estimate. A particle filter with some clutter rejection provides a continuous track, and a waypoint follow behavior servos the iRobot PackBot robot chassis to a desired location behind the pedestrian. The final system is able to detect, track, and follow a pedestrian over several kilometers in outdoor environments, demonstrating a level of performance not previously shown on a small unmanned ground vehicle.

[1]  Robert E. Schapire,et al.  The Boosting Approach to Machine Learning An Overview , 2003 .

[2]  J. Miura,et al.  Robust Stereo-Based Person Detection and Tracking for a Person Following Robot , 2009 .

[3]  Mahmoud Tarokh,et al.  Vision Based Person Tracking and Following in Unstructured Environments , 2008 .

[4]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Hiroshi Mizoguchi,et al.  Development of a Person Following Robot with Vision Based Target Detection , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Jean J. Saade,et al.  Fuzzy Inference-Based Person-Following Robot , 2008 .

[7]  Navneet Dalal,et al.  Finding People in Images and Videos , 2006 .

[8]  Christian Schlegel,et al.  Vision Based Person Tracking with a Mobile Robot , 1998, BMVC.

[9]  Alexander Carballo,et al.  Multiple People Detection from a Mobile Robot using Double Layered Laser Range Finders , 2009 .

[10]  Wolfram Burgard,et al.  Multi-model Hypothesis Group Tracking and Group Size Estimation , 2010, Int. J. Soc. Robotics.

[11]  Hiroshi Mizoguchi,et al.  Person Following Robot ApriAttenda , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Josephine Sullivan,et al.  Multi-target Tracking on a Large Scale: Experiences from Football Player Tracking , 2009 .

[13]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[14]  M. Kleinehagenbrock,et al.  Person tracking with a mobile robot based on multi-modal anchoring , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[15]  Roger D. Boyle,et al.  Performance Evaluation Metrics and Statistics for Positional Tracker Evaluation , 2003, ICVS.

[16]  Luc Van Gool,et al.  A mobile vision system for robust multi-person tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Jouko Lampinen,et al.  Rao-Blackwellized particle filter for multiple target tracking , 2007, Inf. Fusion.

[18]  Sonia Chernova,et al.  Mobile human-robot teaming with environmental tolerance , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[19]  Henrik I. Christensen,et al.  Tracking for following and passing persons , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  M.R. Civanlar,et al.  End-To-End Stereoscopic Video Streaming System , 2006, 2006 IEEE 14th Signal Processing and Communications Applications.

[21]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[22]  Avinash C. Kak,et al.  Person Tracking with a Mobile Robot using Two Uncalibrated Independently Moving Cameras , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[23]  Reid G. Simmons,et al.  Natural person-following behavior for social robots , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).