Human position tracking for side by side walking mobile robot using foot positions

This work proposes a method for tracking human position from side way. The method takes streaming of depth images from a Microsoft Kinect sensor as its input. The sensor is set up at the height of a human and tilted downward to cover the human's feet. The system tracks the position of the feet and uses the position along with the feet's direction to compute the human position and heading. The underlying idea relies on the fact that depth sensor can easily identify floor plane and the assumption that feet are located just above the floor plane. The method finds its use on side-by-side walking mobile robot. Real world examples are presented showing that the method gives fairly accurate tracking performance.

[1]  Yoshinori Kobayashi,et al.  Robotic wheelchair based on observations of people using integrated sensors , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Shin'ichi Yuta,et al.  Fusion of double layered multiple laser range finders for people detection from a mobile robot , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[3]  Gaurav S. Sukhatme,et al.  People tracking and following with mobile robot using an omnidirectional camera and a laser , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[4]  Erwin Prassler,et al.  Motion coordination between a human and a mobile robot , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Reid G. Simmons,et al.  Natural person-following behavior for social robots , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[6]  J. L. Roux.  An Introduction to the Kalman Filter , 2003 .

[7]  Hiroshi Ishiguro,et al.  Laser tracking of human body motion using adaptive shape modeling , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Jenq-Neng Hwang,et al.  Real-Time 3D Human Pose Estimation from Monocular View with Applications to Event Detection and Video Gaming , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[9]  François Chaumette,et al.  Image moments: a general and useful set of features for visual servoing , 2004, IEEE Transactions on Robotics.

[10]  Kazuhiko Takahashi,et al.  Identification and tracking using laser and vision of people maneuvering in crowded environments , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[11]  Jan-Olof Eklundh,et al.  Detecting and tracking moving objects from a mobile platform using a laser range scanner , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[12]  Jong-Soo Choi,et al.  3D pose estimation for foot motion tracking from image sequences , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).

[13]  Wolfram Burgard,et al.  Tracking multiple moving targets with a mobile robot using particle filters and statistical data association , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[14]  Seong-Whan Lee,et al.  Reconstructing 3D Human Body Pose from Stereo Image Sequences Using Hierarchical Human Body Model Learning , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[15]  Ben J. A. Kröse,et al.  Jijo-2: An Office Robot that Communicates and Learns , 2001, IEEE Intell. Syst..

[16]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[17]  Huosheng Hu,et al.  Multisensor-Based Human Detection and Tracking for Mobile Service Robots , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Rachid Alami,et al.  Rackham: An Interactive Robot-Guide , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[19]  Takashi Tsubouchi,et al.  People Tracking Using a Robot in Motion with Laser Range Finder , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.