Human tracking based on vision and laser sensor

In order to solve the problem of human tracking, we present a real-time person tracking system for a mobile robot based on the fusion of monocular camera and laser sensor. Firstly, the mark model constructed to detect the target by the combination of color and geometric features is developed, and the robot obtains the coordinates of the target by using the principle of monocular distance measurement. Then, a method is proposed to detect the human leg by using the method of geometric feature detection based on self-adapting threshold segmentation of laser information. Finally, the weighted fusion strategy is used to fuse the results of laser and monocular vision to determine the target person, and a Kalman filter is used to obtain the stable trajectory. Experimental results performed in indoor environments show the effectiveness and robustness of the developed approach.

[1]  Woojin Chung,et al.  Human tracking of a mobile robot with an onboard LRF (Laser Range Finder) using human walking motion analysis , 2011, 2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[2]  R.C. Luo,et al.  Face Detection and Tracking for Human Robot Interaction through Service Robot , 2007, IECON 2007 - 33rd Annual Conference of the IEEE Industrial Electronics Society.

[3]  Christian Schlegel,et al.  Vision Based Person Tracking with a Mobile Robot , 1998, BMVC.

[4]  Ryosuke Shibasaki,et al.  A novel system for tracking pedestrians using multiple single-row laser-range scanners , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[5]  Peter Xiaoping Liu,et al.  Robot tracking using vision and laser sensors , 2008, 2008 IEEE International Conference on Automation Science and Engineering.

[6]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[7]  Minh-Quoc Do,et al.  Embedded human-following mobile-robot with an RGB-D camera , 2015, 2015 14th IAPR International Conference on Machine Vision Applications (MVA).

[8]  Pupil and Glint Detection Using Wearable Camera Sensor and Near-Infrared LED Array , 2015, Sensors.

[9]  Alireza Ahmadi,et al.  Skeleton and visual tracking fusion for human following task of service robots , 2015, 2015 3rd RSI International Conference on Robotics and Mechatronics (ICROM).

[10]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Sebastian Lang,et al.  Multi-modal anchoring for human-robot interaction , 2003, Robotics Auton. Syst..

[12]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[13]  Ankur Agarwal,et al.  Recovering 3D human pose from monocular images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.