Human tracking system based on adaptive multi-feature mean-shift for robot under the double-layer locating mechanism

Human tracking has been a challenging task for robot in the past decades. In this paper, to realize the human following in a cluttered environment, a human tracking system based on adaptive multi-feature mean-shift (AMF-MS) under the double-layer locating mechanism (DLLM) is proposed to solve the problem of distinguishing target, occlusion, and quick turning. The DLLM, considering the course location processing and fine location processing, is designed to estimate the person’s position using the fusion of heterogeneous data. As an ID tag attached on target can be detected by RF antennas, the course locating method can track the target easily and quickly. The Bayes rule is introduced to calculate the probability where the tag exists due to the instability of RF signals. In the fine locating step, the AMF-MS is proposed because it can reduce computational load and represent target by multi-feature histogram function. Meanwhile, we combine extended Kalman filter and AMF-MS to overcome MS’s inability of occlusion. To control the robot following the target person precisely, an intelligent gear shift strategy based on fuzzy control is implemented by analyzing the robot structure. Experiments demonstrate that the proposed approach is robust to handle complex tracking conditions, and show the system has an optimum performance. Graphical Abstract

[1]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  V. Caron,et al.  United states. , 2018, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[4]  Amir Hooshang Mazinan,et al.  Applying mean shift, motion information and Kalman filtering approaches to object tracking. , 2012, ISA transactions.

[5]  Anamitra Makur,et al.  Online adaptive radial basis function networks for robust object tracking , 2010, Comput. Vis. Image Underst..

[6]  Mustapha Hamerlain,et al.  Multi-Sensor-Based Control Strategy for Initiating and Maintaining Interaction Between a Robot and a Human , 2011, Adv. Robotics.

[7]  Roberto Cipolla,et al.  Stereoscopic tracking of bodies in motion , 1990, Image Vis. Comput..

[8]  Guijin Wang,et al.  A compact association of particle filtering and kernel based object tracking , 2012, Pattern Recognit..

[9]  D.V. Thombre,et al.  Human detection and tracking using image segmentation and Kalman filter , 2009, 2009 International Conference on Intelligent Agent & Multi-Agent Systems.

[10]  Gian Luca Marcialis,et al.  Fusion of Radio and Video Localization for People Tracking , 2011, AmI.

[11]  Shuang Wang,et al.  Robust human detecting and tracking using varying scale template matching , 2012, 2012 IEEE International Conference on Information and Automation.

[12]  Bohyung Han,et al.  Incremental density approximation and kernel-based Bayesian filtering for object tracking , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[13]  Huosheng Hu,et al.  Vision and Laser Data Fusion for Tracking People with a Mobile Robot , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[14]  Jun Miura,et al.  Stereo-Based Multi-person Tracking Using Overlapping Silhouette Templates , 2010, 2010 20th International Conference on Pattern Recognition.

[15]  Yuan Li,et al.  High-Performance Rotation Invariant Multiview Face Detection , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Songmin Jia,et al.  Robot Localization in Indoor Environments Using Radio Frequency Identification Technology and Stereo Vision , 2008, Adv. Robotics.

[17]  Ryosuke Shibasaki,et al.  Multi-modal tracking of people using laser scanners and video camera , 2008, Image Vis. Comput..

[18]  Hani Hagras,et al.  A Fuzzy Logic-Based System for Indoor Localization Using WiFi in Ambient Intelligent Environments , 2013, IEEE Transactions on Fuzzy Systems.

[19]  Tomomasa Sato,et al.  Multiple people tracking by integrating distributed floor pressure sensors and RFID system , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[20]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[21]  Satoshi Takahashi,et al.  A ZigBee-based sensor node for tracking people's locations , 2008, CASEMANS '08.