The Moving Target Recognition and Tracking Using RGB-D Data with the Mobile Robot

This paper investigated the problem of moving target recognition and tracking in unknown environments for autonomous mobile robots. The mobile robot is equipped with the Kinect sensor to acquire the appearance and depth information of the environment for target recognition and motion control. As for the visual target recognition, the depth feature is fused with the color feature on the basis of the Kernel Correlation Filtering algorithm (KCF), and the Kalman filtering algorithm based on the target motion state is integrated with the KCF, to cope with such situations as the target occlusion in tracking process. The movement of the robot can be controlled according to the results of visual target recognition and the standard of keeping the target in the central area of the mobile robot’s vision. Finally, controlling the mobile robot to track the moving target is realized. The experimental results on Kobuki robot platform prove the effectiveness of the presented method.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[3]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[4]  Hatice Gunes,et al.  Tracking People in Crowds by a Part Matching Approach , 2008, 2008 IEEE Fifth International Conference on Advanced Video and Signal Based Surveillance.

[5]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Sharath Pankanti,et al.  Appearance models for occlusion handling , 2006, Image Vis. Comput..

[7]  Qi Wang,et al.  Multi-cue based tracking , 2014, Neurocomputing.

[8]  Rui Caseiro,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence High-speed Tracking with Kernelized Correlation Filters , 2022 .

[9]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[10]  Jianxiong Xiao,et al.  Tracking Revisited Using RGBD Camera: Unified Benchmark and Baselines , 2013, 2013 IEEE International Conference on Computer Vision.

[11]  Jin Zhang,et al.  Robust Human Tracking Algorithm Applied for Occlusion Handling , 2010, 2010 Fifth International Conference on Frontier of Computer Science and Technology.

[12]  Maurice K. Wong,et al.  Algorithm AS136: A k-means clustering algorithm. , 1979 .

[13]  Bruce A. Draper,et al.  Visual object tracking using adaptive correlation filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Shao-Yi Chien,et al.  Fast image segmentation based on K-Means clustering with histograms in HSV color space , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.