Object tracking by mean shift and radial basis function neural networks

In this paper, a tracker based on mean shift and radial basis function neural networks called MS-RBF is addressed. As its name implies, two independent trackers have been combined and linked together. The mean shift algorithm estimates the target’s location within only two iterations. The scale and orientation of target are computed by exploiting 2-D correlation coefficient between reference and target candidate histograms instead of using Bhattacharyya coefficient. A code optimization strategy, named multiply–add–accumulate (MAC), is proposed to remove useless memory occupation and programmatic operations. MAC implementation has reduced computational load and made overall tracking process faster. The second tracker “RBFNN” has an input feature vector that contains variables such as local contrast, color histogram, gradient, intensity, and spatial frequency. The neural network learns the color and texture features from the target and background. Then, this information is used to detect and track the object in other frames. The neural network employs Epanechnikov activation functions. The features extracted in any frame are clustered by Fuzzy C-Means clustering which produces the means and variances of the clusters. The experimental results show that the proposed tracker can resist to different types of occlusions, sudden movement, and shape deformations.

[1]  D. Zhang,et al.  Robust mean-shift tracking with corrected background-weighted histogram , 2012 .

[2]  Antonio García,et al.  Quantization analysis and enhancement of a VLSI gradient-based motion estimation architecture , 2012, Digit. Signal Process..

[3]  Vinayak S. Naik,et al.  A line in the sand: a wireless sensor network for target detection, classification, and tracking , 2004, Comput. Networks.

[4]  D. Zhang,et al.  Scale and orientation adaptive mean shift tracking , 2012 .

[5]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[6]  Anke Meyer-Bäse,et al.  Stochastic stability analysis of competitive neural networks with different time-scales , 2013, Neurocomputing.

[7]  Robert W. Brodersen,et al.  Floating-point to fixed-point conversion with decision errors due to quantization , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[8]  Vahid Rowghanian,et al.  Non iterated mean shift and particle filtering , 2014, 2014 22nd Iranian Conference on Electrical Engineering (ICEE).

[9]  Keith Jack,et al.  Video Demystified: A Handbook for the Digital Engineer , 1993 .

[10]  Irene Y. H. Gu,et al.  Robust Visual Object Tracking Using Multi-Mode Anisotropic Mean Shift and Particle Filters , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Zhou Bin,et al.  Algorithm of target tracking based on mean shift with RBF neural network , 2008, 2008 27th Chinese Control Conference.

[12]  Anamitra Makur,et al.  Online adaptive radial basis function networks for robust object tracking , 2010, Comput. Vis. Image Underst..

[13]  B. Kröse,et al.  An EM-like algorithm for color-histogram-based object tracking , 2004, CVPR 2004.

[14]  Guang-Zhong Yang,et al.  Three-Dimensional Tissue Deformation Recovery and Tracking , 2010, IEEE Signal Processing Magazine.

[15]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  T. Kailath The Divergence and Bhattacharyya Distance Measures in Signal Selection , 1967 .

[17]  Tieniu Tan,et al.  Real-time hand tracking using a mean shift embedded particle filter , 2007, Pattern Recognit..

[18]  Tieniu Tan,et al.  Real time hand tracking by combining particle filtering and mean shift , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[19]  Lei Zhang,et al.  Real-Time Compressive Tracking , 2012, ECCV.

[20]  Toshihiro Nishimura,et al.  US image improvement using fuzzy Neural Network with Epanechnikov kernel , 2009, 2009 35th Annual Conference of IEEE Industrial Electronics.

[21]  Alireza Asvadi,et al.  Efficient Object Tracking Using Optimized K-means Segmentation and Radial Basis Function Neural Netw , 2011 .

[22]  Chee Kheong Siew,et al.  Extreme learning machine: RBF network case , 2004, ICARCV 2004 8th Control, Automation, Robotics and Vision Conference, 2004..

[23]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  H. JoséAntonioMartín,et al.  FPGA-Based Multimodal Embedded Sensor System Integrating Low- and Mid-Level Vision , 2011, Sensors.

[25]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[26]  Andrei Stan,et al.  Floating-point to fixed-point code conversion with variable trade-off between computational complexity and accuracy loss , 2011, 15th International Conference on System Theory, Control and Computing.

[27]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[28]  Michael J. Black,et al.  EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation , 1996, International Journal of Computer Vision.

[29]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[30]  Miguel Á. Carreira-Perpiñán,et al.  Gaussian Mean-Shift Is an EM Algorithm , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Xin Li,et al.  Contour-based object tracking with occlusion handling in video acquired using mobile cameras , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Zezhi Chen,et al.  Video Object Tracking Based on a Chamfer Distance Transform , 2007, 2007 IEEE International Conference on Image Processing.

[33]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[34]  Sergio A. Velastin,et al.  Automated measurement of crowd density and motion using image processing , 1994 .

[35]  Hongbo Zhu,et al.  A Directional-Edge-Based Real-Time Object Tracking System Employing Multiple Candidate-Location Generation , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  R. Venkatesh Babu,et al.  Robust tracking with interest points: A sparse representation approach , 2015, Image Vis. Comput..