Multiple object tracking with partial occlusion handling using salient feature points

Abstract Handling occlusion has been a challenging task in object tracking. In this paper, we propose a multiple object tracking method in the presence of partial occlusion using salient feature points. We first extract the prominent feature points from each target object, and then use a particle filter-based approach to track the feature points in image sequences based on various attributes such as location, velocity and other descriptors. We then detect and revise the feature points that have been tracked incorrectly. The main idea is that, even if some feature points are not successfully tracked due to occlusion or poor imaging condition, the other correctly tracked features can collectively perform the corrections on their behalf. Finally, we track the objects using the correctly tracked feature points through a Hough-like approach, and the object bounding boxes are updated using the relative locations of these feature points. Experimental results demonstrate that our method is proficient in providing accurate human tracking as well as appropriate occlusion handling, compared to the existing methods.

[1]  R. Dinesh,et al.  Non-parametric adaptive region of support useful for corner detection: a novel approach , 2004, Pattern Recognit..

[2]  Jesse S. Jin,et al.  Mean shift object tracking for a SIMD computer , 2005, Third International Conference on Information Technology and Applications (ICITA'05).

[3]  D. Zhang,et al.  Robust mean-shift tracking with corrected background-weighted histogram , 2012 .

[4]  Mignon Park,et al.  Object tracking from image sequences using adaptive models in fuzzy particle filter , 2013, Inf. Sci..

[5]  Juan José Pantrigo,et al.  High performance memetic algorithm particle filter for multiple object tracking on modern GPUs , 2012, Soft Comput..

[6]  James J. Little,et al.  A Boosted Particle Filter: Multitarget Detection and Tracking , 2004, ECCV.

[7]  Yi-Ping Hung,et al.  Adaptive Learning for Target Tracking and True Linking Discovering Across Multiple Non-Overlapping Cameras , 2011, IEEE Transactions on Multimedia.

[8]  Ian D. Reid,et al.  Unconstrained Multiple-People Tracking , 2006, DAGM-Symposium.

[9]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[11]  Amar Mitiche,et al.  A real-time system for high-level video representation: application to video surveillance , 2003, IS&T/SPIE Electronic Imaging.

[12]  A. M. Tekalp,et al.  Multiple camera tracking of interacting and occluded human motion , 2001, Proc. IEEE.

[13]  David Beymer,et al.  Real-Time Tracking of Multiple People Using Continuous Detection , 1999 .

[14]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[15]  Nelson H. C. Yung,et al.  Corner detector based on global and local curvature properties , 2008 .

[16]  Rashid Ansari,et al.  Kernel particle filter for visual tracking , 2005, IEEE Signal Processing Letters.

[17]  Jang-Ping Sheu,et al.  Target tracking and boundary node selection algorithms of wireless sensor networks for internet services , 2013, Inf. Sci..

[18]  Ramakant Nevatia,et al.  Segmentation and Tracking of Multiple Humans in Crowded Environments , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Grantham Pang,et al.  People Counting and Human Detection in a Challenging Situation , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[20]  Rui Yu,et al.  A New Hybrid Synthetic Aperture Imaging Model for Tracking and Seeing People Through Occlusion , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Larry S. Davis,et al.  Fast multiple object tracking via a hierarchical particle filter , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[22]  F. Dellaert,et al.  A Rao-Blackwellized particle filter for EigenTracking , 2004, CVPR 2004.

[23]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[24]  Yuanqing Xia,et al.  A new continuous-discrete particle filter for continuous-discrete nonlinear systems , 2013, Inf. Sci..

[25]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[26]  Ling Shao,et al.  Recent advances and trends in visual tracking: A review , 2011, Neurocomputing.

[27]  Fuchun Sun,et al.  Efficient visual tracking using particle filter with incremental likelihood calculation , 2012, Information Sciences.

[28]  Jian Cheng,et al.  Human tracking in the complicated background by Particle Filter using color-histogram and HOG , 2010, 2010 International Symposium on Intelligent Signal Processing and Communication Systems.

[29]  Luc Van Gool,et al.  Online Multiperson Tracking-by-Detection from a Single, Uncalibrated Camera , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Wei Wang,et al.  A multiple object tracking method using Kalman filter , 2010, The 2010 IEEE International Conference on Information and Automation.

[32]  F. D. Garber,et al.  The Quality of Training Sample Estimates of the Bhattacharyya Coefficient , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  James J. Little,et al.  Robust Visual Tracking for Multiple Targets , 2006, ECCV.

[34]  Ling Shao,et al.  Content-based retrieval of human actions from realistic video databases , 2013, Inf. Sci..

[35]  M. Sohail Khalid KULLBACK-LEIBER DIVERGENCE MEASURE IN CORRELATION OF GRAY-SCALE OBJECTS , 2005 .

[36]  Xi Chen,et al.  Tracking a moving object via a sensor network with a partial information broadcasting scheme , 2011, Inf. Sci..

[37]  Chirala Satyanarayana,et al.  Visual Object Target Tracking Using Particle Filter : A Survey , 2013 .

[38]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..