Tracking video objects with feature points based particle filtering

For intelligent video surveillance, the adaptive tracking of multiple moving objects is still an open issue. In this paper, a new multi-object tracking method based on video frames is proposed. A type of particle filtering combined with the SIFT (Scale Invariant Feature Transform) is proposed for motion tracking, where SIFT key points are treated as parts of particles to improve the sample distribution. Then, a queue chain method is adopted to record data associations among different objects, which could improve the detection accuracy and reduce the computational complexity. By actual road tests and comparisons, the system tracks multi-objects with better performance, e.g., real time implementation and robust against mutual occlusions, indicating that it is effective for intelligent video surveillance systems.

[1]  Dar-Shyang Lee,et al.  Effective Gaussian mixture learning for video background subtraction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Osama Masoud,et al.  Detection and classification of vehicles , 2002, IEEE Trans. Intell. Transp. Syst..

[3]  Zhao Zong-gui.  JPDA in Multisensor Multitarget Tracking , 2004 .

[4]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[5]  Patrick Pérez,et al.  Robust tracking with motion estimation and local Kernel-based color modeling , 2007, Image Vis. Comput..

[6]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[7]  Bart De Schutter,et al.  IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS Editor-In-Chief , 2005 .

[8]  Jun Cai,et al.  On Eliminating Static Shadow False Alarms in Automatic Incident Detection Systems , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[9]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  P. Pérez,et al.  Tracking multiple objects with particle filtering , 2002 .

[11]  L. Davis,et al.  Real-time multiple vehicle detection and tracking from a moving vehicle , 2000, Machine Vision and Applications.

[12]  Yingzi Du,et al.  Region-based SIFT approach to iris recognition , 2009 .

[13]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Fa-Sheng Wang,et al.  A New Particle Filter for Nonlinear Filtering Problems: A New Particle Filter for Nonlinear Filtering Problems , 2009 .

[15]  James J. Little,et al.  Robust Visual Tracking for Multiple Targets , 2006, ECCV.

[16]  Farzin Mokhtarian,et al.  Variational Particle Filter for Multi-Object Tracking , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[17]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[18]  Guan Ye-peng.  Automatic and Robust Shadow Segmentation from Two-Dimensional Scenes , 2006 .

[19]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[20]  Ingemar J. Cox,et al.  An Efficient Implementation of Reid's Multiple Hypothesis Tracking Algorithm and Its Evaluation for the Purpose of Visual Tracking , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Bang Jun Lei,et al.  Real-time outdoor video surveillance with robust foreground extraction and object tracking via multi-state transition management , 2006, Pattern Recognit. Lett..

[22]  Tzung-Pei Hong,et al.  Opportunities and Challenges for Next-Generation Applied Intelligence , 2009 .

[23]  Ming-Hsuan Yang,et al.  Adaptive Probabilistic Visual Tracking with Incremental Subspace Update , 2004, ECCV.

[24]  R. C. Harrell,et al.  A fruit-tracking system for robotic harvesting , 2005, Machine Vision and Applications.

[25]  Gao Tao,et al.  Redundant discrete wavelet transforms based moving object recognition and tracking , 2009 .

[26]  James J. Little,et al.  A Boosted Particle Filter: Multitarget Detection and Tracking , 2004, ECCV.

[27]  Luc Van Gool,et al.  Robust tracking-by-detection using a detector confidence particle filter , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[28]  Lingfu Kong,et al.  Particle filter tracking based on color and SIFT features , 2008, 2008 International Conference on Audio, Language and Image Processing.

[29]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  M. Kilger,et al.  A shadow handler in a video-based real-time traffic monitoring system , 1992, [1992] Proceedings IEEE Workshop on Applications of Computer Vision.

[31]  Wang Fa.  A New Particle Filter for Nonlinear Filtering Problems , 2008 .

[32]  Shihong Yue,et al.  Robust background subtraction in traffic video sequence , 2010 .

[33]  Wang Lu,et al.  IR TARGET TRACKING BASED ON IMPROVED MEAN SHIFT METHOD , 2007 .

[34]  Zhu Shan-an.  Real-time segmentation and tracking technique of multiple moving objects in video sequence , 2008 .

[35]  Xinhe Xu,et al.  Multiple Vehicle Visual Tracking from a Moving Vehicle , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[36]  Ian D. Reid,et al.  Unconstrained Multiple-People Tracking , 2006, DAGM-Symposium.

[37]  Ray Williams,et al.  Application of the Particle Filter to Tracking of Fish in Aquaculture Research , 2008, 2008 Digital Image Computing: Techniques and Applications.

[38]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[39]  Hans-Hellmut Nagel,et al.  A Framework for Model-Based Tracking Experiments in Image Sequences , 2007, International Journal of Computer Vision.

[40]  Dorin Comaniciu,et al.  Mean shift and optimal prediction for efficient object tracking , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[41]  Liu Yu-shu.  Improved Mean-Shift Object Tracking Method , 2008 .

[42]  S. Fazli,et al.  Particle Filter Based Object Tracking with Sift and Color Feature , 2009, 2009 Second International Conference on Machine Vision.

[43]  Hedvig Sidenbladh,et al.  Multi-target particle filtering for the probability hypothesis density , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[44]  Yang Jun,et al.  Shadow processing method based on normalized RGB color model , 2007 .

[45]  Hans-Hellmut Nagel,et al.  Initialization of Model-Based Vehicle Tracking in Video Sequences of Inner-City Intersections , 2007, International Journal of Computer Vision.

[46]  Jun Zhang,et al.  Feature Particles Tracking for the Moving Object , 2009 .