A Closed-loop Background Subtraction Approach for Multiple Models based Multiple Objects Tracking

Normally visual surveillance systems are basedon background subtraction to detect foreground objects andthen conduct multiple objects tracking with data associationand tracking filters in an open-loop procedure. Differentfrom the state-of-the-art approaches, this paper discusses aclosed-loop object detection and tracking method. In ourproposed method, each pixel is first modeled with an adaptiveGaussian Mixture Models (GMMs). Second, foregroundmoving objects are tracked by Multiple Hypotheses Trackers(MHT) together with an adaptive Interacting MultipleModels (IMM) method. With the IMM approach, object’sdynamic properties can be better modeled to get more accuratedynamic tracking results. Third, our proposed closedloopapproach uses the object tracking results to adjust theGMMs’ parameters to extract foreground object pixels moreaccurately. With this closed-loop approach, the accuracy ofboth object detection and tracking are improved withoutincreasing computational costs. The proposed new algorithmis tested with extensive experimental videos collected fromdifferent scenarios such as urban streets, intersections, andhighways. Experimental results demonstrated the efficiencyand robustness of our proposed algorithm in handling objectdetection and tracking in real-time.

[1]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[2]  Amir Averbuch,et al.  Interacting Multiple Model Methods in Target Tracking: A Survey , 1988 .

[3]  Jacques Verly,et al.  The State of the Art in Multiple Object Tracking Under Occlusion in Video Sequences , 2003 .

[4]  James Ferryman,et al.  Proceedings of the thirteenth IEEE International Workshop on Performance Evaluation of Tracking and Surveillance , 2009 .

[5]  Wei Hua,et al.  Confidence-Based Color Modeling for Online Video Segmentation , 2009, ACCV.

[6]  S.S. Blackman,et al.  Multiple hypothesis tracking for multiple target tracking , 2004, IEEE Aerospace and Electronic Systems Magazine.

[7]  Ramakant Nevatia,et al.  Tracking multiple humans in complex situations , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  I. Haritaoglu,et al.  Background and foreground modeling using nonparametric kernel density estimation for visual surveillance , 2002 .

[9]  Mansour Jamzad,et al.  Real time classification and tracking of multiple vehicles in highways , 2005, Pattern Recognit. Lett..

[10]  Peter H. Tu,et al.  Simultaneous estimation of segmentation and shape , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Jan-Olof Eklundh,et al.  Statistical background subtraction for a mobile observer , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  Mubarak Shah,et al.  Automatically Tuning Background Subtraction Parameters using Particle Swarm Optimization , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[13]  Quan Pan,et al.  Real-time multiple objects tracking with occlusion handling in dynamic scenes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Harry Shum,et al.  Background Cut , 2006, ECCV.

[15]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[16]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..