Role of Spatiotemporal Oriented Energy Features for Robust Visual Tracking in Video Surveillance

We propose an effective approach to take advantage of the rich description provided by Spatiotemporal Oriented Energy features for the purpose of robust tracking. There are two core components in our system. The first one is a compound measure of 'Coherent Motion' and 'Identity Motion Signature' which is introduced based on motion dynamics of the targets. This measure is used for robust optimisation in occluded situations as well as an adaptive template updating scheme. The second component is a state machine which detects various states of the targets based on statistical analysis of their 'Motion Signature'. Empirical evaluations demonstrate improvement in performance of the tracking system along with the role of each component.

[1]  Richard P. Wildes,et al.  Visual Tracking Using a Pixelwise Spatiotemporal Oriented Energy Representation , 2010, ECCV.

[2]  Richard P. Wildes,et al.  Spatiotemporal Oriented Energy Features for Visual Tracking , 2007, ACCV.

[3]  Richard P. Wildes,et al.  Classification of traffic video based on a spatiotemporal orientation analysis , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[4]  David J. Heeger,et al.  Optical flow using spatiotemporal filters , 2004, International Journal of Computer Vision.

[5]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[6]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[7]  Richard P. Wildes.  A measure of motion salience for surveillance applications , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[8]  Rainer Herpers,et al.  Unified Target Detection and Tracking Using Motion Coherence , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[9]  Richard P. Wildes,et al.  Efficient action spotting based on a spacetime oriented structure representation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Ehud Rivlin,et al.  Classification of Moving Targets Based on Motion and Appearance , 2003, BMVC.

[11]  Eero P. Simoncelli.  Distributed representation and analysis of visual motion , 1993 .

[12]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Richard P. Wildes,et al.  Qualitative Spatiotemporal Analysis Using an Oriented Energy Representation , 2000, ECCV.

[14]  Richard P. Wildes,et al.  Early spatiotemporal grouping with a distributed oriented energy representation , 2009, CVPR.

[15]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..