Unsupervised Tracking from Clustered Graph Patterns

This paper shows how data mining and in particular graph mining and clustering can help to tackle difficult tracking problems such as tracking possibly multiple objects in a video with a moving camera and without any contextual information on the objects to track. Starting from different segmentations of the video frames (dynamic and non dynamic ones), we extract frequent sub graph patterns to create spatio-temporal patterns that may correspond to interesting objects to track. We then cluster the obtained spatio-temporal patterns to get longer and more robust tracks along the video. We compare our tracking method called TRAP to two state-of-the-art tracking ones and show on four synthetic and real videos that our method is effective in this difficult context.

[1]  Michael R. Anderberg,et al.  Cluster Analysis for Applications , 1973 .

[2]  Joan Serrat,et al.  Night-time Outdoor Surveillance with Mobile Cameras , 2012, ICPRAM.

[3]  Philippe C. Cattin,et al.  Tracking the invisible: Learning where the object might be , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  ZuWhan Kim Real time object tracking based on dynamic feature grouping with background subtraction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Emmanuel Marilly,et al.  Graph Mining for Object Tracking in Videos , 2012, ECML/PKDD.

[6]  Gérard G. Medioni,et al.  Context tracker: Exploring supporters and distracters in unconstrained environments , 2011, CVPR 2011.

[7]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[8]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Z. M. Hefed Object tracking , 1999 .

[10]  Xin Yang,et al.  Multi-object detection and tracking by stereo vision , 2010, Pattern Recognit..

[11]  Gérard G. Medioni,et al.  Multiple-Target Tracking by Spatiotemporal Monte Carlo Markov Chain Data Association , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[13]  Mei Han,et al.  Efficient hierarchical graph-based video segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Ruey-Feng Chang,et al.  Region-based image retrieval using edgeflow segmentation and region adjacency graph , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[15]  Lei Zhang,et al.  Real-Time Compressive Tracking , 2012, ECCV.

[16]  Robert T. Collins,et al.  Multitarget data association with higher-order motion models , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Carlo Tomasi,et al.  Branch and track , 2011, CVPR 2011.

[18]  Jiri Matas,et al.  P-N learning: Bootstrapping binary classifiers by structural constraints , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Stan Z. Li,et al.  Structured Visual Tracking with Dynamic Graph , 2012, ACCV.

[20]  Gang Hua,et al.  Context-Aware Visual Tracking , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.