Discovering hot topics from geo-tagged video

As video data generated by users boom continuously, making sense of large scale data archives is considered as a critical challenge for data management. Most existing learning techniques that extract signal-level contents from video data struggle to scale due to efficiency limits. With the development of pervasive positioning techniques, discovering hot topics from multimedia data by their geographical tags has become practical: videos taken by advanced cameras are associated with GPS locations, and geo-tagged videos from YouTube can be identified by their associated GPS locations on Google Maps. It enables us to know the cultures, scenes, and human behaviors from videos based on their spatio-temporal distributions. However, meaningful topic discovery requires an efficient clustering approach, through which coherent topics can be detected according to particular geographical regions without out-of-focus effects. To handle this problem, this paper presents a filter-refinement framework to discover hot topics corresponding to geographical dense regions, and then introduces two novel metrics to refine unbounded hot regions, together with a heuristic method for setting rational thresholds on these metrics. The results of extensive experiments prove that hot topics can be efficiently discovered by our framework, and more compact topics can be achieved after using the novel metrics.

[1]  Dieter Pfoser,et al.  Capturing the Uncertainty of Moving-Object Representations , 1999, SSD.

[2]  Jiawei Han,et al.  Geographical topic discovery and comparison , 2011, WWW.

[3]  Jianhong Wu,et al.  Data clustering - theory, algorithms, and applications , 2007 .

[4]  Mubarak Shah,et al.  Tracking news stories across different sources , 2005, MULTIMEDIA '05.

[5]  George Kollios,et al.  Mining, indexing, and querying historical spatiotemporal data , 2004, KDD.

[6]  Guojun Gan,et al.  Data Clustering: Theory, Algorithms, and Applications (ASA-SIAM Series on Statistics and Applied Probability) , 2007 .

[7]  Marcel Worring,et al.  Multimodal Video Indexing : A Review of the State-ofthe-art , 2001 .

[8]  Xiu- li Zhao,et al.  Mining spatio-temporal association rules in bus IC card databases , 2009, 2009 2nd International Conference on Power Electronics and Intelligent Transportation System (PEITS).

[9]  Yueting Zhuang,et al.  Topic discovery of web video using star-structured K-partite graph , 2010, ACM Multimedia.

[10]  Yue Gao,et al.  W2Go: a travel guidance system by automatic landmark ranking , 2010, ACM Multimedia.

[11]  Sari Haj Hussein Effective Density Queries on Continuously Moving Objects; in Slides , 2012 .

[12]  Christian S. Jensen,et al.  Discovery of convoys in trajectory databases , 2008, Proc. VLDB Endow..

[13]  Meng Hu,et al.  TrajPattern: Mining Sequential Patterns from Imprecise Trajectories of Mobile Objects , 2006, EDBT.

[14]  Hongyang Chao,et al.  Annotating and navigating tourist videos , 2010, GIS '10.

[15]  Yi Yang,et al.  Image Clustering Using Local Discriminant Models and Global Integration , 2010, IEEE Transactions on Image Processing.

[16]  G M SnoekCees,et al.  Multimodal Video Indexing , 2005 .

[17]  Dino Pedreschi,et al.  Trajectory pattern mining , 2007, KDD '07.

[18]  Alberto Messina,et al.  Parallel neural networks for multimodal video genre classification , 2008, Multimedia Tools and Applications.

[19]  Lifeng Sun,et al.  Web video topic discovery and tracking via bipartite graph reinforcement model , 2008, WWW.

[20]  Sanjay Chawla,et al.  Mining Spatio-temporal Association Rules, Sources, Sinks, Stationary Regions and Thoroughfares in Object Mobility Databases , 2006, DASFAA.

[21]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Roger Zimmermann,et al.  Viewable scene modeling for geospatial video search , 2008, ACM Multimedia.

[23]  Shankar Kumar,et al.  Video suggestion and discovery for youtube: taking random walks through the view graph , 2008, WWW.

[24]  Dimitrios Gunopulos,et al.  On-Line Discovery of Dense Areas in Spatio-temporal Databases , 2003, SSTD.

[25]  Marc Gelgon,et al.  Building and tracking hierarchical geographical & temporal partitions for image collection management on mobile devices , 2005, MULTIMEDIA '05.

[26]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[27]  Qi Tian,et al.  Mining flickr landmarks by modeling reconstruction sparsity , 2011, TOMCCAP.

[28]  Michael G. Christel,et al.  Interactive maps for a digital video library , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[29]  R. Suganya,et al.  Data Mining Concepts and Techniques , 2010 .

[30]  Chong-Wah Ngo,et al.  Hot Event Detection and Summarization by Graph Modeling and Matching , 2005, CIVR.

[31]  Qing Liu,et al.  A Hybrid Prediction Model for Moving Objects , 2008, 2008 IEEE 24th International Conference on Data Engineering.

[32]  Rongrong Ji,et al.  Nonnegative Spectral Clustering with Discriminative Regularization , 2011, AAAI.

[33]  Changhu Wang,et al.  Photo2Trip: generating travel routes from geo-tagged photos for trip planning , 2010, ACM Multimedia.

[34]  Xiaofang Zhou,et al.  MOIR/MT: Monitoring Large-Scale Road Network Traffic in Real-Time , 2009, Proc. VLDB Endow..