GeoUGV: user-generated mobile video dataset with fine granularity spatial metadata

When analyzing and processing videos, it has become increasingly important in many applications to also consider contextual information, in addition to the content. With the ubiquity of sensor-rich smartphones, acquiring a continuous stream of geo-spatial metadata that includes the location and orientation of a camera together with the video frames has become practical. However, no such detailed dataset is publicly available. In this paper we present an extensive geo-tagged video dataset named GeoUGV that has been collected as part of the MediaQ [3] and GeoVid [1] projects. The key features of the dataset are that each video file is accompanied by a metadata sequence of geo-tags consisting of GPS locations, compass directions, and spatial keywords at fine-grained intervals. The GeoUGV dataset has been collected by volunteer users and its statistics can be summarized as follows: 2,397 videos containing 208,976 video frames that are geo-tagged, collected by 289 users in more than 20 cities across the world over a period of 10 years (2007-2016). We hope that this dataset will be useful for researchers, scientists and practitioners alike in their work.

[1]  Cyrus Shahabi,et al.  Incorporating Geo-Tagged Mobile Videos into Context-Aware Augmented Reality Applications , 2016, 2016 IEEE Second International Conference on Multimedia Big Data (BigMM).

[2]  Cyrus Shahabi,et al.  Gift: A geospatial image and video filtering tool for computer vision applications with geo-tagged mobile videos , 2015, 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[3]  He Ma,et al.  Large-scale geo-tagged video indexing and queries , 2014, GeoInformatica.

[4]  Roger Zimmermann,et al.  On Generating Content-Oriented Geo Features for Sensor-Rich Outdoor Video Search , 2015, IEEE Transactions on Multimedia.

[5]  Xian-Sheng Hua,et al.  Bayesian video search reranking , 2008, ACM Multimedia.

[6]  Cyrus Shahabi,et al.  Key Frame Selection Algorithms for Automatic Generation of Panoramic Images from Crowdsourced Geo-tagged Videos , 2014, W2GIS.

[7]  Huizhong Chen,et al.  The stanford mobile visual search data set , 2011, MMSys.

[8]  Cyrus Shahabi,et al.  An arc orienteering algorithm to find the most scenic path on a large-scale road network , 2015, SIGSPATIAL/GIS.

[9]  Cyrus Shahabi,et al.  An efficient index structure for large-scale geo-tagged video databases , 2014, SIGSPATIAL/GIS.

[10]  Xuelong Li,et al.  Visual-Textual Joint Relevance Learning for Tag-Based Social Image Search , 2013, IEEE Transactions on Image Processing.

[11]  Roger Zimmermann,et al.  Viewable scene modeling for geospatial video search , 2008, ACM Multimedia.

[12]  Tao Mei,et al.  Correlative multi-label video annotation , 2007, ACM Multimedia.

[13]  Roger Zimmermann,et al.  Generating synthetic meta-data for georeferenced video management , 2010, GIS '10.

[14]  Deyu Meng,et al.  Bridging the Ultimate Semantic Gap: A Semantic Search Engine for Internet Videos , 2015, ICMR.

[15]  Cyrus Shahabi,et al.  MediaQ: mobile multimedia management system , 2014, MMSys '14.

[16]  Mubarak Shah,et al.  Image Geo-Localization Based on MultipleNearest Neighbor Feature Matching UsingGeneralized Graphs , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Roger Zimmermann,et al.  Automatic tag generation and ranking for sensor-rich outdoor videos , 2011, MM '11.

[18]  Cyrus Shahabi,et al.  GeoCrowd: enabling query answering with spatial crowdsourcing , 2012, SIGSPATIAL/GIS.

[19]  He Ma,et al.  GRVS: a georeferenced video search engine , 2009, MM '09.

[20]  Cyrus Shahabi,et al.  Effectively crowdsourcing the acquisition and analysis of visual data for disaster response , 2015, 2015 IEEE International Conference on Big Data (Big Data).

[21]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[22]  Luming Zhang,et al.  Active key frame selection for 3D model reconstruction from crowdsourced geo-tagged videos , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[23]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[24]  Cyrus Shahabi,et al.  Efficient indexing and retrieval of large-scale geo-tagged video databases , 2016, GeoInformatica.

[25]  Roger Zimmermann,et al.  Automatic positioning data correction for sensor-annotated mobile videos , 2012, SIGSPATIAL/GIS.

[26]  He Ma,et al.  A Grid-Based Index and Queries for Large-Scale Geo-tagged Video Collections , 2012, DASFAA Workshops.