TVDP: Translational Visual Data Platform for Smart Cities

This paper proposes a platform, dubbed "Translational Visual Data Platform (TVDP)", to collect, manage, analyze urban visual data which enables participating community members connected not only to enhance their individual operations but also to smartly incorporate visual data acquisition, access, analysis methods and results among them. Specifically, we focus on geo-tagged visual data since location information is essential in many smart city applications and provides a fundamental connection in managing and sharing data among collaborators. Furthermore, our study targets for an image-based machine learning platform to prepare users for the upcoming era of machine learning (ML) and artificial intelligence (AI) applications. TVDP will be used to pilot, test, and apply various visual data-intensive applications in a collaborative way. New data, methods, and extracted knowledge from one application can be effectively translated into other applications, ultimately making visual data and analysis as a smart city infrastructure. The goal is to make value creation through visual data and their analysis as broadly available as possible, thus to make social and economic problem solving more distributed and collaborative among users. This paper reports the design and implementation of TVDP in progress and partial experimental results to demonstrate its feasibility.

[1]  Bhaskar Krishnamachari,et al.  A Crowd-Based Image Learning Framework using Edge Computing for Smart City Applications , 2019, 2019 IEEE Fifth International Conference on Multimedia Big Data (BigMM).

[2]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[3]  Cyrus Shahabi,et al.  Geo-Spatial Multimedia Sentiment Analysis in Disasters , 2017, 2017 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[4]  Nicole Immorlica,et al.  Locality-sensitive hashing scheme based on p-stable distributions , 2004, SCG '04.

[5]  Cyrus Shahabi,et al.  Efficient indexing and retrieval of large-scale geo-tagged video databases , 2016, GeoInformatica.

[6]  Luming Zhang,et al.  Active key frame selection for 3D model reconstruction from crowdsourced geo-tagged videos , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[7]  Cyrus Shahabi,et al.  Effectively crowdsourcing the acquisition and analysis of visual data for disaster response , 2015, 2015 IEEE International Conference on Big Data (Big Data).

[8]  Cyrus Shahabi,et al.  MediaQ: mobile multimedia management system , 2014, MMSys '14.

[9]  Cyrus Shahabi,et al.  Key Frame Selection Algorithms for Automatic Generation of Panoramic Images from Crowdsourced Geo-tagged Videos , 2014, W2GIS.

[10]  Cyrus Shahabi,et al.  Real-Time Traffic Video Analysis Using Intel Viewmont Coprocessor , 2013, DNIS.

[11]  Cyrus Shahabi,et al.  Scalable Spatial Crowdsourcing: A Study of Distributed Algorithms , 2015, 2015 16th IEEE International Conference on Mobile Data Management.

[12]  Cyrus Shahabi,et al.  GeoCrowd: enabling query answering with spatial crowdsourcing , 2012, SIGSPATIAL/GIS.

[13]  Mark S. Nixon,et al.  Feature extraction & image processing for computer vision , 2012 .

[14]  Cyrus Shahabi,et al.  An entropy-based framework for efficient post-disaster assessment based on crowdsourced data , 2016, EM-GIS.

[15]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[16]  Roger Zimmermann,et al.  Viewable scene modeling for geospatial video search , 2008, ACM Multimedia.

[17]  Cyrus Shahabi,et al.  Spatial Coverage Measurement of Geo- Tagged Visual Data: A Database Approach , 2018, 2018 IEEE Fourth International Conference on Multimedia Big Data (BigMM).

[18]  Cyrus Shahabi,et al.  Image Classification to Determine the Level of Street Cleanliness: A Case Study , 2018, 2018 IEEE Fourth International Conference on Multimedia Big Data (BigMM).

[19]  JUSTIN ZOBEL,et al.  Inverted files for text search engines , 2006, CSUR.

[20]  Cyrus Shahabi,et al.  Recognizing Material of a Covered Object: A Case Study With Graffiti , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[21]  Cyrus Shahabi,et al.  A Deep Learning Approach for Road Damage Detection from Smartphone Images , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[22]  Noah Snavely,et al.  Material recognition in the wild with the Materials in Context Database , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Cyrus Shahabi,et al.  Hybrid Indexes for Spatial-Visual Search , 2017, ACM Multimedia.

[24]  Cyrus Shahabi,et al.  GeoUGV: user-generated mobile video dataset with fine granularity spatial metadata , 2016, MMSys.

[25]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Cyrus Shahabi,et al.  A Data-Centric Approach for Image Scene Localization , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[27]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..