Integrating Online Data for Smart City Data Marts

The development of smart city infrastructures is seen as an important strategic component for many countries with applications in the areas of government services, healthcare, transport and traffic management, energy, water, and the management of waste services. In general, each of these infrastructural components generates data as it delivers its service. The usage of this data is often crucial both to the continued development of the service and for forward planning. While the data sources are often not complex in structure, traditional decision support systems are not built to handle continuous data streams, new or disappearing data sources, or the integration of multiple online data sources. In this work, we develop a flexible ETL process to quickly process and integrate online smart city data sources to deliver information that can be used in close to real-time.

[1]  Mark Roantree,et al.  A heuristic approach to selecting views for materialization , 2014, Softw. Pract. Exp..

[2]  María Bermúdez-Edo,et al.  Challenges for Quality of Data in Smart Cities , 2015, ACM J. Data Inf. Qual..

[3]  Luis A. Hernández Gómez,et al.  Smart Cities at the Forefront of the Future Internet , 2011, Future Internet Assembly.

[4]  Hiroyuki Kitagawa,et al.  Towards Real-Time Analysis of Smart City Data: A Case Study on City Facility Utilizations , 2016, 2016 IEEE 18th International Conference on High Performance Computing and Communications; IEEE 14th International Conference on Smart City; IEEE 2nd International Conference on Data Science and Systems (HPCC/SmartCity/DSS).

[5]  Pierfrancesco Bellini,et al.  Km4City ontology building vs data harvesting and cleaning for smart-city services , 2014, J. Vis. Lang. Comput..

[6]  Roberto De Virgilio,et al.  A Path-Oriented RDF Index for Keyword Search Query Processing , 2011, DEXA.

[7]  Dario Colazzo,et al.  Counting types for massive JSON datasets , 2017, DBPL.

[8]  Mark Roantree,et al.  Integrating Sensor Streams in pHealth Networks , 2008, 2008 14th IEEE International Conference on Parallel and Distributed Systems.

[9]  Michael Scriney,et al.  Generating cubes from smart city web data , 2017, ACSW.

[10]  Dario Colazzo,et al.  Schema Inference for Massive JSON Datasets , 2017, EDBT.

[11]  Torben Bach Pedersen,et al.  Multidimensional Integrated Ontologies: A Framework for Designing Semantic Data Warehouses , 2009, J. Data Semant..

[12]  Josep Paradells Aspas,et al.  Smart Cities as an Application of Internet of Things: Experiences and Lessons Learnt in Barcelona , 2013, 2013 Seventh International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.

[13]  Dimitrios Skoutas,et al.  Ontology-Based Conceptual Design of ETL Processes for Both Structured and Semi-Structured Data , 2007, Int. J. Semantic Web Inf. Syst..