Big Data in Smart City: Management Challenges

Smart cities use digital technologies such as cloud computing, Internet of Things, or open data in order to overcome limitations of traditional representation and exchange of geospatial data. This concept ensures a significant increase in the use of data to establish new services that contribute to better sustainable development and monitoring of all phenomena that occur in urban areas. The use of the modern geoinformation technologies, such as sensors for collecting different geospatial and related data, requires adequate storage options for further data analysis. In this paper, we suggest the biG dAta sMart cIty maNagEment SyStem (GAMINESS) that is based on the Apache Spark big data framework. The model of the GAMINESS management system is based on the principles of the big data modeling, which differs greatly from standard databases. This approach provides the ability to store and manage huge amounts of structured, semi-structured, and unstructured data in real time. System performance is increasing to a higher level by using the process parallelization explained through the five V principles of the big data paradigm. The existing solutions based on the five V principles are focused only on the data visualization, not the data themselves. Such solutions are often limited by different storage mechanisms and by the ability to perform complex analyses on large amounts of data with expected performance. The GAMINESS management system overcomes these disadvantages by conversion of smart city data to a big data structure without limitations related to data formats or use standards. The suggested model contains two components: a geospatial component and a sensor component that are based on the CityGML and the SensorThings standards. The developed model has the ability to exchange data regardless of the used standard or the data format into proposed Apache Spark data framework schema. The verification of the proposed model is done within the case study for the part of the city of Novi Sad.

[1]  Nor Badrul Anuar,et al.  The role of big data in smart city , 2016, Int. J. Inf. Manag..

[2]  Thomas H. Kolbe,et al.  CityGML 3.0: New Functions Open Up New Applications , 2020, PFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science.

[3]  Sherali Zeadally,et al.  IoT technologies for smart cities , 2018, IET Networks.

[4]  Taehoon Kim,et al.  Comparison between two OGC standards for indoor space: CityGML and IndoorGML , 2015, ISA@SIGSPATIAL.

[5]  Volker Coors,et al.  INTEGRATION AND VISUALIZATION OF HETEROGENEOUS SENSOR DATA AND GEOSPATIAL INFORMATION , 2018, SDSC 2018.

[6]  Milan Kubina,et al.  Use of Big Data for Competitive Advantage of Company , 2015 .

[7]  Mohamed Sarwat,et al.  GeoSpark: a cluster computing framework for processing large-scale spatial data , 2015, SIGSPATIAL/GIS.

[8]  Ph . Engel,et al.  DEVELOPMENT OF AN OPEN-SOURCE AUTOMATIC DEFORMATION MONITORING SYSTEM FOR GEODETICAL AND GEOTECHNICAL MEASUREMENTS , 2016 .

[9]  Yusuf A. Aina,et al.  Achieving smart sustainable cities with GeoICT support: The Saudi evolving smart cities , 2017 .

[10]  Stevan Milovanov,et al.  Building Virtual 3D City Model for Smart Cities Applications: A Case Study on Campus Area of the University of Novi Sad , 2020, ISPRS Int. J. Geo Inf..

[11]  Sanjay Ghemawat,et al.  MapReduce: simplified data processing on large clusters , 2008, CACM.

[12]  Jane W.-S. Liu,et al.  Active Disaster Response System for a Smart Building , 2014, 2014 International Symposium on Computer, Consumer and Control.

[13]  Yiran Chen,et al.  GeoSpark SQL: An Effective Framework Enabling Spatial Queries on Spark , 2017, ISPRS Int. J. Geo Inf..

[14]  Andreas Donaubauer,et al.  3DCITYDB4BIM: A SYSTEM ARCHITECTURE FOR LINKING BIM SERVER AND 3D CITYDB FOR BIM-GIS-INTEGRATION , 2020 .

[15]  Mahmoud Ammar,et al.  Journal of Information Security and Applications , 2022 .

[16]  박인혜,et al.  Integrating IndoorGML and Indoor POI Data for Navigation Applications in Indoor Space , 2019 .

[17]  Kun Liu,et al.  CLASSIFICATION OF BIG POINT CLOUD DATA USING CLOUD COMPUTING , 2015 .

[18]  Kun Liu,et al.  Parallel processing of big point clouds using Z-Order-based partitioning , 2016 .

[19]  T. H. Kolbe,et al.  INTEGRATING DYNAMIC DATA AND SENSORS WITH SEMANTIC 3D CITY MODELSIN THE CONTEXT OF SMART CITIES , 2016 .

[20]  Carlo Zaniolo,et al.  Big Data Analytics with Datalog Queries on Spark , 2016, SIGMOD Conference.

[21]  Alexandros Labrinidis,et al.  GeoSensor Networks, Second International Conference, GSN 2006, Boston, MA, USA, October 1-3, 2006, Revised Selected and Invited Papers , 2008, GSN.

[22]  Filip Biljecki,et al.  CityGML Application Domain Extension (ADE): overview of developments , 2018, Open Geospatial Data, Software and Standards.

[23]  Jürgen Döllner,et al.  Concepts and techniques for integration, analysis and visualization of massive 3D point clouds , 2014, Comput. Environ. Urban Syst..

[24]  Karl-Heinz Häfele,et al.  New Concepts for Structuring 3D City Models - An Extended Level of Detail Concept for CityGML Buildings , 2013, ICCSA.

[25]  Maher A. El-Hallaq,et al.  Enhancing Sustainable Development through Web Based 3D Smart City Model Using GIS and BIM. Case Study: Sheikh Hamad City , 2019, Journal of Geographic Information System.

[26]  Jameela Al-Jaroodi,et al.  Applications of big data to smart cities , 2015, Journal of Internet Services and Applications.

[27]  Ping Wang,et al.  Real-Time Big Data Processing Framework: Challenges and Solutions , 2015 .

[28]  Hae-Kyong Kang,et al.  A Standard Indoor Spatial Data Model - OGC IndoorGML and Implementation Approaches , 2017, ISPRS Int. J. Geo Inf..

[29]  Dorota Jelonek,et al.  Big Data Analytics in the Management of Business , 2017 .

[30]  Simon Elias Bibri,et al.  The Big Data Deluge for Transforming the Knowledge of Smart Sustainable Cities: A Data Mining Framework for Urban Analytics , 2018, SCA.

[31]  Miro Govedarica,et al.  Model of Point Cloud Data Management System in Big Data Paradigm , 2018, ISPRS Int. J. Geo Inf..

[32]  Yuan Yao,et al.  Big data in smart cities , 2015, Science China Information Sciences.

[33]  Kun Liu,et al.  The Iqmulus Urban Showcase: Automatic Tree Classification and Identification in Huge Mobile Mapping Point Clouds , 2016 .

[34]  Martin Breunig,et al.  Geospatial Data Management Research: Progress and Future Directions , 2020, ISPRS Int. J. Geo Inf..

[35]  Ravi Kishore Kodali,et al.  IoT Based HOME AUTOMATION Using Node-RED , 2018, 2018 Second International Conference on Green Computing and Internet of Things (ICGCIoT).

[36]  Chih-Yuan Huang,et al.  An Automatic Embedded Device Registration Procedure Based on the OGC SensorThings API , 2019, Sensors.

[37]  Andreas Donaubauer,et al.  3DCityDB - a 3D geodatabase solution for the management, analysis, and visualization of semantic 3D city models based on CityGML , 2018, Open Geospatial Data, Software and Standards.

[38]  Andreas Donaubauer,et al.  A 3D Indoor Routing Service with 2D Visualization Based on the Multi-Layered Space-Event Model , 2013, Progress in Location-Based Services.

[39]  Z. Irani,et al.  Critical analysis of Big Data challenges and analytical methods , 2017 .

[40]  Christian M. Alis,et al.  Sideloading - Ingestion of Large Point Clouds Into the Apache Spark Big Data Engine , 2016 .

[41]  Giner Alor-Hernández,et al.  A general perspective of Big Data: applications, tools, challenges and trends , 2015, The Journal of Supercomputing.

[42]  Syed Akhter Hossain,et al.  NoSQL Database: New Era of Databases for Big data Analytics - Classification, Characteristics and Comparison , 2013, ArXiv.

[43]  Filip Biljecki,et al.  Applications of 3D City Models: State of the Art Review , 2015, ISPRS Int. J. Geo Inf..

[44]  Govind P. Gupta,et al.  Framework for Monitoring and Recognition of the Activities for Elderly People from Accelerometer Sensor Data Using Apache Spark , 2020 .

[45]  Stefano Piffer,et al.  USING CITYGML TO DEPLOY SMART-CITY SERVICES FOR URBAN ECOSYSTEMS , 2013 .

[46]  A Saraswathi,et al.  Real-Time Traffic Monitoring System Using Spark , 2019, 2019 International Conference on Emerging Trends in Science and Engineering (ICESE).

[47]  Kavisha Kumar,et al.  CityJSON: a compact and easy-to-use encoding of the CityGML data model , 2019, Open Geospatial Data, Software and Standards.

[48]  Peter van Oosterom,et al.  Massive point cloud data management: Design, implementation and execution of a point cloud benchmark , 2015, Comput. Graph..