Using Big Data and Real-Time Analytics to Support Smart City Initiatives

Abstract: A central issue in the context of smart cities is related to the capability to acquire timely information about city events. This paper describes a platform which focuses on processing messages posted in Twitter social network. Key issues here are the high throughput a large volume of data per second that needs to be processed, and the need to process ill formed natural language texts. With these in mind the platform has pipelined modules for robust, fast, real time tweet acquisition and storage, filtering of several kinds, natural language processing and sentiment analysis, that feed a final analysis and visualization module. A case study of sentiment analysis during the 2014 FIFA World Cup in Brazil is used to validate the effort made so far.

[1]  Gerhard P. Hancke,et al.  The Role of Advanced Sensing in Smart Cities , 2012, Sensors.

[2]  Swapna S. Gokhale,et al.  Human sensing for smart cities , 2013, 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2013).

[3]  Antonio Quintela Incera,et al.  Fiber Optic Sensors in Structural Health Monitoring , 2011, Journal of Lightwave Technology.

[4]  Dimitrios Buhalis,et al.  Smart Tourism Destinations , 2014, ENTER.

[5]  P. Nijkamp,et al.  Smart Cities in Europe , 2011 .

[6]  Mário J. Silva,et al.  Building a Sentiment Lexicon for Social Judgement Mining , 2012, PROPOR.

[7]  Sherif Sakr,et al.  Modeling performance of a parallel streaming engine: bridging theory and costs , 2013, ICPE '13.

[8]  Krishnaprasad Thirunarayan,et al.  Extracting City Traffic Events from Social Streams , 2015, ACM Trans. Intell. Syst. Technol..

[9]  R. Coleman,et al.  'You'll never walk alone': CCTV surveillance, order and neo-liberal rule in Liverpool city centre. , 2000, The British journal of sociology.

[10]  Ewan Klein,et al.  Natural Language Processing with Python , 2009 .

[11]  N. Komninos,et al.  Special Issue on Smart Cities and the Future Internet in Europe , 2012, Journal of the Knowledge Economy.

[12]  Jiawei Han,et al.  MoveMine 2.0: Mining Object Relationships from Movement Data , 2014, Proc. VLDB Endow..