Distributed online Temporal Fuzzy Concept Analysis for stream processing in smart cities

Abstract Nowadays, one of the main challenges in the smart cities is mining high-level semantics from low-level activities. In this context, real-time data streams are continuously produced and analysed by efficient and effective algorithms, which are able to handle complexities related to big data, in order to enable the core functions of Decision Support Systems in the smart city. These algorithms should receive input data coming from different city domains (or pillars) and process, aggregate and reason over them in a way that it is possible to find hidden correlations among different and heterogeneous elements (e.g., traffic, weather, cultural events) along space and time dimensions. This paper proposes the online implementation and deployment of Temporal Fuzzy Concept Analysis on a distributed real-time computation system, based on Apache Storm, to face with big data stream analysis in the smart city context. Such online distributed algorithm is able to incrementally generate the timed fuzzy lattice that organizes the knowledge on several and cross-domain aspects of the city. Temporal patterns, of how situations evolve in the city, can be elicited by both exploring the lattice and observing its growth in order to obtain actionable knowledge to support smart city decision-making processes.

[1]  Antonio di Nola,et al.  Unifying fuzzy concept lattice construction methods , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[2]  Kimiz Dalkir,et al.  Knowledge Management in Theory and Practice , 2005 .

[3]  Rokia Missaoui,et al.  INCREMENTAL CONCEPT FORMATION ALGORITHMS BASED ON GALOIS (CONCEPT) LATTICES , 1995, Comput. Intell..

[4]  Rob Kitchin,et al.  The automatic management of drivers and driving spaces , 2007 .

[5]  Gianmarco De Francisci Morales,et al.  SAMOA: scalable advanced massive online analysis , 2015, J. Mach. Learn. Res..

[6]  Vincenzo Loia,et al.  Towards an automatic fuzzy ontology generation , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[7]  Gerd Stumme,et al.  Efficient Data Mining Based on Formal Concept Analysis , 2002, DEXA.

[8]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[9]  Jonas Poelmans,et al.  Analyzing Chat Conversations of Pedophiles with Temporal Relational Semantic Systems , 2012, 2012 European Intelligence and Security Informatics Conference.

[10]  Zhaohui Wu,et al.  Trace analysis and mining for smart cities: issues, methods, and applications , 2013, IEEE Communications Magazine.

[11]  Fatos Xhafa,et al.  Processing and Analytics of Big Data Streams with Yahoo!S4 , 2015, 2015 IEEE 29th International Conference on Advanced Information Networking and Applications.

[12]  Hao Wang,et al.  Learning concept-drifting data streams with random ensemble decision trees , 2015, Neurocomputing.

[13]  Bernhard Ganter,et al.  Formal Concept Analysis: Mathematical Foundations , 1998 .

[14]  Li Guo,et al.  A framework for application-driven classification of data streams , 2012, Neurocomputing.

[15]  Sami Bhiri,et al.  Using Formal Concept Analysis for Organizing and Discovering Sensor Capabilities , 2015, Comput. J..

[16]  Paddy Nixon,et al.  Situation determination with reusable situation specifications , 2006, Fourth Annual IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOMW'06).

[17]  J. Wareham,et al.  A Smart City Initiative: the Case of Barcelona , 2012, Journal of the Knowledge Economy.

[18]  Fatos Xhafa,et al.  On Streaming Consistency of Big Data Stream Processing in Heterogenous Clutsers , 2015, 2015 18th International Conference on Network-Based Information Systems.

[19]  Ruairí de Fréin,et al.  Distributed Formal Concept Analysis Algorithms Based on an Iterative MapReduce Framework , 2012, ICFCA.

[20]  Ahmed Y. Tawfik,et al.  Towards a Temporal Extension of Formal Concept Analysis , 2001, Canadian Conference on AI.

[21]  Vincenzo Loia,et al.  Hierarchical web resources retrieval by exploiting Fuzzy Formal Concept Analysis , 2012, Inf. Process. Manag..

[22]  Fatos Xhafa,et al.  A Software Chain Approach to Big Data Stream Processing and Analytics , 2015, 2015 Ninth International Conference on Complex, Intelligent, and Software Intensive Systems.

[23]  Derlis Gregor,et al.  Distributed urban traffic applications based on CORBA event services , 2011 .

[24]  Mimmo Parente,et al.  Time Aware Knowledge Extraction for microblog summarization on Twitter , 2015, Inf. Fusion.

[25]  Yoshitaka Shibata,et al.  A road condition monitoring system using various sensor data in vehicle-to-vehicle communication environment , 2016, Int. J. Space Based Situated Comput..

[26]  Francesco Orciuoli,et al.  Unfolding social content evolution along time and semantics , 2017, Future Gener. Comput. Syst..

[27]  Derrick G. Kourie,et al.  AddIntent: A New Incremental Algorithm for Constructing Concept Lattices , 2004, ICFCA.

[28]  Xu Qian,et al.  An Improved Incremental Algorithm for Constructing Concept Lattices , 2009, 2009 WRI World Congress on Software Engineering.

[29]  Feng Gao,et al.  CityBench: A Configurable Benchmark to Evaluate RSP Engines Using Smart City Datasets , 2015, SEMWEB.