A Distributed Framework for Large-Scale Time-Dependent Graph Analysis

In the last few years, we have seen that many applications or computer problems are mobilized as a graph since this data structure gives a particular handling for some use cases such as social networks, bioinformatics, road networks and communication networks. Despite its importance, the graph processing remains a challenge when dealing with large graphs. In this context, several solutions and works have been proposed to support large graph processing and storage. Nevertheless, new needs are emerging to support the dynamism of the graph (Dynamic Graph) and properties variation of the graph during the time (temporal graph). In this paper, we first present the concepts of dynamic and temporal graphs. Secondly, we show some frameworks that treat static, dynamic and temporal graphs. Finally, we propose a new framework based on the limits of the frameworks study.

[1]  Jae-Gil Lee,et al.  Traffic Density-Based Discovery of Hot Routes in Road Networks , 2007, SSTD.

[2]  Éric Tanter,et al.  Parallel actor monitors: Disentangling task-level parallelism from data partitioning in the actor model , 2014, Sci. Comput. Program..

[3]  Deborah Estrin,et al.  Directed diffusion: a scalable and robust communication paradigm for sensor networks , 2000, MobiCom '00.

[4]  Ling Liu,et al.  NEAT: Road Network Aware Trajectory Clustering , 2012, 2012 IEEE 32nd International Conference on Distributed Computing Systems.

[5]  Alberto Montresor,et al.  An evaluation study of BigData frameworks for graph processing , 2013, 2013 IEEE International Conference on Big Data.

[6]  Sabeur Aridhi,et al.  Big Graph Mining: Frameworks and Techniques , 2016, Big Data Res..

[7]  Jae-Gil Lee,et al.  Parallel community detection on large graphs with MapReduce and GraphChi , 2016, Data Knowl. Eng..

[8]  Jay Kreps,et al.  Kafka : a Distributed Messaging System for Log Processing , 2011 .

[9]  Laks V. S. Lakshmanan,et al.  Incremental cluster evolution tracking from highly dynamic network data , 2014, 2014 IEEE 30th International Conference on Data Engineering.

[10]  Karsten Schwan,et al.  GraphIn: An Online High Performance Incremental Graph Processing Framework , 2016, Euro-Par.

[11]  Sabeur Aridhi,et al.  BLADYG: A Graph Processing Framework for Large Dynamic Graphs , 2017, Big Data Res..

[12]  Timothy G. Armstrong,et al.  LinkBench: a database benchmark based on the Facebook social graph , 2013, SIGMOD '13.

[13]  Willy Zwaenepoel,et al.  X-Stream: edge-centric graph processing using streaming partitions , 2013, SOSP.

[14]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[15]  Regis Pires Magalhães,et al.  Graphast: an extensible framework for building applications on time-dependent networks , 2015, SIGSPATIAL/GIS.

[16]  M. Delsanti,et al.  Structural, elastic, and dynamic properties of swollen polymer networks , 1982 .

[17]  Aart J. C. Bik,et al.  Pregel: a system for large-scale graph processing , 2010, SIGMOD Conference.

[18]  Joseph Gonzalez,et al.  PowerGraph: Distributed Graph-Parallel Computation on Natural Graphs , 2012, OSDI.