Gelly-scheduling: distributed graph processing for service placement in community networks

Community networks (CNs) have seen an increase in the last fifteen years. Their members contact nodes which operate Internet proxies, web servers, user file storage and video streaming services, to name a few. Detecting communities of nodes with properties (such as co-location) and assessing node eligibility for service placement is thus a key-factor in optimizing the experience of users. We present a novel solution for the problem of service placement as a two-phase approach, based on: 1) community finding using a scalable graph label propagation technique and 2) a decentralized election procedure to address the multi-objective challenge of optimizing service placement in CNs. Herein we: i) highlight the applicability of leader election heuristics which are important for service placement in community networks and scheduler-dependent scenarios; ii) present a parallel and distributed solution designed as a scalable alternative for the problem of service placement, which has mostly seen computational approaches based on centralization and sequential execution.

[1]  Pietro Liò,et al.  Towards real-time community detection in large networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Luís Veiga,et al.  Towards Network-Aware Service Placement in Community Network Micro-Clouds , 2016, Euro-Par.

[3]  Marco Rosa,et al.  Layered label propagation: a multiresolution coordinate-free ordering for compressing social networks , 2010, WWW.

[4]  Leandro Navarro-Moldes,et al.  A technological overview of the guifi.net community network , 2015, Comput. Networks.

[5]  Alexander L. Wolf,et al.  Dynamic placement of composite software services in hybrid wireless networks , 2015, MILCOM 2015 - 2015 IEEE Military Communications Conference.

[6]  Luís Veiga,et al.  Performance evaluation of a distributed storage service in community network clouds , 2016, Concurr. Comput. Pract. Exp..

[7]  J. Hosking L‐Moments: Analysis and Estimation of Distributions Using Linear Combinations of Order Statistics , 1990 .

[8]  J. R. Wallis,et al.  Regional Frequency Analysis: An Approach Based on L-Moments , 1997 .

[9]  Llorenç Cerdà-Alabern,et al.  On the topology characterization of Guifi.net , 2012, 2012 IEEE 8th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).

[10]  Skipper Seabold,et al.  Statsmodels: Econometric and Statistical Modeling with Python , 2010, SciPy.

[11]  Leandro Navarro-Moldes,et al.  Topology patterns of a community network: Guifi.net , 2012, 2012 IEEE 8th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).

[12]  Kin K. Leung,et al.  Dynamic Service Placement for Mobile Micro-Clouds with Predicted Future Costs , 2015, IEEE Transactions on Parallel and Distributed Systems.

[13]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[14]  Joan Manuel Marquès,et al.  Exploring local service allocation in Community Networks , 2014, 2014 IEEE 10th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).

[15]  Felix Freitag,et al.  Cloud services in the Guifi.net community network , 2015, Comput. Networks.

[16]  Eric P. Smith,et al.  An Introduction to Statistical Modeling of Extreme Values , 2002, Technometrics.

[17]  Jonathan R. M. Hosking,et al.  Fortran routines for use with the method of L-moments Version 3.04 , 1997 .

[18]  Johan Tordsson,et al.  Dynamic application placement in the Mobile Cloud Network , 2017, Future Gener. Comput. Syst..

[19]  Réka Albert,et al.  Near linear time algorithm to detect community structures in large-scale networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  Asser N. Tantawi Solution Biasing for Optimized Cloud Workload Placement , 2016, 2016 IEEE International Conference on Autonomic Computing (ICAC).

[21]  Jonathan R. M. Hosking,et al.  The four-parameter kappa distribution , 1994, IBM J. Res. Dev..

[22]  Luís Veiga,et al.  Practical Service Placement Approach for Microservices Architecture , 2017, 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID).