A green policy to schedule tasks in a distributed cloud

In the last years, demand and availability of computational capabilities experienced radical changes. Desktops and laptops increased their processing resources, exceeding users’ demand for large part of the day. On the other hand, computational methods are more and more frequently adopted by scientific communities, which often experience difficulties in obtaining access to the required resources. Consequently, data centers for outsourcing use, relying on the cloud computing paradigm, are proliferating. Notwithstanding the effort to build energy-efficient data centers, their energy footprint is still considerable, since cooling a large number of machines situated in the same room or container requires a significant amount of power. The volunteer cloud, exploiting the users’ willingness to share a quote of their underused machine resources, can constitute an effective solution to have the required computational resources when needed. In this paper, we foster the adoption of the volunteer cloud computing as a green (i.e., energy efficient) solution even able to outperform existing data centers in specific tasks. To manage the complexity of such a large scale heterogeneous system, we propose a distributed optimization policy to task scheduling with the aim of reducing the overall energy consumption executing a given workload. To this end, we consider an integer programming problem relying on the Alternating Direction Method of Multipliers (ADMM) for its solution. Our approach is compared with a centralized one and other non-green targeting solutions. Results show that the distributed solution found by the ADMM constitutes a good suboptimal solution, worth to be applied in a real environment.

[1]  Shuaiwen Song,et al.  EDR: An energy-aware runtime load distribution system for data-intensive applications in the cloud , 2013, 2013 IEEE International Conference on Cluster Computing (CLUSTER).

[2]  Victor C. M. Leung,et al.  Job Scheduling for Cloud Computing Integrated with Wireless Sensor Network , 2014, 2014 IEEE 6th International Conference on Cloud Computing Technology and Science.

[3]  Patrick Pérez,et al.  Distributed Non-convex ADMM-based inference in large-scale random fields , 2014, BMVC.

[4]  Antonio Scala,et al.  A Workload-Based Approach to Partition the Volunteer Cloud , 2015, 2015 IEEE Conference on Collaboration and Internet Computing (CIC).

[5]  D. Milojicic,et al.  Peer-to-Peer Computing , 2010 .

[6]  D. Janaki Ram,et al.  Cloudy knapsack problems: An optimization model for distributed cloud-assisted systems , 2014, 14-th IEEE International Conference on Peer-to-Peer Computing.

[7]  Domenico Talia,et al.  Cloud Computing and Software Agents: Towards Cloud Intelligent Services , 2011, WOA.

[8]  David P. Anderson,et al.  BOINC: a system for public-resource computing and storage , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[9]  Jarek Nabrzyski,et al.  Cost minimization for computational applications on hybrid cloud infrastructures , 2013, Future Gener. Comput. Syst..

[10]  Hsien-Hsin S. Lee,et al.  Extending Amdahl's Law for Energy-Efficient Computing in the Many-Core Era , 2008, Computer.

[11]  Antonio Puliafito,et al.  Cloud@Home: Bridging the Gap between Volunteer and Cloud Computing , 2009, ICIC.

[12]  Alberto Lluch-Lafuente,et al.  A Holistic Approach for Collaborative Workload Execution in Volunteer Clouds , 2018, ACM Trans. Model. Comput. Simul..

[13]  Özalp Babaoglu,et al.  Design and implementation of a P2P Cloud system , 2012, SAC '12.

[14]  Jyh-Horng Chou,et al.  Optimized task scheduling and resource allocation on cloud computing environment using improved differential evolution algorithm , 2013, Comput. Oper. Res..

[15]  Baochun Li,et al.  Joint request mapping and response routing for geo-distributed cloud services , 2013, 2013 Proceedings IEEE INFOCOM.

[16]  Alberto Montresor,et al.  P2P and Cloud: A Marriage of Convenience for Replica Management , 2012, IWSOS.

[17]  Alberto Montresor,et al.  Cloudy weather for P2P, with a chance of gossip , 2011, 2011 IEEE International Conference on Peer-to-Peer Computing.

[18]  Alberto Lluch-Lafuente,et al.  AVOCLOUDY: a simulator of volunteer clouds , 2016, Softw. Pract. Exp..

[19]  Ivan Beschastnikh,et al.  Seattle: a platform for educational cloud computing , 2009, SIGCSE '09.

[20]  Laura Ricci,et al.  Integrating peer-to-peer and cloud computing for massively multiuser online games , 2015, Peer-to-Peer Netw. Appl..

[21]  Francisco Vilar Brasileiro,et al.  Bridging the High Performance Computing Gap: the OurGrid Experience , 2007, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).

[22]  Marc St-Hilaire,et al.  An energy optimizing scheduler for mobile cloud computing environments , 2014, 2014 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[23]  David P. Anderson,et al.  SETI@home: an experiment in public-resource computing , 2002, CACM.

[24]  George Pavlou,et al.  A toolchain for simplifying network simulation setup , 2013, SimuTools.

[25]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[26]  Michael Dahlin,et al.  Volunteer Cloud Computing: MapReduce over the Internet , 2011, 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum.

[27]  Alberto Lluch-Lafuente,et al.  A computational field framework for collaborative task execution in volunteer clouds , 2014, SEAMS 2014.

[28]  Mark D. Hill,et al.  Amdahl's Law in the Multicore Era , 2008 .

[29]  Marian Bubak,et al.  Scheduling Multilevel Deadline-Constrained Scientific Workflows on Clouds Based on Cost Optimization , 2015, Sci. Program..

[30]  Euhanna Ghadimi,et al.  Optimal Parameter Selection for the Alternating Direction Method of Multipliers (ADMM): Quadratic Problems , 2013, IEEE Transactions on Automatic Control.

[31]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[32]  Alberto Bemporad,et al.  Optimal distributed task scheduling in volunteer clouds , 2017, Comput. Oper. Res..

[33]  Raffaele Cerulli,et al.  Maximizing lifetime in wireless sensor networks with multiple sensor families , 2015, Comput. Oper. Res..

[34]  Santiago Grijalva,et al.  Large-scale decentralized unit commitment , 2015 .

[35]  Francesco Tiezzi,et al.  Reputation-Based Cooperation in the Clouds , 2014, IFIPTM.

[36]  Raffaela Mirandola,et al.  On exploiting decentralized bio-inspired self-organization algorithms to develop real systems , 2009, 2009 ICSE Workshop on Software Engineering for Adaptive and Self-Managing Systems.

[37]  Omer F. Rana,et al.  CONCURRENCYANDCOMPUTATION : PRACTICE AND EXPERIENCE Towards autonomic management for Cloud services based upon volunteered resources , 2011 .

[38]  Paramvir Bahl,et al.  The Case for VM-Based Cloudlets in Mobile Computing , 2009, IEEE Pervasive Computing.

[39]  Patrick Wendell,et al.  DONAR: decentralized server selection for cloud services , 2010, SIGCOMM '10.

[40]  Patrick Pérez,et al.  Distributed ADMM-based inference in large-scale random fields , 2014, British Machine Vision Conference.

[41]  Douglas Thain,et al.  Distributed computing in practice: the Condor experience , 2005, Concurr. Pract. Exp..

[42]  Franco Zambonelli,et al.  Spatial Computing: An Emerging Paradigm for Autonomic Computing and Communication , 2004, WAC.

[43]  Alberto Lluch-Lafuente,et al.  A Cooperative Approach for Distributed Task Execution in Autonomic Clouds , 2013, 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing.

[44]  Xian-He Sun,et al.  Reevaluating Amdahl's law in the multicore era , 2010, J. Parallel Distributed Comput..

[45]  Chita R. Das,et al.  Towards characterizing cloud backend workloads: insights from Google compute clusters , 2010, PERV.