Time-sensitive resource re-allocation strategy for interdependent continuous tasks

An increase in volumes of data and a shift towards live data enabled a stronger focus on resource-intensive tasks which run continuously over long periods. A Grid has potential to offer the required resources for these tasks, while considering a fair and balanced allocation of resources among multiple client agents. Taking this into account, a Grid might be unwilling to allocate its resources for long time, leading to task interruptions. This problem becomes even more serious if an interruption of one task may lead to the interruption of dependent tasks. Here, we discuss a new strategy for resource re-allocation which is utilized by a client with the aim to prevent too long interruptions by re-allocating resources between its own tasks. Those re-allocations are suggested by a client agent, but only a Grid can re-allocate resources if agreed. Our strategy was tested under the different Grid settings, accounting for the adjusted coefficients, and demonstrated noticeable improvements in client utilities as compared to when it is not considered. Our experiment was also extended to tests with environmental modelling and realistic Grid resource simulation, grounded in real-life Grid studies. These tests have also shown a useful application of our strategy.

[1]  Michael Luck,et al.  Negotiation to Execute Continuous Long-Term Tasks , 2014, ECAI.

[2]  Shu-Chin Wang,et al.  A hybrid load balancing policy underlying grid computing environment , 2007, Comput. Stand. Interfaces.

[3]  Michael Luck,et al.  Resource Re-allocation for Data Inter-dependent Continuous Tasks in Grids , 2016, EUMAS/AT.

[4]  Frode Eika Sandnes,et al.  Stochastic DFS for Multiprocessor Scheduling of Cyclic Taskgraphs , 2004, PDCAT.

[5]  Yanxiang He,et al.  A Run-Time Scheduling Policy for Dependent Tasks in Grid Computing Systems , 2005, Sixth International Conference on Parallel and Distributed Computing Applications and Technologies (PDCAT'05).

[6]  Óscar Corcho,et al.  Linked Stream Data: A Position Paper , 2009, SSN.

[7]  Ian T. Foster,et al.  The anatomy of the grid: enabling scalable virtual organizations , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[8]  Shivnath Babu,et al.  Execution and optimization of continuous queries with cyclops , 2013, SIGMOD '13.

[9]  Liang-Teh Lee,et al.  A Non-critical Path Earliest-Finish Algorithm for Inter-dependent Tasks in Heterogeneous Computing Environments , 2009, 2009 11th IEEE International Conference on High Performance Computing and Communications.

[10]  Marco A. Casanova,et al.  From Sensor Data Streams to Linked Streaming Data: a survey of main approaches , 2016, J. Inf. Data Manag..

[11]  Rizos Sakellariou,et al.  A Low-Cost Rescheduling Policy for Dependent Tasks on Grid Computing Systems , 2004, European Across Grids Conference.

[12]  Victor R. Lesser,et al.  A retrospective view of FA/C distributed problem solving , 1991, IEEE Trans. Syst. Man Cybern..

[13]  A. Sardinha,et al.  Scheduling Cyclic Task Graphs with SCC-Map , 2012, 2012 Third Workshop on Applications for Multi-Core Architecture.

[14]  Jennifer Widom,et al.  Continuous queries over data streams , 2001, SGMD.

[15]  Valeriia Haberland,et al.  Strategies for the execution of long-term continuous and simultaneous tasks in grids , 2015 .

[16]  Michael Luck,et al.  Negotiation strategy for continuous long-term tasks in a grid environment , 2015, Autonomous Agents and Multi-Agent Systems.

[17]  Victor R. Lesser,et al.  Generalizing the Partial Global Planning Algorithm , 1992, Int. J. Cooperative Inf. Syst..

[18]  Jennifer Widom,et al.  Query Processing, Resource Management, and Approximation ina Data Stream Management System , 2002 .

[19]  Victor R. Lesser.  Evolution of the GPGP/TÆMS domain-independent coordination framework , 2002, AAMAS.

[20]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[21]  Tao Yang,et al.  Heuristic Algorithms for Scheduling Iterative Task Computations on Distributed Memory Machines , 1997, IEEE Trans. Parallel Distributed Syst..

[22]  Douglas B. Terry,et al.  Continuous queries over append-only databases , 1992, SIGMOD '92.

[23]  Hoan Quoc Nguyen-Mau,et al.  A middleware framework for scalable management of linked streams , 2012, J. Web Semant..

[24]  Victor R. Lesser,et al.  Evolution of the GPGP/TÆMS Domain-Independent Coordination Framework , 2002, AAMAS '02.

[25]  Andrew A. Chien,et al.  Henri Casanova , 2022 .

[26]  Michael Luck,et al.  Adjustable Fuzzy Inference for Adaptive Grid Resource Negotiation , 2015, Next Frontier in Agent-Based Complex Automated Negotiation.

[27]  Daniele Braga,et al.  C-SPARQL: SPARQL for continuous querying , 2009, WWW '09.

[28]  Belabbes Yagoubi,et al.  Dynamic Dependent Tasks Assignment for Grid Computing , 2011, Int. J. Grid High Perform. Comput..

[29]  Artur Andrzejak,et al.  Characterizing and Predicting Resource Demand by Periodicity Mining , 2005, Journal of Network and Systems Management.

[30]  Alexandru Iosup,et al.  The Grid Workloads Archive , 2008, Future Gener. Comput. Syst..