Online Scheduling of Multiple Deadline-Constrained Workflow Applications in Distributed Systems

As distributed systems get increasingly popular in the use for large-scale computational/storage requirements, more attention has been put on the benefit of the system resource providers. This paper focuses on the online scheduling problem of how to schedule a set of sequentially submitted workflows with deadline constraints to maximize the resource utilization as well as the success rate of meeting the deadlines. A novel discrete-event based simulator is proposed to ease the analysis of the problem. Extensive evaluation has been done to exhibit the effectiveness and significance of the proposed simulator.

[1]  Laxmikant V. Kalé,et al.  Simulation-Based Performance Prediction for Large Parallel Machines , 2005, International Journal of Parallel Programming.

[2]  Rizos Sakellariou,et al.  A hybrid heuristic for DAG scheduling on heterogeneous systems , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[3]  Radu Prodan,et al.  Using a new event-based simulation framework for investigating resource provisioning in Clouds , 2011, Sci. Program..

[4]  Rajkumar Buyya,et al.  Adaptive workflow scheduling for dynamic grid and cloud computing environment , 2013, Concurr. Comput. Pract. Exp..

[5]  Bo Li,et al.  iAware: Making Live Migration of Virtual Machines Interference-Aware in the Cloud , 2014, IEEE Transactions on Computers.

[6]  Ian J. Taylor,et al.  Workflows and e-Science: An overview of workflow system features and capabilities , 2009, Future Gener. Comput. Syst..

[7]  Hsien-Hsin S. Lee,et al.  Using Mathematical Modeling in Provisioning a Heterogeneous Cloud Computing Environment , 2011, Computer.

[8]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[9]  G. Bruce Berriman,et al.  An Evaluation of the Cost and Performance of Scientific Workflows on Amazon EC2 , 2012, Journal of Grid Computing.

[10]  Fred W. Howell,et al.  Using Java for Discrete Event Simulation , 1996 .

[11]  Ya-Shu Chen,et al.  Online Real-Time Task Scheduling in Heterogeneous Multicore System-on-a-Chip , 2013, IEEE Transactions on Parallel and Distributed Systems.

[12]  Sanjoy K. Baruah,et al.  A Generalized Parallel Task Model for Recurrent Real-time Processes , 2012, 2012 IEEE 33rd Real-Time Systems Symposium.

[13]  Rajkumar Buyya,et al.  Modeling and simulation of scalable Cloud computing environments and the CloudSim toolkit: Challenges and opportunities , 2009, 2009 International Conference on High Performance Computing & Simulation.

[14]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[15]  Dennis Gannon,et al.  Workflows for e-Science, Scientific Workflows for Grids , 2014 .

[16]  Henri Casanova,et al.  Simgrid: a toolkit for the simulation of application scheduling , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[17]  Mike Hibler,et al.  Netbed: an integrated experimental environment , 2002, CCRV.

[18]  Ewa Deelman,et al.  Scientific workflows and clouds , 2010, ACM Crossroads.

[19]  Jason Liu,et al.  An Open and Scalable Emulation Infrastructure for Large-Scale Real-Time Network Simulations , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[20]  Rajkumar Buyya,et al.  A toolkit for modelling and simulating data Grids: an extension to GridSim , 2008, Concurr. Comput. Pract. Exp..

[21]  Radu Prodan,et al.  Using a new event-based simulation framework for investigating resource provisioning in Clouds , 2011, CloudCom 2011.

[22]  Henri Casanova,et al.  Scheduling Parallel Iterative Applications on Volatile Resources , 2011, 2011 IEEE International Parallel & Distributed Processing Symposium.

[23]  Dick H. J. Epema,et al.  Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds , 2013, Future Gener. Comput. Syst..