Scheduling in compute cloud with multiple data banks using divisible load paradigm

The main challenge in a compute cloud system is to design a scheduling strategy for heterogeneous computing resources with shared data banks. The cloud user's job arrives at the Web role, which distributes the load to the worker rules for concurrent processing. The worker role retrieves the respective data from the shared data banks. According to divisible load theory, the scheduling problem is formulated as relevant recursive equations and constraints that are derived from the continuity of processing time due to retrieval from multiple data banks. The scheduling problem in a compute cloud is formulated as a linear programming problem. Finally, we present a satellite image classification problem in a compute cloud as an example to show the adequacy of the proposed solution.

[1]  Yike Guo,et al.  Optimization of Resource Scheduling in Cloud Computing , 2010, 2010 12th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing.

[2]  Sundaram Suresh,et al.  Divisible load scheduling in distributed system with buffer constraints: genetic algorithm and linear programming approach , 2006, Int. J. Parallel Emergent Distributed Syst..

[3]  Bharadwaj Veeravalli,et al.  On the Influence of Start-Up Costs in Scheduling Divisible Loads on Bus Networks , 2000, IEEE Trans. Parallel Distributed Syst..

[4]  Thomas G. Robertazzi,et al.  Distributed Scheduling of Nonlinear Computational Loads , 2003 .

[5]  Dantong Yu,et al.  Data Intensive Grid Scheduling: Multiple Sources with Capacity Constraints , 2003 .

[6]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .

[7]  V Bharadwaj,et al.  Scheduling divisible loads in bus networks with arbitrary processor release times , 1996 .

[8]  Marlon E. Pierce,et al.  BioVLAB-Microarray: Microarray Data Analysis in Virtual Environment , 2008, 2008 IEEE Fourth International Conference on eScience.

[9]  Thomas G. Robertazzi,et al.  Ten Reasons to Use Divisible Load Theory , 2003, Computer.

[10]  Jianhua Gu,et al.  A Scheduling Strategy on Load Balancing of Virtual Machine Resources in Cloud Computing Environment , 2010, 2010 3rd International Symposium on Parallel Architectures, Algorithms and Programming.

[11]  T.G. Robertazzi,et al.  Switching in sequential tree networks , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[12]  Sundaram Suresh,et al.  Parallel implementation of back-propagation algorithm in networks of workstations , 2005, IEEE Transactions on Parallel and Distributed Systems.

[13]  T.G. Robertazzi,et al.  Equal allocation scheduling for data intensive applications , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[14]  Sundaram Suresh,et al.  A Real Coded Genetic Algorithm for Data Partitioning and Scheduling in Networks with Arbitrary Processor Release Time , 2005, Asia-Pacific Computer Systems Architecture Conference.

[15]  Thomas G. Robertazzi,et al.  Bus-oriented load sharing for a network of sensor driven processors , 1991, IEEE Trans. Syst. Man Cybern..

[16]  Young-Il Kim,et al.  Scheduling Second-Order Computational Load in Master-Slave Paradigm , 2012, IEEE Transactions on Aerospace and Electronic Systems.

[17]  Sundaram Suresh,et al.  Sequential Projection-Based Metacognitive Learning in a Radial Basis Function Network for Classification Problems , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[18]  M Mahalakshmi,et al.  Compute and storage clouds using wide area high performance networks , 2016 .

[19]  Debasish Ghose,et al.  Foreword (Special Issue of Cluster Computing on Divisible Load Scheduling) , 2004, Cluster Computing.

[20]  S. Mohammadi,et al.  Distributed image processing scheduling in heterogeneous computing network systems , 2012, 2012 9th France-Japan & 7th Europe-Asia Congress on Mechatronics (MECATRONICS) / 13th Int'l Workshop on Research and Education in Mechatronics (REM).

[21]  Jaafar M. H. Elmirghani,et al.  Distributed storage scenario in a wide area WDM mesh architecture under heterogeneous traffic , 2009, 2009 International Conference on Optical Network Design and Modeling.

[22]  D. Daniel,et al.  A novel approach for scheduling service request in cloud with trust monitor , 2011, 2011 International Conference on Signal Processing, Communication, Computing and Networking Technologies.

[23]  V. Mani,et al.  Divisible load scheduling in single-level tree networks: Optimal sequencing and arrangement in the nonblocking mode of communication , 2003 .

[24]  P. Mell,et al.  The NIST Definition of Cloud Computing , 2011 .

[25]  Arnaud Legrand,et al.  On the Complexity of Multi-Round Divisible Load Scheduling , 2007 .

[26]  Bharadwaj Veeravalli,et al.  Divisible load scheduling on single-level tree networks with buffer constraints , 2000, IEEE Trans. Aerosp. Electron. Syst..

[27]  Rajkumar Buyya,et al.  A Particle Swarm Optimization-Based Heuristic for Scheduling Workflow Applications in Cloud Computing Environments , 2010, 2010 24th IEEE International Conference on Advanced Information Networking and Applications.

[28]  Hamidah Ibrahim,et al.  A2DLT: Divisible Load Balancing Model for Scheduling Communication-Intensive Grid Applications , 2008, ICCS.

[29]  Bharadwaj Veeravalli,et al.  Divisible load scheduling on a hypercube cluster with finite-size buffers and granularity constraints , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[30]  Thomas G. Robertazzi,et al.  Distributed computation for a tree network with communication delays , 1990 .

[31]  Hiroaki Kobayashi,et al.  A History-Based Job Scheduling Mechanism for the Vector Computing Cloud , 2010, 2010 10th IEEE/IPSJ International Symposium on Applications and the Internet.

[32]  Ting-lei Huang,et al.  An optimistic job scheduling strategy based on QoS for Cloud Computing , 2010, 2010 International Conference on Intelligent Computing and Integrated Systems.

[33]  Thomas G. Robertazzi,et al.  Distributed computation with communication delay (distributed intelligent sensor networks) , 1988 .

[34]  Thomas G. Robertazzi,et al.  Scheduling nonlinear divisible loads in a single level tree network , 2011, The Journal of Supercomputing.

[35]  Shamsollah Ghanbari,et al.  Comprehensive Review on Divisible Load Theory: Concepts, Strategies, and Approaches , 2014 .

[36]  Naixue Xiong,et al.  Scheduling Parallel Cloud Computing Services: An Evolutional Game , 2009, 2009 First International Conference on Information Science and Engineering.

[37]  Sundaram Suresh,et al.  An equivalent network for divisible load scheduling in nonblocking mode of communication , 2005 .

[38]  Guiyi Wei,et al.  GA-Based Task Scheduler for the Cloud Computing Systems , 2010, 2010 International Conference on Web Information Systems and Mining.

[39]  Hamidah Ibrahim,et al.  Adaptive Divisible Load Model for Scheduling Data-Intensive Grid Applications , 2007, International Conference on Computational Science.

[40]  Hamidah Ibrahim,et al.  Optimal workload allocation model for scheduling divisible data grid applications , 2010, Future Gener. Comput. Syst..

[41]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[42]  Junfeng Yao,et al.  Cloud computing and its key techniques , 2011, Proceedings of 2011 International Conference on Electronic & Mechanical Engineering and Information Technology.

[43]  Bharadwaj Veeravalli,et al.  On Handling Large-Scale Polynomial Multiplications in Compute Cloud Environments using Divisible Load Paradigm , 2012, IEEE Transactions on Aerospace and Electronic Systems.

[44]  Sundaram Suresh,et al.  The effect of start-up delays in scheduling divisible loads on bus networks: An alternate approach , 2003 .

[45]  Debasish Ghose,et al.  Scheduling Divisible Loads in Parallel and Distributed Systems , 1996 .

[46]  Thomas G. Robertazzi,et al.  Greedy Signature Processing with Arbitrary Location Distributions: A Divisible Load Framework , 2012, IEEE Transactions on Aerospace and Electronic Systems.

[47]  Narasimhan Sundararajan,et al.  A new load distribution strategy for linear network with communication delays , 2009, Math. Comput. Simul..

[48]  Sundaram Suresh,et al.  Parallel Video Processing Using Divisible Load Scheduling Paradigm , 2005 .