Comprehensive Review on Divisible Load Theory: Concepts, Strategies, and Approaches

There is extensive literature concerning the divisible load theory. The divisible load theory is mainly applied for scheduling in the area of distributed computing. It is based on the fact that the load can be divided into some arbitrarily independent parts, in which each part can be processed independently by a processor. This paper reviews the literature concerning the divisible load theory, while focusing on the details of the basic concepts, approaches, strategies, typologies, and open problems.

[1]  Hiroshi Watanabe,et al.  Divisible Load Scheduling with Result Collection on Heterogeneous Systems , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[2]  Bharadwaj Veeravalli,et al.  Scheduling divisible loads on heterogeneous linear daisy chain networks with arbitrary processor release times , 2004, IEEE Transactions on Parallel and Distributed Systems.

[3]  Thomas G. Robertazzi,et al.  Ten Reasons to Use Divisible Load Theory , 2003, Computer.

[4]  Thomas G. Robertazzi,et al.  Distributed computation for a tree network with communication delays , 1990 .

[5]  Bharadwaj Veeravalli,et al.  Aligning biological sequences on distributed bus networks: a divisible load scheduling approach , 2005, IEEE Transactions on Information Technology in Biomedicine.

[6]  Hamidah Ibrahim,et al.  Optimal workload allocation model for scheduling divisible data grid applications , 2010, Future Gener. Comput. Syst..

[7]  Thomas G. Robertazzi.  Processor equivalence for daisy chain load sharing processors , 1993 .

[8]  Debasish Ghose,et al.  Multi-installment load distribution in tree networks with delays , 1995 .

[10]  Thomas G. Robertazzi,et al.  Optimal Divisible Load Scheduling and Markov Chain Models , 2003 .

[11]  Henri Casanova,et al.  A realistic network/application model for scheduling divisible loads on large-scale platforms , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.

[12]  Bharadwaj Veeravalli,et al.  Design and performance evaluation of load distribution strategies for multiple divisible loads on heterogeneous linear daisy chain networks , 2005, J. Parallel Distributed Comput..

[13]  Wanliang Wang,et al.  Energy Dependent Divisible Load Theory for Wireless Sensor Network Workload Allocation , 2012 .

[14]  H. V. Jagadish,et al.  Partitioning Techniques for Large-Grained Parallelism , 1988, IEEE Trans. Computers.

[15]  Jacek Blazewicz,et al.  Divisible task scheduling - Concept and verification , 1999, Parallel Comput..

[16]  Arnaud Legrand,et al.  On the Complexity of Multi-Round Divisible Load Scheduling , 2007 .

[17]  T.G. Robertazzi,et al.  Signature search time evaluation in flat file databases , 2008, IEEE Transactions on Aerospace and Electronic Systems.

[18]  Keqin Li.  Accelerating divisible load distribution on tree and pyramid networks using pipelined communications , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[19]  V Bharadwaj,et al.  Scheduling divisible loads in bus networks with arbitrary processor release times , 1996 .

[20]  Debasish Ghose,et al.  Adaptive divisible load scheduling strategies for workstation clusters with unknown network resources , 2005, IEEE Transactions on Parallel and Distributed Systems.

[21]  Mohamed Othman,et al.  Survey on Divisible Load Theory , 2009, 2009 International Association of Computer Science and Information Technology - Spring Conference.

[22]  Dan C. Marinescu,et al.  Algorithms for Divisible Load Scheduling of Data-intensive Applications , 2010, Journal of Grid Computing.

[23]  Hamidah Ibrahim,et al.  An Integrated Approach for Scheduling Divisible Load on Large Scale Data Grids , 2007, ICCSA.

[24]  Sundaram Suresh,et al.  Parallel implementation of back-propagation algorithm in networks of workstations , 2005, IEEE Transactions on Parallel and Distributed Systems.

[25]  Thomas G. Robertazzi,et al.  Closed Form Solutions for Bus and Tree Networks of Processors Load Sharing A Divisible Job , 1993, ICPP.

[26]  Henri Casanova,et al.  Scheduling divisible loads on star and tree networks: results and open problems , 2005, IEEE Transactions on Parallel and Distributed Systems.

[27]  Frederick S. Hillier,et al.  Introduction of Operations Research , 1967 .

[28]  T.G. Robertazzi,et al.  Equal allocation scheduling for data intensive applications , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[29]  Maciej Drozdowski,et al.  Scheduling divisible loads in a three-dimensional mesh of processors , 1999, Parallel Comput..

[30]  Maciej Drozdowski,et al.  THE PERFORMANCE LIMITS OF A TWO-DIMENSIONAL NETWORK OF LOAD-SHARING PROCESSORS , 2011 .

[31]  Subramaniam Shamala,et al.  New method for scheduling heterogeneous multi-installment systems , 2012, Future Gener. Comput. Syst..

[32]  Jitender S. Deogun,et al.  Real-Time Divisible Load Scheduling with Different Processor Available Times , 2007, 2007 International Conference on Parallel Processing (ICPP 2007).

[33]  Thomas G. Robertazzi,et al.  Record Search Time Evaluations Using Divisible Load Analysis , 1998 .

[34]  Maciej Drozdowski,et al.  Scheduling multiple divisible loads in homogeneous star systems , 2008, J. Sched..

[35]  Thomas G. Robertazzi,et al.  Divisible Load Scheduling and Markov Chain Models , 2006, Comput. Math. Appl..

[36]  Debasish Ghose,et al.  Divisible Load Theory: A New Paradigm for Load Scheduling in Distributed Systems , 2004, Cluster Computing.

[37]  Hyoung Joong Kim.  A Novel Optimal Load Distribution Algorithm for Divisible Loads , 2004, Cluster Computing.

[38]  Hamidah Ibrahim,et al.  Adaptive Divisible Load Model for Scheduling Data-Intensive Grid Applications , 2007, International Conference on Computational Science.

[39]  Joanna Berlinska,et al.  Heuristics for multi-round divisible loads scheduling with limited memory , 2010, Parallel Comput..

[40]  Thomas G. Robertazzi,et al.  Grid scheduling divisible loads from two sources , 2009, Comput. Math. Appl..

[41]  Ping Li,et al.  Design and implementation of parallel video encoding strategies using divisible load analysis , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[42]  Daniel Grosu,et al.  A strategy proof mechanism for scheduling divisible loads in bus networks without control processors , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[43]  Bharadwaj Veeravalli,et al.  Efficient Scheduling Strategies for Processing Multiple Divisible Loads on Bus Networks , 2002, J. Parallel Distributed Comput..

[44]  Bharadwaj Veeravalli,et al.  Divisible load scheduling on single-level tree networks with buffer constraints , 2000, IEEE Trans. Aerosp. Electron. Syst..

[45]  Thomas G. Robertazzi,et al.  Optimal time-varying load sharing for divisible loads , 1998 .

[46]  Daniel Grosu,et al.  An incentive-based distributed mechanism for scheduling divisible loads in tree networks , 2012, J. Parallel Distributed Comput..

[47]  Pawel Wolniewicz,et al.  Processing Time and Memory Requirements for Multi-instalment Divisible Job Processing , 2001, PPAM.

[48]  T.G. Robertazzi,et al.  Switching in sequential tree networks , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[49]  M. Moges,et al.  Wireless sensor networks: scheduling for measurement and data reporting , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[50]  Bharadwaj Veeravalli,et al.  Efficient partitioning and scheduling of computer vision and image processing data on bus networks using divisible load analysis , 2000, Image Vis. Comput..

[51]  Mohamed Othman,et al.  Categorizing DLT researches and its applications , 2009 .

[52]  Ngai Ming Kwok,et al.  Adaptive Indexed Divisible Load Theory for Wireless Sensor Network Workload Allocation , 2013, Int. J. Distributed Sens. Networks.

[53]  Jacek Blazewicz,et al.  Scheduling Divisible Jobs on Hypercubes , 1995, Parallel Comput..

[54]  Jacek Blazewicz,et al.  Scheduling a Divisible Task in a Two-dimensional Toroidal Mesh , 1999, Discret. Appl. Math..

[55]  Thomas G. Robertazzi,et al.  An optimum load sharing strategy for divisible jobs with time-varying processor and channel speed , 1995 .

[56]  Thomas G. Robertazzi,et al.  Divisible Load Scheduling with Multiple Sources: Closed Form Solutions , 2005 .

[57]  Thomas G. Robertazzi,et al.  Optimizing Computing Costs Using Divisible Load Analysis , 1998, IEEE Trans. Parallel Distributed Syst..

[58]  Bharadwaj Veeravalli,et al.  Divisible load scheduling strategies on distributed multi-level tree networks with communication delays and buffer constraints , 2004, Comput. Commun..

[59]  Maciej Drozdowski,et al.  Scheduling Multiple Divisible Loads , 2006, Int. J. High Perform. Comput. Appl..

[60]  Jon B. Weissman,et al.  A genetic algorithm based approach for scheduling decomposable data grid applications , 2004, International Conference on Parallel Processing, 2004. ICPP 2004..

[61]  Chi-kin Lee.  Distributed image processing on a network of workstations , 1994 .

[62]  Thomas G. Robertazzi,et al.  Optimal load sharing for a divisible job on a bus network , 1992 .

[63]  Debasish Ghose.  A Feedback Strategy for Load Allocation in Workstation Clusters with Unknown Network Resource Capabilities Using the DLT Paradigm , 2002, PDPTA.

[64]  Bharadwaj Veeravalli,et al.  Scheduling Divisible Loads with Processor Release Times and Finite Size Buffer Capacity Constraints in Bus Networks , 2004, Cluster Computing.

[65]  Thomas G. Robertazzi,et al.  Distributed computation with communication delay (distributed intelligent sensor networks) , 1988 .

[66]  Dantong Yu,et al.  GRID SCHEDULING DIVISIBLE LOADS FROM MULTIPLE SOURCES VIA LINEAR PROGRAMMING , 2004 .

[67]  Bharadwaj Veeravalli,et al.  Theoretical and experimental study on large size image processing applications using divisible load paradigm on distributed bus networks , 2002, Image Vis. Comput..

[68]  Bharadwaj Veeravalli,et al.  Design and Performance Analysis of Divisible Load Scheduling Strategies on Arbitrary Graphs , 2004, Cluster Computing.

[69]  Chi Chung Ko,et al.  Design and analysis of load distribution strategies with start-up costs in scheduling divisible loads on distributed networks , 2000 .

[70]  Maciej Drozdowski,et al.  Multi-installment Divisible Load Processing in Heterogeneous Systems with Limited Memory , 2005, PPAM.

[71]  P. Wolniewicz.  Multi-instalment divisible job processing with communication startup cost , 2002 .

[72]  Keqin Li.  New Divisible Load Distribution Methods using Pipelined Communication Techniques on Tree and Pyramid Networks , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[73]  Joanna Berlinska,et al.  Scheduling divisible MapReduce computations , 2011, J. Parallel Distributed Comput..

[74]  Sundaram Suresh,et al.  The effect of start-up delays in scheduling divisible loads on bus networks: An alternate approach , 2003 .

[75]  Debasish Ghose,et al.  Scheduling Divisible Loads in Parallel and Distributed Systems , 1996 .

[76]  Mohamed Othman,et al.  An Improved Genetic Algorithm for Job Scheduling in Cloud Computing Environment , 2013 .

[77]  Barbara Wasson,et al.  Coordinating Collaborative Knowledge Building , 2003 .

[78]  Thomas G. Robertazzi,et al.  Scheduling nonlinear divisible loads in a single level tree network , 2011, The Journal of Supercomputing.

[79]  V. Mani.  An Equivalent Tree Network Methodology for Efficient Utilization of Front-Ends in Linear Network , 2004, Cluster Computing.

[80]  T.G. Robertazzi,et al.  Scheduling nonlinear computational loads , 2008, IEEE Transactions on Aerospace and Electronic Systems.

[81]  Keqin Li.  Speed-up of Parallel Processing of Divisible Loads on k-dimensional Meshes and Tori , 2003, Comput. J..

[82]  Bharadwaj Veeravalli,et al.  Suboptimal solutions using integer approximation techniques for scheduling divisible loads on distributed bus networks , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[83]  Debasish Ghose,et al.  Foreword (Special Issue of Cluster Computing on Divisible Load Scheduling) , 2004, Cluster Computing.

[84]  Henri Casanova,et al.  RUMR: robust scheduling for divisible workloads , 2003, High Performance Distributed Computing, 2003. Proceedings. 12th IEEE International Symposium on.

[85]  Debasish Ghose,et al.  Optimal Sequencing and Arrangement in Distributed Single-Level Tree Networks with Communication Delays , 1994, IEEE Trans. Parallel Distributed Syst..

[86]  Jitender S. Deogun,et al.  Real-time scheduling of divisible loads in cluster computing environments , 2010, J. Parallel Distributed Comput..

[87]  Keqin Li.  Improved methods for divisible load distribution on k-dimensional meshes using pipelined communications , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[88]  Hiroshi Watanabe,et al.  SPORT: An Algorithm for Divisible Load Scheduling with Result Collection on Heterogeneous Systems , 2008, IEICE Trans. Commun..

[89]  Bharadwaj Veeravalli,et al.  On the Influence of Start-Up Costs in Scheduling Divisible Loads on Bus Networks , 2000, IEEE Trans. Parallel Distributed Syst..

[90]  Jitender S. Deogun,et al.  Scheduling real-time divisible loads with advance reservations , 2011, Real-Time Systems.

[91]  Pawel Wolniewicz,et al.  Optimum divisible load scheduling on heterogeneous stars with limited memory , 2006, Eur. J. Oper. Res..

[92]  Bharadwaj Veeravalli,et al.  Access Time Minimization for Distributed Multimedia Applications , 2000, Multimedia Tools and Applications.

[93]  Daniel Grosu,et al.  A Strategyproof Mechanism for Scheduling Divisible Loads in Distributed Systems , 2005, The 4th International Symposium on Parallel and Distributed Computing (ISPDC'05).

[94]  Daniel Grosu,et al.  Divisible Load Scheduling: An Approach Using Coalitional Games , 2007, Sixth International Symposium on Parallel and Distributed Computing (ISPDC'07).

[95]  Keqin Li.  Parallel Processing of Divisible Loads on Partitionable Static Interconnection Networks , 2004, Cluster Computing.

[96]  Guangwen Yang,et al.  Scheduling divisible loads in the dynamic heterogeneous grid environment , 2006, InfoScale '06.

[97]  Thomas G. Robertazzi,et al.  A Multi-Job Load Sharing Strategy for Divisible Jobs on Bus Networks , 1993 .

[98]  Yves Robert,et al.  Scheduling divisible workloads on heterogeneous platforms , 2003, Parallel Comput..

[99]  T.G. Robertazzi,et al.  Multi-Source Grid Scheduling for Divisible Loads , 2006, 2006 40th Annual Conference on Information Sciences and Systems.

[100]  Suriayati Chuprat.  Divisible load scheduling of real-time task on heterogeneous clusters , 2010, 2010 International Symposium on Information Technology.

[101]  Mohamed Othman,et al.  Multi-Criteria Based Algorithm for Scheduling Divisible Load , 2013, DaEng.

[102]  Thomas G. Robertazzi.  Networks and grids - technology and theory , 2007, Information technology.

[103]  Dantong Yu,et al.  Data Intensive Grid Scheduling: Multiple Sources with Capacity Constraints , 2003 .

[104]  Chih-Ping Chu,et al.  Improved Methods for Divisible Load Distribution on k-Dimensional Meshes Using Multi-Installment , 2007, IEEE Transactions on Parallel and Distributed Systems.

[105]  Daniel Grosu,et al.  A Strategyproof Mechanism for Scheduling Divisible Loads in Linear Networks , 2005 .

[106]  Debasish Ghose,et al.  Multi-installment load distribution strategy in linear networks with communication delays , 1995 .

[107]  Jitender S. Deogun,et al.  Real-Time Divisible Load Scheduling with Different Processor Available Times , 2007, ICPP.

[108]  Maciej Drozdowski,et al.  Performance limits of divisible load processing in systems with limited communication buffers , 2004, J. Parallel Distributed Comput..

[109]  H.,et al.  Divisible Load Scheduling in Single-Level Tree Networks : Optimal Sequencing and Arrangement in the Nonblocking Mode of Communication , 2004 .

[110]  Mounir Hamdi,et al.  Parallel Image Processing Applications on a Network of Workstations , 1995, Parallel Comput..

[111]  Bharadwaj Veeravalli,et al.  Scheduling Multisource Divisible Loads on Arbitrary Networks , 2010, IEEE Transactions on Parallel and Distributed Systems.

[112]  Bharadwaj Veeravalli,et al.  Divisible load scheduling on a hypercube cluster with finite-size buffers and granularity constraints , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[113]  Debasish Ghose,et al.  Large matrix-vector products on distributed bus networks with communication delays using the divisible load paradigm: performance analysis and simulation , 2001, Math. Comput. Simul..

[114]  Bharadwaj Veeravalli,et al.  PPDD: scheduling multi-site divisible loads in single-level tree networks , 2010, Cluster Computing.

[115]  E. Haddad.  Runtime reallocation of divisible load under processor execution deadlines , 1995, Proceedings of Third Workshop on Parallel and Distributed Real-Time Systems.