Modeling and Performance Analysis to Predict the Behavior of a Divisible Load Application in a Cloud Computing Environment

Cloud computing is an emerging technology where IT resources are virtualized to users as a set of a unified computing resources on a pay per use basis. The resources are dynamically chosen to satisfy a user Service Level Agreement and a required level of performance. Divisible load applications occur in many scientific and engineering applications and can easily be mapped to a Cloud using a master-worker pattern. However, those applications pose challenges to obtain the required performance. We model divisible load applications tasks processing on a set of cloud resources. We derive a novel model and formulas for computing the blocking probability in the system. The formulas are useful to analyze and predict the behavior of a divisible load application on a chosen set of resources to satisfy a Service Level Agreement before the implementation phase, thus saving time and platform energy. They are also useful as a dynamic feedback to a cloud scheduler for optimal scheduling. We evaluate the model in a set of illustrative scenarios.

[1]  K. Shadan,et al.  Available online: , 2012 .

[2]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[3]  Leila Ismail,et al.  Performance Evaluation of Convolution on the Cell Broadband Engine Processor , 2011, IEEE Transactions on Parallel and Distributed Systems.

[4]  Yakup Paker,et al.  Optimal Scheduling Algorithms for Communication Constrained Parallel Processing , 2002, Euro-Par.

[5]  Rajeev Barua,et al.  Implementation and performance evaluation of a distributed conjugate gradient method in a cloud computing environment , 2013, Softw. Pract. Exp..

[6]  Emmanuel Medernach,et al.  Workload Analysis of a Cluster in a Grid Environment , 2005, JSSPP.

[7]  Christopher John Young,et al.  An Automatic, Adaptive Algorithm for Refining Phase Picks in Large Seismic Data Sets , 2002 .

[8]  Rajkumar Buyya,et al.  High-Performance Cloud Computing: A View of Scientific Applications , 2009, 2009 10th International Symposium on Pervasive Systems, Algorithms, and Networks.

[9]  Henri Casanova,et al.  Multiround algorithms for scheduling divisible loads , 2005, IEEE Transactions on Parallel and Distributed Systems.

[10]  Ian Foster,et al.  Designing and building parallel programs , 1994 .

[11]  J.W. Manke,et al.  Parallel computing in aerospace , 2001, Parallel Comput..

[12]  Henri Casanova,et al.  Scheduling divisible loads on star and tree networks: results and open problems , 2005, IEEE Transactions on Parallel and Distributed Systems.

[13]  Debasish Ghose,et al.  Multi-installment load distribution in tree networks with delays , 1995 .

[14]  Rajkumar Buyya,et al.  Market-Oriented Cloud Computing: Vision, Hype, and Reality for Delivering IT Services as Computing Utilities , 2008, 2008 10th IEEE International Conference on High Performance Computing and Communications.

[15]  Debasish Ghose,et al.  Foreword (Special Issue of Cluster Computing on Divisible Load Scheduling) , 2004, Cluster Computing.

[16]  Bharadwaj Veeravalli,et al.  Theoretical and experimental study on large size image processing applications using divisible load paradigm on distributed bus networks , 2002, Image Vis. Comput..

[17]  Pawel Wolniewicz,et al.  Experiments with Scheduling Divisible Tasks in Clusters of Workstations , 2000, Euro-Par.

[18]  Leila Ismail,et al.  A Formal Model of Dynamic Resource Allocation in Grid Computing Environment , 2008, 2008 Ninth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing.

[19]  Mohamed Othman,et al.  Categorizing DLT researches and its applications , 2009 .

[20]  Dan C. Marinescu,et al.  Algorithms for Divisible Load Scheduling of Data-intensive Applications , 2010, Journal of Grid Computing.

[21]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[22]  Debasish Ghose,et al.  Divisible Load Theory: A New Paradigm for Load Scheduling in Distributed Systems , 2004, Cluster Computing.

[23]  D. Turgay Altilar,et al.  An optimal scheduling algorithm for parallel video processing , 1998, Proceedings. IEEE International Conference on Multimedia Computing and Systems (Cat. No.98TB100241).

[24]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .

[25]  Maciej Drozdowski,et al.  Multi-installment Divisible Load Processing in Heterogeneous Systems with Limited Memory , 2005, PPAM.

[26]  Mounir Hamdi,et al.  Parallel Image Processing Applications on a Network of Workstations , 1995, Parallel Comput..