Resource-provision scheduling in cloud datacenter

Abstract. Cloud computing, the long-held dream of computing as a utility, has the potential to transform a large part of the IT industry, making software even more attractive as a service and shaping the way in which hardware is designed and purchased. We review the new cloud computing technologies, and indicate the main challenges for their development in future, among which resource management problem stands out and attracts our attention. Combining the current scheduling theories, we propose cloud scheduling hierarchy to deal with different requirements of cloud services. we settle the evaluation problem for on-line schedulability tests in cloud computing. We propose a concept of test reliability to express the probability that a random task set could pass a given schedulability test. The larger the probability is, the more reliable the test is. From the aspect of system, a test with high reliability can guarantee high system utilization. From the practical aspect, we develop a simulator to model MapReduce framework. This simulator offers a simulated environment directly used by MapReduce theoretical researchers. The users of SimMapReduce only concentrate on specific research issues without getting concerned about finer implementation details for diverse service models, so that they can accelerate study progress of new cloud technologies.

[1]  Artur Andrzejak,et al.  Reducing Costs of Spot Instances via Checkpointing in the Amazon Elastic Compute Cloud , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[2]  S Ravichandran,et al.  Dynamic Scheduling of Data Using Genetic Algorithm in Cloud Computing , 2013 .

[3]  Rajkumar Buyya,et al.  Modeling and simulation of scalable Cloud computing environments and the CloudSim toolkit: Challenges and opportunities , 2009, 2009 International Conference on High Performance Computing & Simulation.

[4]  Jan Broeckhove,et al.  A commodity market algorithm for pricing substitutable Grid resources , 2007, Future Gener. Comput. Syst..

[5]  Robert Gibbons,et al.  A primer in game theory , 1992 .

[6]  David E. Culler,et al.  User-Centric Performance Analysis of Market-Based Cluster Batch Schedulers , 2002, 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGRID'02).

[7]  Ric D. Herbert,et al.  Auction resource allocation mechanisms in grids of heterogeneous computers , 2009 .

[8]  Chunyan Miao,et al.  Market Based Resource Allocation with Incomplete Information , 2007, IJCAI.

[9]  Nicholas R. Jennings,et al.  The Evolution of the Grid , 2003 .

[10]  Naixue Xiong,et al.  A game-theoretic method of fair resource allocation for cloud computing services , 2010, The Journal of Supercomputing.

[11]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .

[12]  Fei Teng,et al.  A New Game Theoretical Resource Allocation Algorithm for Cloud Computing , 2010, GPC.

[13]  Can C. Özturan,et al.  Resource bartering in data grids , 2004, Sci. Program..

[14]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[15]  David Abramson,et al.  Economic models for resource management and scheduling in Grid computing , 2002, Concurr. Comput. Pract. Exp..

[16]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[17]  Tamer Basar,et al.  Computational Markets to Regulate Mobile-Agent Systems , 2003, Autonomous Agents and Multi-Agent Systems.

[18]  Salim Hariri,et al.  Autonomic Computing: An Overview , 2004, UPP.

[19]  T. Başar,et al.  Nash Equilibrium and Decentralized Negotiation in Auctioning Divisible Resources , 2003 .

[20]  Frédéric Magoulès,et al.  Autonomic Data Management System in Grid Environment , 2009 .

[21]  Ian T. Foster,et al.  The Anatomy of the Grid: Enabling Scalable Virtual Organizations , 2001, Int. J. High Perform. Comput. Appl..

[22]  Naixue Xiong,et al.  Game and Balance Multicast Architecture Algorithms for Sensor Grid , 2009, 2011 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[23]  Ishfaq Ahmad,et al.  Non-cooperative, semi-cooperative, and cooperative games-based grid resource allocation , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[24]  Pablo Chacin,et al.  A catallactic market for data mining services , 2007, Future Gener. Comput. Syst..

[25]  Shanshan Song,et al.  Selfish grid computing: game-theoretic modeling and NAS performance results , 2005, CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005..

[26]  Nicholas R. Jennings,et al.  Market-Based Call Routing in Telecommunications Networks Using Adaptive Pricing and Real Bidding , 1999, IATA.

[27]  Tuomas Sandholm,et al.  Distributed rational decision making , 1999 .

[28]  Kristina Lerman,et al.  Resource allocation games with changing resource capacities , 2003, AAMAS '03.

[29]  Richard Mortier,et al.  An economic approach to adaptive resource management , 1999, Proceedings of the Seventh Workshop on Hot Topics in Operating Systems.