Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility

With the significant advances in Information and Communications Technology (ICT) over the last half century, there is an increasingly perceived vision that computing will one day be the 5th utility (after water, electricity, gas, and telephony). This computing utility, like all other four existing utilities, will provide the basic level of computing service that is considered essential to meet the everyday needs of the general community. To deliver this vision, a number of computing paradigms have been proposed, of which the latest one is known as Cloud computing. Hence, in this paper, we define Cloud computing and provide the architecture for creating Clouds with market-oriented resource allocation by leveraging technologies such as Virtual Machines (VMs). We also provide insights on market-based resource management strategies that encompass both customer-driven service management and computational risk management to sustain Service Level Agreement (SLA)-oriented resource allocation. In addition, we reveal our early thoughts on interconnecting Clouds for dynamically creating global Cloud exchanges and markets. Then, we present some representative Cloud platforms, especially those developed in industries, along with our current work towards realizing market-oriented resource allocation of Clouds as realized in Aneka enterprise Cloud technology. Furthermore, we highlight the difference between High Performance Computing (HPC) workload and Internet-based services workload. We also describe a meta-negotiation infrastructure to establish global Cloud exchanges and markets, and illustrate a case study of harnessing 'Storage Clouds' for high performance content delivery. Finally, we conclude with the need for convergence of competing IT paradigms to deliver our 21st century vision.

[1]  Doug Johnson,et al.  Computing in the Clouds. , 2010 .

[2]  Ian T. Foster,et al.  SNAP: A Protocol for Negotiating Service Level Agreements and Coordinating Resource Management in Distributed Systems , 2002, JSSPP.

[3]  Ian T. Foster,et al.  Virtual workspaces: Achieving quality of service and quality of life in the Grid , 2005, Sci. Program..

[4]  Aleksandar Kuzmanovic,et al.  Drafting behind Akamai (travelocity-based detouring) , 2006, SIGCOMM '06.

[5]  ZhangLi,et al.  Analysis and characterization of large-scale Web server access patterns and performance , 1999 .

[6]  Rajkumar Buyya,et al.  High Performance Cluster Computing , 1999 .

[7]  B. Schneider,et al.  Service Quality: Research Perspectives , 2003 .

[8]  P. Altena,et al.  In search of clusters , 2007 .

[9]  Raymond Turner,et al.  Specification , 2011, Minds and Machines.

[10]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Autonomic Metered Pricing for a Utility Computing Service , 2022 .

[11]  Rajkumar Buyya,et al.  Market-oriented Grids and Utility Computing: The State-of-the-art and Future Directions , 2008, Journal of Grid Computing.

[12]  Jon Howell,et al.  Handling Flash Crowds from Your Garage , 2008, USENIX Annual Technical Conference.

[13]  Randy H. Katz,et al.  Improving MapReduce Performance in Heterogeneous Environments , 2008, OSDI.

[14]  Rajkumar Buyya,et al.  MapReduce Programming Model for . NET-based Distributed Computing , 2008 .

[15]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[16]  Rajkumar Buyya,et al.  A Negotiation Mechanism for Advance Resource Reservations Using the Alternate Offers Protocol , 2008, 2008 16th Interntional Workshop on Quality of Service.

[17]  Andrew A. Chien,et al.  Entropia: architecture and performance of an enterprise desktop grid system , 2003, J. Parallel Distributed Comput..

[18]  Rajkumar Buyya,et al.  A Grid service broker for scheduling e‐Science applications on global data Grids , 2006, Concurr. Comput. Pract. Exp..

[19]  David E. Irwin,et al.  Balancing risk and reward in a market-based task service , 2004, Proceedings. 13th IEEE International Symposium on High performance Distributed Computing, 2004..

[20]  David Abramson,et al.  A Computational Economy for Grid Computing and its Implementation in the Nimrod-G Resource Brok , 2001, Future Gener. Comput. Syst..

[21]  Rajkumar Buyya,et al.  Pricing for Utility-Driven Resource Management and Allocation in Clusters , 2007, Int. J. High Perform. Comput. Appl..

[22]  Eugene Ciurana,et al.  Google App Engine , 2009 .

[23]  Gregory F. Pfister,et al.  In Search of Clusters , 1995 .

[24]  B. Looy,et al.  Service management : an integrated approach , 2013 .

[25]  Florian Schintke,et al.  Peer-to-Peer Computing , 2010, Euro-Par.

[26]  Robert R. Moeller,et al.  COSO Enterprise Risk Management: Understanding the New Integrated ERM Framework , 2007 .

[27]  Ivona Brandic,et al.  Specification, planning, and execution of QoS‐aware Grid workflows within the Amadeus environment , 2008, Concurr. Comput. Pract. Exp..

[28]  David E. Irwin,et al.  Sharing Networked Resources with Brokered Leases , 2006, USENIX Annual Technical Conference, General Track.

[29]  Amin Vahdat,et al.  SHARP: an architecture for secure resource peering , 2003, SOSP '03.

[30]  Zahir Tari,et al.  MetaCDN: Harnessing 'Storage Clouds' for high performance content delivery , 2009, J. Netw. Comput. Appl..

[31]  Bruce M. Maggs Global internet content delivery , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[32]  Ivona Brandic,et al.  Specification, planning, and execution of QoS-aware Grid workflows within the Amadeus environment , 2008 .

[33]  Johan Tordsson,et al.  A Grid Resource Broker Supporting Advance Reservations and Benchmark-Based Resource Selection , 2004, PARA.

[34]  Amin Vahdat,et al.  Resource Allocation in Federated Distributed Computing Infrastructures , 2004 .

[35]  Rajkumar Buyya,et al.  Weaving computational grids: how analogous are they with electrical grids? , 2002, Comput. Sci. Eng..

[36]  David Abramson,et al.  The Grid Economy , 2005, Proceedings of the IEEE.

[37]  Rajkumar Buyya,et al.  Integrated Risk Analysis for a Commercial Computing Service , 2007, IPDPS.

[38]  Rajkumar Buyya,et al.  Aneka: Next-Generation Enterprise Grid Platform for e-Science and e-Business Applications , 2007, Third IEEE International Conference on e-Science and Grid Computing (e-Science 2007).

[39]  Venkata N. Padmanabhan,et al.  The Case for Cooperative Networking , 2002, IPTPS.

[40]  Li Zhang,et al.  Tycoon: An implementation of a distributed, market-based resource allocation system , 2004, Multiagent Grid Syst..

[41]  Rajkumar Buyya,et al.  Power Aware Scheduling of Bag-of-Tasks Applications with Deadline Constraints on DVS-enabled Clusters , 2007, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).

[42]  Martin Arlitt,et al.  Workload Characterization of the 1998 World Cup Web Site , 1999 .

[43]  R. Buyya,et al.  Towards a Meta-Negotiation Architecture for SLA-Aware Grid Services , 2008 .

[44]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[45]  Rajkumar Buyya,et al.  High Performance Cluster Computing: Architectures and Systems , 1999 .

[46]  Jan Broeckhove,et al.  A commodity market algorithm for pricing substitutable Grid resources , 2007, Future Gener. Comput. Syst..

[47]  Martin Arlitt,et al.  A workload characterization study of the 1998 World Cup Web site , 2000, IEEE Netw..

[48]  E. Rametsteiner,et al.  Austria , 1980, The Lancet.

[49]  Stephen Horn,et al.  Essentials of Risk Management , 1985 .