Cloud Pricing: The Spot Market Strikes Back

Cloud computing providers must constantly hold many idle compute instances available (e.g., for maintenance, or for users with long-term contracts). A natural idea to increase the provider's profit is to sell these idle instances on a spot market where users can be preempted. However, this ignores the possible "market cannibalization'' that may occur in equilibrium. In particular, users who would generate more profit in the provider's existing fixed-price market might move to the spot market and generate less profit. In this paper, we model the provider's profit optimization problem using queuing theory and game theory and analyze the equilibria of the resulting queuing system. Our main result is an easy-to-check condition under which offering a market consisting of fixed-price instances as well as some spot instances (using idle resources) increases the provider's profit over offering only fixed-price instances. Furthermore, we show that under our condition, such a profit increase can always be combined with a Pareto improvement for the users. Finally, we illustrate our results numerically to demonstrate the effects the provider's costs and her strategy have on her profit. Full paper: https://ssrn.com/abstract=3383420

[1]  S. Rosen,et al.  Monopoly and product quality , 1978 .

[2]  Roger B. Myerson,et al.  Optimal Auction Design , 1981, Math. Oper. Res..

[3]  A. Shaked,et al.  Relaxing price competition through product differentiation , 1982 .

[4]  Ronald W. Wolff,et al.  Poisson Arrivals See Time Averages , 1982, Oper. Res..

[5]  A. Unwin,et al.  Introduction to Queueing Theory , 1973 .

[6]  Jeffrey P. Buzen,et al.  The Response Times of Priority Classes under Preemptive Resume in M/M/m Queues , 1983, Oper. Res..

[7]  Jeffrey P. Buzen,et al.  The response times of priority classes under preemptive resume in M/G/m queues , 1984, SIGMETRICS '84.

[8]  E. Maskin,et al.  Monopoly with Incomplete Information , 1984 .

[9]  K. Moorthy Market Segmentation, Self-Selection, and Product Line Design , 1984 .

[10]  M. Armstrong,et al.  Price Discrimination ∗ , 1999 .

[11]  Preyas S. Desai Quality Segmentation in Spatial Markets: When Does Cannibalization Affect Product Line Design? , 2001 .

[12]  Refael Hassin,et al.  To Queue or Not to Queue: Equilibrium Behavior in Queueing Systems , 2002 .

[13]  Bernhard Walke,et al.  Spectrum Requirement Planning in Wireless Communications , 2008 .

[14]  H. Takagi Appendix A: Derivation of Formulas by Queueing Theory , 2008 .

[15]  Zohar Feldman,et al.  Waiting and sojourn times in a multi-server queue with mixed priorities , 2009, Queueing Syst. Theory Appl..

[16]  Scott Shenker,et al.  Delay scheduling: a simple technique for achieving locality and fairness in cluster scheduling , 2010, EuroSys '10.

[17]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[18]  Muli Ben-Yehuda,et al.  Deconstructing Amazon EC2 Spot Instance Pricing , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[19]  Ian A. Kash,et al.  Fixed and market pricing for cloud services , 2012, 2012 Proceedings IEEE INFOCOM Workshops.

[20]  Qian Zhu,et al.  Resource Provisioning with Budget Constraints for Adaptive Applications in Cloud Environments , 2010, IEEE Transactions on Services Computing.

[21]  Moshe Zukerman,et al.  Introduction to Queueing Theory and Stochastic Teletraffic Models , 2013, ArXiv.

[22]  Quanyan Zhu,et al.  Dependable Demand Response Management in the Smart Grid: A Stackelberg Game Approach , 2013, IEEE Transactions on Smart Grid.

[23]  Zongpeng Li,et al.  An online auction framework for dynamic resource provisioning in cloud computing , 2014, SIGMETRICS '14.

[24]  Zongpeng Li,et al.  Dynamic resource provisioning in cloud computing: A randomized auction approach , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[25]  R. Johari,et al.  Pricing in Ride-Share Platforms: A Queueing-Theoretic Approach , 2015 .

[26]  Carlos Riquelme,et al.  Pricing in Ride-Sharing Platforms: A Queueing-Theoretic Approach , 2015, EC.

[27]  Yossi Azar,et al.  Truthful Online Scheduling with Commitments , 2015, EC.

[28]  Yang Chen,et al.  TR-Spark: Transient Computing for Big Data Analytics , 2016, SoCC.

[29]  Carlo Curino,et al.  Morpheus: Towards Automated SLOs for Enterprise Clusters , 2016, OSDI.

[30]  Nicole Immorlica,et al.  On-Demand or Spot? Selling the Cloud to Risk-Averse Customers , 2016, WINE.

[31]  Athanasios V. Vasilakos,et al.  A Framework for Truthful Online Auctions in Cloud Computing with Heterogeneous User Demands , 2016, IEEE Transactions on Computers.

[32]  Liang Zheng,et al.  On the Viability of a Cloud Virtual Service Provider , 2016, SIGMETRICS.

[33]  David E. Irwin,et al.  Cloud Spot Markets are Not Sustainable: The Case for Transient Guarantees , 2016, HotCloud.

[34]  Carlo Curino,et al.  PerfOrator: eloquent performance models for Resource Optimization , 2016, SoCC.

[35]  Ian A. Kash,et al.  Pricing the Cloud , 2016, IEEE Internet Computing.

[36]  Ian A. Kash,et al.  Simple pricing schemes for the cloud , 2017, WINE.

[37]  Adam Wierman,et al.  A Spot Capacity Market to Increase Power Infrastructure Utilization in Multi-Tenant Data Centers , 2017, SIGMETRICS.

[38]  Carlo Curino,et al.  ERA: A Framework for Economic Resource Allocation for the Cloud , 2017, WWW.

[39]  Zongpeng Li,et al.  An Efficient Cloud Market Mechanism for Computing Jobs With Soft Deadlines , 2017, IEEE/ACM Transactions on Networking.

[40]  Morteza Zadimoghaddam,et al.  Overcommitment in Cloud Services Bin packing with Chance Constraints , 2016, SIGMETRICS.

[41]  Ricardo Bianchini,et al.  Resource Central: Understanding and Predicting Workloads for Improved Resource Management in Large Cloud Platforms , 2017, SOSP.

[42]  Sven Seuken,et al.  The Power of Machine Learning and Market Design for Cloud Computing Admission Control , 2018, ArXiv.

[43]  Ian A. Kash,et al.  Bayesian Admission Policies for Cloud Computing Clusters , 2018, 1804.07571.

[44]  Parthasarathy Ranganathan,et al.  The Datacenter as a Computer: Designing Warehouse-Scale Machines, Third Edition , 2018, The Datacenter as a Computer.

[45]  Adam Wierman,et al.  A Spot Capacity Market to Increase Power Infrastructure Utilization in Multi-tenant Data Centers , 2017, 2018 IEEE International Symposium on High Performance Computer Architecture (HPCA).

[46]  Ruta Mehta,et al.  Online Revenue Maximization for Server Pricing , 2019, ArXiv.

[47]  Sven Seuken,et al.  Cloud Pricing: The Spot Market Strikes Back , 2021, SSRN Electronic Journal.

[48]  Huseyin Topaloglu,et al.  When Fixed Price Meets Priority Auctions: Competing Firms with Different Pricing and Service Rules , 2017, Stochastic Systems.

[49]  Sven Seuken,et al.  On the cluster admission problem for cloud computing , 2018, NetEcon@SIGMETRICS.

[50]  The Competitive Effects of Variance-based Pricing , 2020, IJCAI.

[51]  Sven Seuken,et al.  Cloud Pricing: The Spot Market Strikes Back , 2021 .