Online Linear Optimization with Inventory Management Constraints

This paper considers the problem of online linear optimization with inventory management constraints. Specifically, we consider an online scenario where a decision maker needs to satisfy her time-varying demand for some units of an asset, either from a market with a time-varying price or from her own inventory. In each time slot, the decision maker is presented a (linear) price and must immediately decide the amount to purchase for covering the demand and/or for storing in the inventory for future use. The inventory has a limited capacity and can be used to buy and store assets at low price and cover the demand when the price is high. The ultimate goal of the decision maker is to cover the demand at each time slot while minimizing the cost of buying assets from the market. We propose ARP, an online algorithm for linear programming with inventory constraints, and ARPRate, an extended version that handles rate constraints to/from the inventory. Both ARP and ARPRate achieve optimal competitive ratios, meaning that no other online algorithm can achieve a better theoretical guarantee. To illustrate the results, we use the proposed algorithms in a case study focused on energy procurement and storage management strategies for data centers.

[1]  Wei Sun,et al.  Data center energy systems: Current technology and future direction , 2015, 2015 IEEE Power & Energy Society General Meeting.

[2]  Friedhelm Meyer auf der Heide,et al.  Online Facility Location with Mobile Facilities , 2018, SPAA.

[3]  Anand Sivasubramaniam,et al.  Optimal power cost management using stored energy in data centers , 2011, PERV.

[4]  Baruch Awerbuch,et al.  Online linear optimization and adaptive routing , 2008, J. Comput. Syst. Sci..

[5]  Nicole Immorlica,et al.  Online auctions and generalized secretary problems , 2008, SECO.

[6]  Baochun Li,et al.  Reducing electricity demand charge for data centers with partial execution , 2013, e-Energy.

[7]  Elad Hazan,et al.  Introduction to Online Convex Optimization , 2016, Found. Trends Optim..

[8]  Nimrod Megiddo,et al.  Improved algorithms and analysis for secretary problems and generalizations , 1995, Proceedings of IEEE 36th Annual Foundations of Computer Science.

[9]  Ramesh K. Sitaraman,et al.  Using batteries to reduce the power costs of internet-scale distributed networks , 2012, SoCC '12.

[10]  Anand Sivasubramaniam,et al.  Aggressive Datacenter Power Provisioning with Batteries , 2013, TOCS.

[11]  Ramesh K. Sitaraman,et al.  The Akamai network: a platform for high-performance internet applications , 2010, OPSR.

[12]  Adam Wierman,et al.  Datum: Managing Data Purchasing and Data Placement in a Geo-Distributed Data Market , 2018, IEEE/ACM Transactions on Networking.

[13]  Ran El-Yaniv,et al.  Optimal Search and One-Way Trading Online Algorithms , 2001, Algorithmica.

[14]  Minghua Chen,et al.  Crowd-Sourced Storage-Assisted Demand Response in Microgrids , 2017, e-Energy.

[15]  Lachlan L. H. Andrew,et al.  Dynamic Right-Sizing for Power-Proportional Data Centers , 2011, IEEE/ACM Transactions on Networking.

[16]  Dennis Komm,et al.  The online knapsack problem: Advice and randomization , 2014, Theor. Comput. Sci..

[17]  Ramesh K. Sitaraman,et al.  Learning from Optimal: Energy Procurement Strategies for Data Centers , 2019, e-Energy.

[18]  Wing Shing Wong,et al.  An Optimal Algorithm for Online Non-Convex Learning , 2018, SIGMETRICS.

[19]  Luiz André Barroso,et al.  The Case for Energy-Proportional Computing , 2007, Computer.

[20]  Anand Sivasubramaniam,et al.  Energy storage in datacenters: what, where, and how much? , 2012, SIGMETRICS '12.

[21]  Zongpeng Li,et al.  An online procurement auction for power demand response in storage-assisted smart grids , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[22]  Susanne Albers,et al.  On Energy Conservation in Data Centers , 2017, SPAA.

[23]  Kai Ma,et al.  Exploiting thermal energy storage to reduce data center capital and operating expenses , 2014, 2014 IEEE 20th International Symposium on High Performance Computer Architecture (HPCA).

[24]  Ness B. Shroff,et al.  Optimal Online Scheduling With Arbitrary Hard Deadlines in Multihop Communication Networks , 2016, IEEE/ACM Transactions on Networking.

[25]  Dror Rawitz,et al.  Online Generalized Caching with Varying Weights and Costs , 2018, SPAA.

[26]  Yuguang Fang,et al.  Electricity Cost Saving Strategy in Data Centers by Using Energy Storage , 2013, IEEE Transactions on Parallel and Distributed Systems.

[27]  Joseph Naor,et al.  Online Primal-Dual Algorithms for Covering and Packing , 2009, Math. Oper. Res..

[28]  Deshi Ye,et al.  Online frequency allocation in cellular networks , 2007, SPAA '07.

[29]  Yasuo Okabe,et al.  A tight bound on online buffer management for two-port shared-memory switches , 2007, SPAA '07.

[30]  Jean C. Walrand,et al.  Optimal demand response with energy storage management , 2012, 2012 IEEE Third International Conference on Smart Grid Communications (SmartGridComm).

[31]  Konstantinos Panagiotou,et al.  Optimal Algorithms for k-Search with Application in Option Pricing , 2007, Algorithmica.

[32]  Eilyan Bitar,et al.  Risk-Sensitive Learning and Pricing for Demand Response , 2016, IEEE Transactions on Smart Grid.

[33]  Zongpeng Li,et al.  Incentivizing Device-to-Device Load Balancing for Cellular Networks: An Online Auction Design , 2017, IEEE Journal on Selected Areas in Communications.

[34]  Adam Wierman,et al.  Energy Portfolio Optimization of Data Centers , 2017, IEEE Transactions on Smart Grid.

[35]  Aron P. Dobos,et al.  PVWatts Version 5 Manual , 2014 .

[36]  Qi Zhu,et al.  Peak-Aware Online Economic Dispatching for Microgrids , 2015, IEEE Transactions on Smart Grid.

[37]  Wing Shing Wong,et al.  An Optimal Randomized Online Algorithm for QoS Buffer Management , 2017, Proc. ACM Meas. Anal. Comput. Syst..

[38]  Lin Yang,et al.  Competitive online algorithms for geographical load balancing in data centers with energy storage , 2016, E2DC@e-Energy.

[39]  Minghua Chen,et al.  Online microgrid energy generation scheduling revisited: the benefits of randomization and interval prediction , 2016, e-Energy.

[40]  Noël Crespi,et al.  Competitive Online Scheduling Algorithms with Applications in Deadline-Constrained EV Charging , 2018, 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS).

[41]  Susanne Albers,et al.  Optimal Algorithms for Right-Sizing Data Centers , 2018, SPAA.

[42]  Esther Mohr,et al.  Online algorithms for conversion problems: A survey , 2014 .

[43]  Xue Liu,et al.  Comprehensive understanding of operation cost reduction using energy storage for IDCs , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[44]  Lin Yang,et al.  Online Linear Programming with Uncertain Constraints , 2019 .

[45]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 2005, IEEE Transactions on Neural Networks.

[46]  Laurent Massoulié,et al.  Optimal Control of End-User Energy Storage , 2012, IEEE Transactions on Smart Grid.

[47]  Allan Borodin,et al.  Online computation and competitive analysis , 1998 .

[48]  Zongpeng Li,et al.  Optimal Posted Prices for Online Cloud Resource Allocation , 2017, Proc. ACM Meas. Anal. Comput. Syst..

[49]  Elad Hazan,et al.  Competing in the Dark: An Efficient Algorithm for Bandit Linear Optimization , 2008, COLT.

[50]  Minghua Chen,et al.  Cost Minimizing Online Algorithms for Energy Storage Management With Worst-Case Guarantee , 2015, IEEE Transactions on Smart Grid.

[51]  Adam Tauman Kalai,et al.  Geometric algorithms for online optimization , 2002 .

[52]  Rong Jin,et al.  25th Annual Conference on Learning Theory Online Optimization with Gradual Variations , 2022 .

[53]  Francesco Orabona,et al.  Scale-Free Algorithms for Online Linear Optimization , 2015, ALT.

[54]  Adam Wierman,et al.  Competitive Online Optimization under Inventory Constraints , 2019, Proc. ACM Meas. Anal. Comput. Syst..

[55]  Minghua Chen,et al.  Dynamic provisioning in next-generation data centers with on-site power production , 2013, e-Energy '13.