A rolling horizon approach for stochastic mixed complementarity problems with endogenous learning: Application to natural gas markets

In this paper we present a new approach for solving energy market equilibria that is an extension of the classical Nash-Cournot approach. Specifically, besides allowing the market participants to decide on their own decision variables such as production, flows or the like, we allow them to compete in terms of adjusting the data in the problem such as scenario probabilities and costs, consistent with a dynamic, more realistic approach to these markets. Such a problem in its original form is very hard to solve given the product of terms involving decision-dependent data and the variables themselves. Moreover, in its more general form, the players can affect not only each others' objective functions but also the constraint sets of opponents making such a formulation a more complicated instance of generalized Nash problems. This new approach involves solving a sequence of stochastic mixed complementarity (MCP) problems where only partial foresight is used, i.e., a rolling horizon. Each stochastic MCP or roll, involves a look-ahead for a fixed number of time periods with learning on the part of the players to approximate the extended Nash paradigm. Such partial foresight stochastic MCPs also offer a realism advantage over more traditional perfect foresight formulations. Additionally, the rolling-horizon approach offers a computational advantage over scenario-reduction methods as is demonstrated with numerical tests on a natural gas market stochastic MCP. Lastly, we introduce a new concept, the Value of the Rolling Horizon (VoRH) to measure the closeness of different rolling horizon schemes to a perfect foresight benchmark and provide some numerical tests on it using a stylized natural gas market. HighlightsHeuristic for solving non-convex programs.Combines rolling horizons with stochastic mixed complementarity problems.Details of how rolling horizons can incorporate decision-dependent scenarios.New concept: Value of the Rolling Horizon.

[1]  W. A. van den Broek Moving horizon control in dynamic games , 2002 .

[2]  Yugeng Xi,et al.  A rolling horizon job shop rescheduling strategy in the dynamic environment , 1997 .

[3]  Georg Ch. Pflug On-Line Optimization of Simulated Markovian Processes , 1990, Math. Oper. Res..

[4]  M. O'Malley,et al.  Unit Commitment for Systems With Significant Wind Penetration , 2009, IEEE Transactions on Power Systems.

[5]  Steven A. Gabriel,et al.  Cartelization in gas markets: Studying the potential for a “Gas OPEC” , 2012 .

[6]  J. Cabero,et al.  Modeling Risk Management in Oligopolistic Electricity Markets: A Benders Decomposition Approach , 2010, IEEE Transactions on Power Systems.

[7]  T. Panke,et al.  COLUMBUS - A global gas market model , 2012 .

[8]  E. N. Barron,et al.  Game Theory: An Introduction , 2008 .

[9]  W. A. van den Broek,et al.  Moving horizon control in dynamic games , 2002 .

[10]  R. Amir STOCHASTIC GAMES IN ECONOMICS AND RELATED FIELDS: AN OVERVIEW , 2001 .

[11]  Claudia A. Sagastizábal,et al.  Robust Management and Pricing of Liquefied Natural Gas Contracts with Cancelation Options , 2014, J. Optim. Theory Appl..

[12]  Suresh P. Sethi,et al.  A theory of rolling horizon decision making , 1991, Ann. Oper. Res..

[13]  Daniel P. Heyman,et al.  Stochastic models in operations research , 1982 .

[14]  Jong-Shi Pang,et al.  An inexact NE/SQP method for solving the nonlinear complementarity problem , 1992, Comput. Optim. Appl..

[15]  Marianthi G. Ierapetritou,et al.  Rolling horizon based planning and scheduling integration with production capacity consideration , 2010 .

[16]  Peter W. Glynn,et al.  A Complementarity Framework for Forward Contracting Under Uncertainty , 2011, Oper. Res..

[17]  Claudia A. Sagastizábal,et al.  An approximation scheme for a class of risk-averse stochastic equilibrium problems , 2016, Math. Program..

[18]  A Rolling Optimisation Model of the UK Natural Gas Market , 2014 .

[19]  Kudret Demirli,et al.  Production scheduling in steel rolling mills with demand substitution: Rolling horizon implementation and approximations , 2010 .

[20]  Steven A. Gabriel,et al.  Solving stochastic complementarity problems in energy market modeling using scenario reduction , 2009, Eur. J. Oper. Res..

[21]  M. Ventosa,et al.  Electricity market modeling trends , 2005 .

[22]  Drew Fudenberg,et al.  Open-loop and closed-loop equilibria in dynamic games with many players , 1988 .

[23]  J. J. Moré,et al.  Smoothing of mixed complementarity problems , 1995 .

[24]  S. Peeta,et al.  Investing in the Links of a Stochastic Network to Minimize Expected Shortest Path. Length , 2004 .

[25]  B. Hobbs,et al.  Complementarity Modeling in Energy Markets , 2012 .

[26]  David L. Woodruff,et al.  Heuristics for Multi-Stage Interdiction of Stochastic Networks , 2005, J. Heuristics.

[27]  Y. Smeers,et al.  A stochastic version of a Stackelberg-Nash-Cournot equilibrium model , 1997 .

[28]  Steven A. Gabriel,et al.  A complementarity model for solving stochastic natural gas market equilibria , 2008 .

[29]  Shai Shalev-Shwartz,et al.  Online Learning and Online Convex Optimization , 2012, Found. Trends Mach. Learn..

[30]  John R. Birge,et al.  Introduction to Stochastic Programming , 1997 .

[31]  Michael C. Ferris,et al.  Complementarity and variational problems : state of the art , 1997 .

[32]  Benjamin F. Hobbs,et al.  Future evolution of the liberalised European gas market: Simulation results with a dynamic model , 2008 .

[33]  Steven A. Gabriel,et al.  A Hybrid Smoothing Method for Mixed Nonlinear Complementarity Problems , 1998, Comput. Optim. Appl..

[34]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[35]  Pierre Dejax,et al.  Multiperiod Planning and Routing on a Rolling Horizon for Field Force Optimization Logistics , 2008 .

[36]  Werner Römisch,et al.  Scenario Reduction Algorithms in Stochastic Programming , 2003, Comput. Optim. Appl..

[37]  Steven A. Gabriel,et al.  A Benders Decomposition Method for Solving Stochastic Complementarity Problems with an Application in Energy , 2010 .

[38]  Jong-Shi Pang,et al.  NE/SQP: A robust algorithm for the nonlinear complementarity problem , 1993, Math. Program..