Benders Decomposition for multi-stage stochastic mixed complementarity problems - Applied to a global natural gas market model

This paper presents and implements a Benders Decomposition type of algorithm for large-scale, stochastic multi-period mixed complementarity problems. The algorithm is applied to various multi-stage natural gas market models accounting for market power exertion by traders. Due to the non-optimization nature of the natural gas market problem, a straightforward implementation of the traditional Benders Decomposition is not possible. The master and subproblems can be derived from the underlying optimization problems and transformed into complementarity problems. However, to complete the master problems optimality cuts are added using the variational inequality-based method developed in Gabriel and Fuller (2010). In this manner, an alternative derivation of Benders Decomposition for Stochastic MCP is presented, thereby making this approach more applicable to a broader audience. The algorithm can successfully solve problems with up to 256 scenarios and more than 600 thousand variables, and problems with over 117 thousand variables with more than two thousand first-stage capacity expansion variables. The algorithm is efficient for solving two-stage problems. The computational time reduction for other stochastic problems is considerable and would be even larger if a parallel implementation of the algorithm were used. The paper concludes with a discussion of infrastructure expansion results, illustrating the impact of hedging on investment timing and optimal capacity sizes.

[1]  Jitka Dupacová,et al.  Scenario reduction in stochastic programming , 2003, Math. Program..

[2]  Gilbert Laporte,et al.  The integer L-shaped method for stochastic integer programs with complete recourse , 1993, Oper. Res. Lett..

[3]  Abram Burk A Reformulation of Certain Aspects of Welfare Economics , 1938 .

[4]  Richard D. Wollmer,et al.  Two stage linear programming under uncertainty with 0–1 integer first stage variables , 1980, Math. Program..

[5]  Steven A. Gabriel,et al.  A complementarity model for solving stochastic natural gas market equilibria , 2008 .

[6]  Jacques F. Benders,et al.  Partitioning procedures for solving mixed-variables programming problems , 2005, Comput. Manag. Sci..

[7]  Franziska Holz,et al.  COALMOD-World: A Model to Assess International Coal Markets Until 2030 , 2010 .

[8]  Gül Gürkan,et al.  Sample-path solution of stochastic variational inequalities , 1999, Math. Program..

[9]  William Chung,et al.  Dantzig—Wolfe Decomposition of Variational Inequalities , 2005 .

[10]  Christian von Hirschhausen,et al.  Efficient pricing for European electricity networks - The theory of nodal pricing applied to feeding-in wind in Germany , 2008 .

[11]  Santiago Cerisola,et al.  Stochastic dual dynamic programming applied to nonconvex hydrothermal models , 2012, Eur. J. Oper. Res..

[12]  José Eugenio Leal,et al.  A spatial price equilibrium model in the oligopolistic market for oil derivatives: an application to the brazilian scenario , 2007 .

[13]  B. Hobbs,et al.  Linear Complementarity Models of Nash-Cournot Competition in Bilateral and POOLCO Power Markets , 2001, IEEE Power Engineering Review.

[14]  A.F. Wals,et al.  Strategic generation with conjectured transmission price responses in a mixed transmission pricing system-part II: application , 2004, IEEE Transactions on Power Systems.

[15]  Benjamin F. Hobbs,et al.  Natural gas corridors between the EU and its main suppliers: Simulation results with the dynamic GASTALE model , 2008 .

[16]  Steven A. Gabriel,et al.  Solving stochastic complementarity problems in energy market modeling using scenario reduction , 2009, Eur. J. Oper. Res..

[17]  A. Conejo,et al.  Scenario Reduction for Futures Market Trading in Electricity Markets , 2009, IEEE Transactions on Power Systems.

[18]  J. Cabero,et al.  Modeling Risk Management in Oligopolistic Electricity Markets: A Benders Decomposition Approach , 2010, IEEE Transactions on Power Systems.

[19]  Shabbir Ahmed,et al.  Supply chain design under uncertainty using sample average approximation and dual decomposition , 2009, Eur. J. Oper. Res..

[20]  Steven A. Gabriel,et al.  Cartelization in gas markets: Studying the potential for a “Gas OPEC” , 2012 .

[21]  Steven A. Gabriel,et al.  A Complementarity Model for the European Natural Gas Market , 2007 .

[22]  Jan Abrell,et al.  Combining Energy Networks , 2010 .

[23]  Richard W. Cottle,et al.  Linear Complementarity Problem. , 1992 .

[24]  Rudolf Egging Multi-period natural gas market modeling Applications, stochastic extensions and solution approaches , 2010 .

[25]  Benjamin F. Hobbs,et al.  Trading in the Downstream European Gas Market: A Successive Oligopoly Approach , 2004 .

[26]  Steven A. Gabriel,et al.  A Benders Decomposition Method for Solving Stochastic Complementarity Problems with an Application in Energy , 2010 .

[27]  Patricia Jaramillo,et al.  Urban rapid transit network design: accelerated Benders decomposition , 2009, Ann. Oper. Res..

[28]  L. Walras Elements of Pure Economics, or The Theory of Social Wealth , 1955 .

[29]  A. M. Geoffrion Generalized Benders decomposition , 1972 .

[30]  David Kendrick,et al.  GAMS, a user's guide , 1988, SGNM.

[31]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[32]  Steven A. Gabriel,et al.  The World Gas Model , 2010 .

[33]  Judith Gurney BP Statistical Review of World Energy , 1985 .

[34]  John R. Birge,et al.  Introduction to Stochastic Programming , 1997 .

[35]  Franziska Holz,et al.  Analysis of the World Market for Steam Coal Using a Complementarity Model , 2008 .

[36]  Jonathan P. Stern,et al.  The Russian-Ukrainian gas crisis of January 2006 , 2006 .

[37]  Franziska Holz,et al.  A Model for the Global Crude Oil Market Using a Multi-Pool MCP Approach , 2009 .

[38]  Rüdiger Schultz,et al.  Dual decomposition in stochastic integer programming , 1999, Oper. Res. Lett..

[39]  Steven A. Gabriel,et al.  Examining market power in the European natural gas market , 2006 .

[40]  Christian von Hirschhausen,et al.  “Take the long way down”: Integration of large-scale North Sea wind using HVDC transmission , 2010 .

[41]  M. Thring World Energy Outlook , 1977 .

[42]  A. Cournot Researches into the Mathematical Principles of the Theory of Wealth , 1898, Forerunners of Realizable Values Accounting in Financial Reporting.

[43]  Salvador Perez Canto,et al.  Application of Benders' decomposition to power plant preventive maintenance scheduling , 2008, Eur. J. Oper. Res..

[44]  Franziska Holz,et al.  Representing GASPEC with the World Gas Model , 2008 .

[45]  John R. Birge,et al.  The value of the stochastic solution in stochastic linear programs with fixed recourse , 1982, Math. Program..

[46]  Xiaojun Chen,et al.  Expected Residual Minimization Method for Stochastic Linear Complementarity Problems , 2005, Math. Oper. Res..

[47]  William Chung,et al.  Benders decomposition for a class of variational inequalities , 2008, Eur. J. Oper. Res..

[48]  Benjamin F. Hobbs,et al.  Future evolution of the liberalised European gas market: Simulation results with a dynamic model , 2008 .