Short Term Electricity Market Designs: Identified Challenges and Promising Solutions

The electricity market, which was initially designed for dispatchable power plants and inflexible demand, is being increasingly challenged by new trends, such as the high penetration of intermittent renewables and the transformation of the consumers energy space. To accommodate these new trends and improve the performance of the market, several modifications to current market designs have been proposed in the literature. Given the vast variety of these proposals, this paper provides a comprehensive investigation of the modifications proposed in the literature as well as a detailed assessment of their suitability for improving market performance under the continuously evolving electricity landscape. To this end, first, a set of criteria for an ideal market design is proposed, and the barriers present in current market designs hindering the fulfillment of these criteria are identified. Then, the different market solutions proposed in the literature, which could potentially mitigate these barriers, are extensively explored. Finally, a taxonomy of the proposed solutions is presented, highlighting the barriers addressed by each proposal and the associated implementation challenges. The outcomes of this analysis show that even though each barrier is addressed by at least one proposed solution, no single proposal is able to address all the barriers simultaneously. In this regard, a future-proof market design must combine different elements of proposed solutions to comprehensively mitigate market barriers and overcome the identified implementation challenges. Thus, by thoroughly reviewing this rich body of literature, this paper introduces key contributions enabling the advancement of the state-of-the-art towards increasingly efficient electricity market.

[1]  Majid Soleimani-Damaneh,et al.  Energy and Reserve Market Clearing With Microgrid Aggregators , 2016, IEEE Transactions on Smart Grid.

[2]  Pandelis N. Biskas,et al.  Adjustable Profile Blocks With Spatial Relations in the Day-Ahead Electricity Market , 2013, IEEE Transactions on Power Systems.

[3]  Xiao-Ping Zhang,et al.  A Solution to the Chance-Constrained Two-Stage Stochastic Program for Unit Commitment With Wind Energy Integration , 2016, IEEE Transactions on Power Systems.

[4]  Brian Ó Gallachóir,et al.  The impact of sub-hourly modelling in power systems with significant levels of renewable generation , 2014 .

[5]  Yury Dvorkin,et al.  A Chance-Constrained Stochastic Electricity Market , 2019, IEEE Transactions on Power Systems.

[6]  D'avid Csercsik,et al.  Introduction of flexible production bids and combined package-price bids in a framework of integrated power-reserve market coupling , 2020, ArXiv.

[7]  P. Pinson,et al.  Energy Collectives: A Community and Fairness Based Approach to Future Electricity Markets , 2019, IEEE Transactions on Power Systems.

[8]  T. Matsuyama,et al.  Energy Management in Prosumer Communities: A Coordinated Approach , 2016 .

[9]  Pierre Pinson,et al.  Peer-to-peer and community-based markets: A comprehensive review , 2018, Renewable and Sustainable Energy Reviews.

[10]  S. Borenstein,et al.  The Competitive Effects of Transmission Capacity in a Deregulated Electricity Industry , 1997 .

[11]  Benjamin F. Hobbs,et al.  Hidden power system inflexibilities imposed by traditional unit commitment formulations , 2017 .

[12]  Daniel Divenyi,et al.  Algorithm design for European electricity market clearing with joint allocation of energy and control reserves , 2019, International Journal of Electrical Power & Energy Systems.

[13]  Rudi A. Hakvoort,et al.  Balance responsibility and imbalance settlement in Northern Europe — An evaluation , 2009, 2009 6th International Conference on the European Energy Market.

[14]  Pierre Pinson,et al.  An Integrated Market for Electricity and Natural Gas Systems with Stochastic Power Producers , 2018, Eur. J. Oper. Res..

[15]  Sheng Chen,et al.  Adaptive Robust Day-Ahead Dispatch for Urban Energy Systems , 2019, IEEE Transactions on Industrial Electronics.

[16]  William W. Hogan,et al.  Market Design Practices: Which Ones Are Best? [In My View] , 2019, IEEE Power and Energy Magazine.

[17]  Andreas Sumper,et al.  Day-ahead micro-market design for distributed energy resources , 2016, 2016 IEEE International Energy Conference (ENERGYCON).

[18]  A. Conejo,et al.  Market-clearing with stochastic security-part I: formulation , 2005, IEEE Transactions on Power Systems.

[19]  Yongpei Guan,et al.  Unified Stochastic and Robust Unit Commitment , 2013, IEEE Transactions on Power Systems.

[20]  Juan M. Morales,et al.  On the inefficiency of the merit order in forward electricity markets with uncertain supply , 2015, Eur. J. Oper. Res..

[21]  Jun Yang,et al.  A chance constrained optimal reserve scheduling approach for economic dispatch considering wind penetration , 2017, IEEE/CAA Journal of Automatica Sinica.

[22]  Magnus Brolin,et al.  Design of a local energy market with multiple energy carriers , 2020 .

[23]  Rens Philipsen,et al.  Trading power instead of energy in day-ahead electricity markets , 2019, Applied Energy.

[24]  Christoph Weber,et al.  Adequate intraday market design to enable the integration of wind energy into the European power systems , 2010 .

[25]  Jesse D. Jenkins,et al.  The Role of Firm Low-Carbon Electricity Resources in Deep Decarbonization of Power Generation , 2018, Joule.

[26]  Pierre Pinson,et al.  Electricity market clearing with improved scheduling of stochastic production , 2014, Eur. J. Oper. Res..

[27]  A. Papavasiliou,et al.  Impacts of Transmission Switching in Zonal Electricity Markets - Part II , 2021, IEEE Transactions on Power Systems.

[28]  E. Fumagalli,et al.  The effect of price regulation on energy imbalances: A Difference in Differences design , 2019, Energy Economics.

[29]  Tom Brijs,et al.  Interactions between the design of short-term electricity markets in the CWE region and power system flexibility , 2017 .

[30]  Yongpei Guan,et al.  A Chance-Constrained Two-Stage Stochastic Program for Unit Commitment With Uncertain Wind Power Output , 2012, IEEE Transactions on Power Systems.

[31]  G. Oggioni,et al.  Reserve procurement and flexibility services in power systems with high renewable capacity: Effects of integration on different market designs , 2019 .

[32]  G. Papaefthymiou,et al.  Towards 100% renewable energy systems: Uncapping power system flexibility , 2016 .

[33]  Iva Ridjan Skov,et al.  Smart Energy Markets - Future electricity, gas and heating markets , 2020 .

[34]  M. Keay Electricity markets are broken – can they be fixed? , 2016 .

[35]  Ioannis Lampropoulos,et al.  A Blockchain-Based Configuration for Balancing the Electricity Grid with Distributed Assets , 2020, World Electric Vehicle Journal.

[36]  Hongjie Jia,et al.  Optimal day-ahead scheduling of integrated urban energy systems , 2016 .

[37]  Andreas Sumper,et al.  Optimization problem for meeting distribution system operator requests in local flexibility markets with distributed energy resources , 2018 .

[38]  Karl-Martin Ehrhart,et al.  The “German Paradox” in the balancing power markets , 2017 .

[39]  P. Cramton Electricity market design , 2017 .

[40]  Daniel Esteban Morales Bondy,et al.  Redefining Requirements of Ancillary Services for Technology Agnostic Sources , 2018, HICSS.

[41]  Ernst Worrell,et al.  Identifying barriers to large-scale integration of variable renewable electricity into the electricity market : A literature review of market design , 2018 .

[42]  Mohammad Reza Mohammadi,et al.  Energy hub: From a model to a concept – A review , 2017 .

[43]  Michael C. Ferris,et al.  Extending the bidding format to promote demand response , 2015 .

[44]  Mar Reguant,et al.  Sequential Markets, Market Power and Arbitrage , 2014 .

[45]  Xi Lu,et al.  Security-Constrained Multiperiod Economic Dispatch With Renewable Energy Utilizing Distributionally Robust Optimization , 2019, IEEE Transactions on Sustainable Energy.

[46]  Karsten Burges,et al.  Pros and cons of exposing renewables to electricity market risks--A comparison of the market integration approaches in Germany, Spain, and the UK , 2008 .

[47]  Xu Andy Sun,et al.  Adaptive Robust Optimization for the Security Constrained Unit Commitment Problem , 2013, IEEE Transactions on Power Systems.

[48]  K. Neuhoff,et al.  Intraday Markets for Power: Discretizing the Continuous Trading? , 2016 .

[49]  Henrik Madsen,et al.  Integrating Renewables in Electricity Markets: Operational Problems , 2013 .

[50]  Antonio J. Conejo,et al.  Rethinking restructured electricity market design: Lessons learned and future needs , 2018, International Journal of Electrical Power & Energy Systems.

[51]  Eric Budish,et al.  The High-Frequency Trading Arms Race: Frequent Batch Auctions as a Market Design Response , 2015 .

[52]  Yingzhong Gu,et al.  Congestion-induced wind curtailment: Sensitivity analysis and case studies , 2011, 2011 North American Power Symposium.

[53]  Benjamin F. Hobbs,et al.  A Stochastic Market Design With Revenue Adequacy and Cost Recovery by Scenario: Benefits and Costs , 2018, IEEE Transactions on Power Systems.

[54]  Feng Liu,et al.  Chance-Constrained Economic Dispatch With Non-Gaussian Correlated Wind Power Uncertainty , 2017, IEEE Transactions on Power Systems.

[55]  Yang Wang,et al.  Risk Adjustable Day-Ahead Unit Commitment With Wind Power Based on Chance Constrained Goal Programming , 2017, IEEE Transactions on Sustainable Energy.

[56]  Jin Zhong,et al.  Pricing Electricity in Pools With Wind Producers , 2012, IEEE Transactions on Power Systems.

[57]  Madeleine Gibescu,et al.  An integrated blockchain-based energy management platform with bilateral trading for microgrid communities , 2020, Applied Energy.

[58]  Marcos J. Rider,et al.  A Stochastic Market-Clearing Model Using Semidefinite Relaxation , 2019, 2019 IEEE Milan PowerTech.

[59]  Gilbert Fridgen,et al.  The search for the perfect match: Aligning power-trading products to the energy transition , 2020, Energy Policy.

[60]  Thomas Ackermann,et al.  Wind Power in Power Systems , 2005 .

[61]  Stéphane Goutte,et al.  The value of flexibility in power markets , 2019, Energy Policy.

[62]  José Pablo Chaves-Ávila,et al.  The Spanish intraday market design: A successful solution to balance renewable generation? , 2015 .

[63]  R. V. D. Veen,et al.  The electricity balancing market: Exploring the design challenge , 2016 .

[64]  A. Papavasiliou,et al.  Coordination Schemes for the Integration of Transmission and Distribution System Operations , 2018, 2018 Power Systems Computation Conference (PSCC).

[65]  Dominique Finon,et al.  Adapting electricity markets to decarbonisation and security of supply objectives: Toward a hybrid regime? , 2017 .

[66]  M. Hogan Follow the missing money: Ensuring reliability at least cost to consumers in the transition to a low-carbon power system , 2017 .

[67]  Michael G. Pollitt,et al.  Market design for a high-renewables European electricity system , 2018, Renewable and Sustainable Energy Reviews.

[68]  Kjetil T. Midthun,et al.  Stochastic Electricity Dispatch: A Challenge for Market Design , 2016 .

[69]  Xue Li,et al.  Day-ahead scheduling of multi-carrier energy systems with multi-type energy storages and wind power , 2018, CSEE Journal of Power and Energy Systems.

[70]  A. Botterud,et al.  Resource Adequacy with Increasing Shares of Wind and Solar Power: A Comparison of European and U.S. Electricity Market Designs , 2020 .

[71]  Yongpei Guan,et al.  A Chance-Constrained Two-Stage Stochastic Program for Unit Commitment With Uncertain Wind Power Output , 2012 .

[72]  Michel Rivier,et al.  Technology and Operation of Electric Power Systems , 2013 .

[73]  Thomas Morstyn,et al.  Bilateral Contract Networks for Peer-to-Peer Energy Trading , 2019, IEEE Transactions on Smart Grid.

[74]  M. Saguan,et al.  Large-scale wind power in European electricity markets: Time for revisiting support schemes and market designs? , 2010 .

[75]  Anthony Papavasiliou,et al.  Dynamic dimensioning approach for operating reserves: Proof of concept in Belgium , 2019, Energy Policy.

[76]  Richard Green,et al.  Electricity and Markets , 2005 .

[77]  F. A. Campos,et al.  Joint energy and reserve markets: Current implementations and modeling trends , 2014 .

[78]  Xiaolong Jin,et al.  Local flexibility markets: Literature review on concepts, models and clearing methods , 2020, Applied Energy.

[79]  J.D. Fuller,et al.  Pricing energy and reserves using stochastic optimization in an alternative electricity market , 2008, 2008 IEEE Power and Energy Society General Meeting - Conversion and Delivery of Electrical Energy in the 21st Century.

[80]  D. Divényi,et al.  Day-ahead market design enabling co-optimized reserve procurement in Europe , 2014, 11th International Conference on the European Energy Market (EEM14).

[81]  Hang Li,et al.  Chance-constrained stochastic congestion management of power systems considering uncertainty of wind power and demand side response , 2019, International Journal of Electrical Power & Energy Systems.

[82]  Ruiwei Jiang,et al.  Robust Unit Commitment With Wind Power and Pumped Storage Hydro , 2012, IEEE Transactions on Power Systems.

[83]  Yongpei Guan,et al.  Two-Stage Minimax Regret Robust Unit Commitment , 2013, IEEE Transactions on Power Systems.

[84]  Mehdi Madani,et al.  Designing Day-Ahead Multi-carrier Markets for Flexibility: Models and Clearing Algorithms , 2020 .

[85]  C. Weber,et al.  Strategic Behavior in the German Balancing Energy Mechanism: Incentives, Evidence, Costs and Solutions , 2012 .

[86]  Wei Tian,et al.  Chance-Constrained Day-Ahead Scheduling in Stochastic Power System Operation , 2014, IEEE Transactions on Power Systems.

[87]  A. F. Gubina,et al.  The flexible demand influence on the joint energy and reserve markets , 2012, 2012 IEEE Power and Energy Society General Meeting.

[88]  D. Kirschen,et al.  Fundamentals of power system economics , 1991 .

[89]  Rodrigo Escobar,et al.  European Union Electricity Markets: Current Practice and Future View , 2019, IEEE Power and Energy Magazine.

[90]  Meng Cheng,et al.  Feasibility of Peer-to-Peer Energy Trading in Low Voltage Electrical Distribution Networks , 2017 .

[91]  Feng Gao,et al.  Comparison of variant robust SCUC models for operational security and economics of power systems under uncertainty , 2016 .

[92]  Geert Deconinck,et al.  Benefits of a multi-energy day-ahead market , 2018, Energy.

[93]  Pierre Pinson,et al.  Exploring Market Properties of Policy-based Reserve Procurement for Power Systems , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[94]  Daan Six,et al.  Coordination between transmission and distribution system operators in the electricity sector: A conceptual framework , 2017 .

[95]  Benjamin Sovacool,et al.  Electricity market design for the prosumer era , 2016, Nature Energy.

[96]  Morteza Rahimiyan,et al.  Day-ahead energy and reserve scheduling under correlated wind power production , 2020 .

[97]  Pierre Pinson,et al.  Consensus-Based Approach to Peer-to-Peer Electricity Markets With Product Differentiation , 2018, IEEE Transactions on Power Systems.

[98]  R. Poudineh,et al.  Electricity market design under increasing renewable energy penetration: Misalignments observed in the European Union , 2019 .

[99]  S. Mei,et al.  Distributionally Robust Co-Optimization of Energy and Reserve Dispatch , 2016, IEEE Transactions on Sustainable Energy.

[100]  Fulli Gianluca,et al.  Nodal Pricing in the European Internal Electricity Market , 2020 .

[101]  Gabriela Hug,et al.  Improving Electricity and Natural Gas Systems Coordination Using Swing Option Contracts , 2019, 2019 IEEE Milan PowerTech.

[102]  H. Slootweg,et al.  Enabling market participation of distributed energy resources through a coupled market design , 2020, IET Renewable Power Generation.

[103]  D Poli,et al.  Clearing procedures for day-ahead Italian electricity market: are complex bids really required? , 2011 .