A Data-Driven Pattern Extraction Method for Analyzing Bidding Behaviors in Power Markets

Myriad studies have been conducted on bidding behaviors following a worldwide restructuring of the electric power market. The common theme in such studies involves idealized and theoretical economic assumptions. However, practical bidding behavior could deviate from that based on theoretical assumptions, which would undoubtedly limit the effectiveness and practicality of the prevalent market-based studies. To analyze the actual bidding behavior in power markets, this paper proposes a data-driven analysis framework for bidding behavior in which a data standardization processing method is proposed that addresses the particularities of the bidding data and provides a fundamental dataset for further market analyses. Then, an adaptive clustering method for bidding behavior is developed that applies the ${K}$ -medoids method and the Wasserstein distance measurement to extract the generators’ bidding patterns from a massive dataset. An empirical analysis of the bidding behavior is conducted on actual data from the Australian energy market. The typical bidding patterns are extracted, and the bidding behaviors are further analyzed.

[1]  Chongqing Kang,et al.  Market Power Mitigation Clearing Mechanism Based on Constrained Bidding Capacities , 2019, IEEE Transactions on Power Systems.

[2]  A. Pakes,et al.  Just Starting Out: Learning and Equilibrium in a New Market , 2016 .

[3]  S. Borenstein,et al.  Measuring Market Inefficiencies in California's Restructured Wholesale Electricity Market , 2002 .

[4]  Daniel S. Kirschen,et al.  Optimal Battery Participation in Frequency Regulation Markets , 2017, IEEE Transactions on Power Systems.

[5]  Hamed Mohsenian Rad,et al.  A data-driven analysis of supply bids in California ISO market: Price elasticity and impact of renewables , 2017, 2017 IEEE International Conference on Smart Grid Communications (SmartGridComm).

[6]  A. K. David,et al.  Market Power in Electricity Supply , 2001, IEEE Power Engineering Review.

[7]  Ying Wah Teh,et al.  Time-series clustering - A decade review , 2015, Inf. Syst..

[8]  Hamed Mohsenian-Rad,et al.  A Closer Look at Demand Bids in California ISO Energy Market , 2016, IEEE Transactions on Power Systems.

[9]  Mohammad Reza Hesamzadeh,et al.  Data-Driven Probabilistic Optimal Power Flow With Nonparametric Bayesian Modeling and Inference , 2020, IEEE Transactions on Smart Grid.

[10]  Qixin Chen,et al.  Efficiency Loss for Variable Renewable Energy Incurred by Competition in Electricity Markets , 2020, IEEE Transactions on Sustainable Energy.

[11]  Antonio J. Conejo,et al.  The role of energy storage in mitigating ramping inefficiencies caused by variable renewable generation , 2018 .

[12]  H. R. Mashhadi,et al.  Analysis of the Probability Distribution of LMP by Central Limit Theorem , 2013, IEEE Transactions on Power Systems.

[13]  A. Conejo,et al.  Offering Strategy of Wind-Power Producer: A Multi-Stage Risk-Constrained Approach , 2016, IEEE Transactions on Power Systems.

[14]  Jinxing Hu,et al.  A New Clustering Approach for Scenario Reduction in Multi-Stochastic Variable Programming , 2019, IEEE Transactions on Power Systems.

[15]  Pramod K. Varshney,et al.  K-Medoids Clustering of Data Sequences With Composite Distributions , 2018, IEEE Transactions on Signal Processing.

[16]  Tao Li,et al.  Strategic bidding of transmission-constrained GENCOs with incomplete information , 2005, IEEE Transactions on Power Systems.

[17]  Jianhui Wang,et al.  Data-Driven Stochastic Transmission Expansion Planning , 2017, IEEE Transactions on Power Systems.

[18]  Ram Rajagopal,et al.  Lifestyle Segmentation Based on Energy Consumption Data , 2018, IEEE Transactions on Smart Grid.

[19]  Ioannis Ch. Paschalidis,et al.  Learning From Past Bids to Participate Strategically in Day-Ahead Electricity Markets , 2018, IEEE Transactions on Smart Grid.

[20]  Mohammad Shahidehpour,et al.  Data-Driven Risk-Averse Two-Stage Optimal Stochastic Scheduling of Energy and Reserve With Correlated Wind Power , 2020, IEEE Transactions on Sustainable Energy.

[21]  Alexandre Street,et al.  Two-Stage Robust Unit Commitment for Co-Optimized Electricity Markets: An Adaptive Data-Driven Approach for Scenario-Based Uncertainty Sets , 2020, IEEE Transactions on Sustainable Energy.

[22]  Juan M. Morales,et al.  A Data-Driven Bidding Model for a Cluster of Price-Responsive Consumers of Electricity , 2015, IEEE Transactions on Power Systems.

[23]  Ali Hortaçsu,et al.  Understanding strategic bidding in multi‐unit auctions: a case study of the Texas electricity spot market , 2008 .

[24]  Antonio J. Conejo,et al.  Revealing Rival Marginal Offer Prices Via Inverse Optimization , 2013, IEEE Transactions on Power Systems.

[25]  Yi Wang,et al.  Clustering of Electricity Consumption Behavior Dynamics Toward Big Data Applications , 2016, IEEE Transactions on Smart Grid.

[26]  Qian Ai,et al.  A Data-Driven Stackelberg Market Strategy for Demand Response-Enabled Distribution Systems , 2019, IEEE Transactions on Smart Grid.

[27]  Sanjay Lall,et al.  Shape-Based Approach to Household Electric Load Curve Clustering and Prediction , 2017, IEEE Transactions on Smart Grid.

[28]  Christopher C. Yang,et al.  Breast Cancer Symptom Clusters Derived From Social Media and Research Study Data Using Improved $K$ -Medoid Clustering , 2016, IEEE Transactions on Computational Social Systems.

[29]  Goran Strbac,et al.  Clustering-Based Residential Baseline Estimation: A Probabilistic Perspective , 2019, IEEE Transactions on Smart Grid.

[30]  Qixin Chen,et al.  Electricity markets evolution with the changing generation mix: An empirical analysis based on China 2050 High Renewable Energy Penetration Roadmap ☆ , 2017 .

[31]  Bri-Mathias Hodge,et al.  The Role of Concentrating Solar Power Toward High Renewable Energy Penetrated Power Systems , 2018, IEEE Transactions on Power Systems.

[32]  Chongqing Kang,et al.  A Novel Combined Data-Driven Approach for Electricity Theft Detection , 2019, IEEE Transactions on Industrial Informatics.

[33]  Ning Zhang,et al.  Probabilistic individual load forecasting using pinball loss guided LSTM , 2019, Applied Energy.

[34]  Kaifeng Zhang,et al.  Improving Deployment Availability of Energy Storage With Data-Driven AGC Signal Models , 2018, IEEE Transactions on Power Systems.

[35]  Asghar Akbari Foroud,et al.  Behavioural market power indices in a transmission-constrained electricity market , 2017 .

[36]  Jay F. Whitacre,et al.  An intertemporal decision framework for electrochemical energy storage management , 2018 .

[37]  Huishi Liang,et al.  A Data-Driven Approach for Targeting Residential Customers for Energy Efficiency Programs , 2020, IEEE Transactions on Smart Grid.

[38]  W. Hogan,et al.  A Hazard Rate Analysis of Mirant’s Generating Plant Outages in California (Jan-04) , 2005 .

[39]  Pierre Pinson,et al.  A Bayesian Inference Approach to Unveil Supply Curves in Electricity Markets , 2018, IEEE Transactions on Power Systems.

[40]  Ram Rajagopal,et al.  Household Energy Consumption Segmentation Using Hourly Data , 2014, IEEE Transactions on Smart Grid.

[41]  Kaveh Dehghanpour,et al.  Agent-based modeling in electrical energy markets using dynamic Bayesian networks , 2017, 2017 IEEE Power & Energy Society General Meeting.

[42]  Javier Contreras,et al.  Strategic Behavior of Multi-Energy Players in Electricity Markets as Aggregators of Demand Side Resources Using a Bi-Level Approach , 2018, IEEE Transactions on Power Systems.

[43]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[44]  A. J. Conejo,et al.  Equilibria in an Oligopolistic Electricity Pool With Stepwise Offer Curves , 2012, IEEE Transactions on Power Systems.

[45]  Gilbert Becker Horizontal Merger Guidelines , 2015 .

[46]  Mohammad Shahidehpour,et al.  DER Aggregator’s Data-Driven Bidding Strategy Using the Information Gap Decision Theory in a Non-Cooperative Electricity Market , 2019, IEEE Transactions on Smart Grid.

[47]  Zijun Zhang,et al.  Short-Term Electricity Price Forecasting With Stacked Denoising Autoencoders , 2017, IEEE Transactions on Power Systems.