How to enhance the future use of energy policy simulation models through ex post validation

Although simulation and modeling in general and system dynamics models in particular has long served the energy policy domain, ex post validation of these energy policy models is rarely addressed. In fact, ex post validation is a valuable area of research because it offers modelers a chance to enhance the future use of their simulation models by validating them against the field data. This paper contributes by presenting (i) a system dynamics simulation model, which was developed and used to do a three dimensional, socio-economical and environmental long-term assessment of Pakistan's energy policy in 1999, (ii) a systematic analysis of the 15-years old predictive scenarios produced by a system dynamics simulation model through ex post validation. How did the model predictions compare with the actual data? We report that the ongoing crisis of the electricity sector of Pakistan is unfolding, as the model-based scenarios had projected.

[1]  Abbas Seifi,et al.  A system dynamics analysis of energy consumption and corrective policies in Iranian iron and steel industry , 2012 .

[2]  Yi-Ming Wei,et al.  The effect of an SPR on the oil price in China: A system dynamics approach , 2014 .

[3]  Hassan Qudrat-Ullah,et al.  On the validation of system dynamics type simulation models , 2010, 2010 International Conference on Information Science and Applications.

[4]  R. Kane,et al.  Decision and Simulation Modeling in Systematic Reviews , 2013 .

[5]  Erling Moxnes,et al.  Interfuel substitution in OECD‐European electricity production , 1990 .

[6]  Olivier Massol,et al.  Construction of a fuel demand function portraying interfuel substitution, a system dynamics approach , 2011 .

[7]  Andrew Ford,et al.  Using system dynamics for conservation policy analysis in the Pacific Northwest , 1989 .

[8]  Hassan Qudrat-Ullah,et al.  MDESRAP: a model for understanding the dynamics of electricity supply, resources and pollution , 2005 .

[9]  Adelino J. C. Pereira,et al.  Generation expansion planning (GEP) – A long-term approach using system dynamics and genetic algorithms (GAs) , 2011 .

[10]  George P. Richardson,et al.  A petroleum life cycle model for the United States with endogenous technology, exploration, recovery, and demand , 1990 .

[11]  David R. Keith,et al.  Analysis of supply-push strategies governing the transition to biofuel vehicles in a market-oriented renewable energy system. , 2016 .

[12]  Roger F. Naill,et al.  A System Dynamics Model for National Energy Policy Planning , 1992 .

[13]  Reza Ghazi,et al.  An improved mechanism for capacity payment based on system dynamics modeling for investment planning in competitive electricity environment , 2008 .

[14]  Charles O.P. Marpaung,et al.  Carbon pricing and energy efficiency improvement -- why to miss the interaction for developing economies? An illustrative CGE based application to the Pakistan case , 2014 .

[15]  Cuauhtémoc Sánchez-Ramírez,et al.  Dynamic analysis of feasibility in ethanol supply chain for biofuel production in Mexico , 2014 .

[16]  Xiaodan Guo,et al.  China's photovoltaic power development under policy incentives: A system dynamics analysis , 2015 .

[17]  Hassan Qudrat-Ullah,et al.  How to do structural validity of a system dynamics type simulation model: The case of an energy policy model , 2010 .

[18]  Andrew Ford,et al.  Using simulation for policy evaluation in the electric utility industry , 1983 .

[19]  Andrew Ford,et al.  System Dynamics and the Electric Power Industry , 1997 .

[20]  John D. Sterman,et al.  System Dynamics: Systems Thinking and Modeling for a Complex World , 2002 .

[21]  Y. Barlas.  Multiple tests for validation of system dynamics type of simulation models , 1989 .

[22]  Mohammad Kazem Sheikh-El-Eslami,et al.  A system dynamics approach for investigating impacts of incentive mechanisms on wind power investment , 2012 .

[23]  Sauleh Siddiqui,et al.  Determining energy and climate market policy using multiobjective programs with equilibrium constraints , 2016 .

[24]  Hassan Qudrat-Ullah,et al.  Understanding the dynamics of electricity generation capacity in Canada: A system dynamics approach , 2013 .

[25]  Hassan Qudrat-Ullah,et al.  Understanding the dynamics of electricity supply, resources and pollution: Pakistan's case , 2001 .

[26]  Hassan Qudrat-Ullah,et al.  Independent power (or pollution) producers? Electricity reforms and IPPs in Pakistan , 2015 .

[27]  Erik R. Larsen,et al.  Sensitivity of reserve margin to factors influencing investment behaviour in the electricity market of England and Wales , 1992 .

[28]  Yaman Barlas,et al.  Formal aspects of model validity and validation in system dynamics , 1996 .

[29]  Hassan Qudrat-Ullah.  Green power in Ontario: A dynamic model-based analysis , 2014 .

[30]  Patricia Ochoa,et al.  Policy changes in the Swiss electricity market: Analysis of likely market responses , 2007 .

[31]  R. A. Rahim,et al.  Role of feed-in tariff policy in promoting solar photovoltaic investments in Malaysia: A system dynamics approach , 2015 .

[32]  Eleftherios Iakovou,et al.  Managing the diffusion of biomass in the residential energy sector: An illustrative real-world case study , 2014 .

[33]  Chanwoong Jeon,et al.  Optimal subsidy estimation method using system dynamics and the real option model: Photovoltaic technology case , 2015 .