Real-world challenges for multi-agent reinforcement learning in grid-interactive buildings

[1]  P. Abbeel,et al.  Don't Change the Algorithm, Change the Data: Exploratory Data for Offline Reinforcement Learning , 2022, ArXiv.

[2]  Felipe Leno da Silva,et al.  Collaborative energy demand response with decentralized actor and centralized critic , 2021, BuildSys@SenSys.

[3]  José R. Vázquez-Canteli,et al.  The citylearn challenge 2021 , 2021, BuildSys@SenSys.

[4]  Javier Jiménez Raboso,et al.  Sinergym: a building simulation and control framework for training reinforcement learning agents , 2021, BuildSys@SenSys.

[5]  David H. Blum,et al.  Building optimization testing framework (BOPTEST) for simulation-based benchmarking of control strategies in buildings , 2021, Journal of Building Performance Simulation.

[6]  Alfonso Capozzoli,et al.  Exploring the Potentialities of Deep Reinforcement Learning for Incentive-Based Demand Response in a Cluster of Small Commercial Buildings , 2021, Energies.

[7]  Aditya A. Khandekar,et al.  A National Roadmap for Grid-Interactive Efficient Buildings , 2021 .

[8]  José R. Vázquez-Canteli,et al.  Coordinated energy management for a cluster of buildings through deep reinforcement learning , 2021 .

[9]  Nir Levine,et al.  Challenges of real-world reinforcement learning: definitions, benchmarks and analysis , 2021, Machine Learning.

[10]  Zhen Xu,et al.  NeoRL: A Near Real-World Benchmark for Offline Reinforcement Learning , 2021, NeurIPS.

[11]  José R. Vázquez-Canteli,et al.  CityLearn: Standardizing Research in Multi-Agent Reinforcement Learning for Demand Response and Urban Energy Management , 2020, ArXiv.

[12]  Hartmut Schmeck,et al.  A Guide for the Design of Benchmark Environments for Building Energy Optimization , 2020, BuildSys@SenSys.

[13]  Omid Ardakanian,et al.  COBS: COmprehensive Building Simulator , 2020, BuildSys@SenSys.

[14]  José R. Vázquez-Canteli,et al.  Benchmarking Multi-Agent Deep Reinforcement Learning Algorithms on a Building Energy Demand Coordination Task , 2020, Proceedings of the 1st International Workshop on Reinforcement Learning for Energy Management in Buildings & Cities.

[15]  José R. Vázquez-Canteli,et al.  MARLISA: Multi-Agent Reinforcement Learning with Iterative Sequential Action Selection for Load Shaping of Grid-Interactive Connected Buildings , 2020, BuildSys@SenSys.

[16]  Vikas Chandan,et al.  Physics-constrained Deep Learning of Multi-zone Building Thermal Dynamics , 2020, Energy and Buildings.

[17]  Michael Wetter,et al.  All you need to know about model predictive control for buildings , 2020, Annu. Rev. Control..

[18]  Anjukan Kathirgamanathan,et al.  A Centralised Soft Actor Critic Deep Reinforcement Learning Approach to District Demand Side Management through CityLearn , 2020, ArXiv.

[19]  Zhe Wang,et al.  Reinforcement learning for building controls: The opportunities and challenges , 2020, Applied Energy.

[20]  José R. Vázquez-Canteli,et al.  CityLearn v1.0: An OpenAI Gym Environment for Demand Response with Deep Reinforcement Learning , 2019, BuildSys@SenSys.

[21]  Gabriel Dulac-Arnold,et al.  Challenges of Real-World Reinforcement Learning , 2019, ArXiv.

[22]  José R. Vázquez-Canteli,et al.  Reinforcement learning for demand response: A review of algorithms and modeling techniques , 2019, Applied Energy.

[23]  Dimitrios V. Rovas,et al.  Simulation-Based Evaluation and Optimization of Control Strategies in Buildings , 2018, Energies.

[24]  José R. Vázquez-Canteli,et al.  Optimal decarbonization pathways for urban residential building energy services , 2018, Applied Energy.

[25]  Tamer Basar,et al.  Fully Decentralized Multi-Agent Reinforcement Learning with Networked Agents , 2018, ICML.

[26]  Sergey Levine,et al.  Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor , 2018, ICML.

[27]  Yuxi Li,et al.  Deep Reinforcement Learning: An Overview , 2017, ArXiv.

[28]  J. Schulman,et al.  OpenAI Gym , 2016, ArXiv.

[29]  R. Belmans,et al.  Impact of residential demand response on power system operation: A Belgian case study , 2014 .

[30]  Pierluigi Siano,et al.  Demand response and smart grids—A survey , 2014 .

[31]  William D'haeseleer,et al.  Short-term demand response of flexible electric heating systems: The need for integrated simulations , 2013, 2013 10th International Conference on the European Energy Market (EEM).

[32]  José Ramón Gil-García,et al.  Understanding Smart Cities: An Integrative Framework , 2012, 2012 45th Hawaii International Conference on System Sciences.

[33]  Bing Liu,et al.  U.S. Department of Energy Commercial Reference Building Models of the National Building Stock , 2011 .

[34]  Salman Mohagheghi,et al.  Demand Response Architecture: Integration into the Distribution Management System , 2010, 2010 First IEEE International Conference on Smart Grid Communications.

[35]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Bart De Schutter,et al.  Multi-Agent Reinforcement Learning: A Survey , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[37]  Robert Nowak,et al.  Distributed optimization in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[38]  Jay H. Lee,et al.  Model predictive control: past, present and future , 1999 .

[39]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[40]  Frauke Oldewurtel,et al.  Building modeling as a crucial part for building predictive control , 2013 .