Learning Optimal Control of Water Distribution Networks through Sequential Model-based Optimization

Sequential Model-based Bayesian Optimization has been successful-ly applied to several application domains, characterized by complex search spaces, such as Automated Machine Learning and Neural Architecture Search. This paper focuses on optimal control problems, proposing a Sequential Model-based Bayesian Optimization framework to learn optimal control strategies. A quite general formalization of the problem is provided, along with a specific instance related to optimization of pumping operations in an urban Water Distri-bution Network. Relevant results on a real-life Water Distribution Network are reported, comparing different possible choices for the proposed framework.

[1]  Harold J. Kushner,et al.  A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise , 1964 .

[2]  Céline Helbert,et al.  Gaussian process optimization with failures: classification and convergence proof , 2020, Journal of Global Optimization.

[3]  Régis Duvigneau,et al.  A classification approach to efficient global optimization in presence of non-computable domains , 2018 .

[4]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[5]  Bernd Bischl,et al.  mlrMBO: A Modular Framework for Model-Based Optimization of Expensive Black-Box Functions , 2017, 1703.03373.

[6]  Lars Kotthoff,et al.  Automated Machine Learning: Methods, Systems, Challenges , 2019, The Springer Series on Challenges in Machine Learning.

[7]  Roman G. Strongin,et al.  Global optimization with non-convex constraints , 2000 .

[8]  József Gergely Bene,et al.  Comparison of deterministic and heuristic optimization solvers for water network scheduling problems , 2013 .

[9]  Frank Hutter,et al.  Neural Architecture Search: A Survey , 2018, J. Mach. Learn. Res..

[10]  Jonas Mockus,et al.  On Bayesian Methods for Seeking the Extremum , 1974, Optimization Techniques.

[11]  Julius Zilinskas,et al.  Advantages of simplicial partitioning for Lipschitz optimization problems with linear constraints , 2014, Optimization Letters.

[12]  Francesco Archetti,et al.  Global optimization in machine learning: the design of a predictive analytics application , 2018, Soft Computing.

[13]  Quan Pan,et al.  MULTIVARIATE OPTIMIZATION TO DECREASE TOTAL ENERGY CONSUMPTION IN THE WATER SUPPLY SYSTEM OF ABBIATEGRASSO (MILAN, ITALY) , 2015 .

[14]  Robert B. Gramacy,et al.  Optimization Under Unknown Constraints , 2010, 1004.4027.

[15]  Lambert Schomaker,et al.  A Comparison of Feature and Pixel-Based Methods for Recognizing Handwritten Bangla Digits , 2013, 2013 12th International Conference on Document Analysis and Recognition.

[16]  Quan Pan,et al.  Pump Scheduling for a Large Water Distribution Network. Milan, Italy☆ , 2017 .

[17]  Francesco Archetti,et al.  Sequential model based optimization with black-box constraints: Feasibility determination via machine learning , 2019 .

[18]  Yaroslav D. Sergeyev,et al.  Index information algorithm with local tuning for solving multidimensional global optimization problems with multiextremal constraints , 2011, Math. Program..

[19]  Matthew W. Hoffman,et al.  Predictive Entropy Search for Bayesian Optimization with Unknown Constraints , 2015, ICML.

[20]  Francesco Archetti,et al.  Bayesian optimization of pump operations in water distribution systems , 2018, J. Glob. Optim..

[21]  Helena Mala-Jetmarova,et al.  Lost in optimisation of water distribution systems? A literature review of system operation , 2017, Environ. Model. Softw..

[22]  A. A. Zhigli︠a︡vskiĭ,et al.  Stochastic Global Optimization , 2007 .

[23]  Y. D. Sergeyev,et al.  Global Optimization with Non-Convex Constraints - Sequential and Parallel Algorithms (Nonconvex Optimization and its Applications Volume 45) (Nonconvex Optimization and Its Applications) , 2000 .

[24]  Sébastien Le Digabel,et al.  A Taxonomy of Constraints in Simulation-Based Optimization , 2015, 1505.07881.

[25]  Antonio Candelieri,et al.  Bayesian Optimization and Data Science , 2019, SpringerBriefs in Optimization.

[26]  D. Ginsbourger,et al.  A benchmark of kriging-based infill criteria for noisy optimization , 2013, Structural and Multidisciplinary Optimization.

[27]  N. Zheng,et al.  Global Optimization of Stochastic Black-Box Systems via Sequential Kriging Meta-Models , 2006, J. Glob. Optim..

[28]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[29]  Antonio Candelieri,et al.  Sequential model based optimization of partially defined functions under unknown constraints , 2019, J. Glob. Optim..

[30]  Kevin Leyton-Brown,et al.  Sequential Model-Based Optimization for General Algorithm Configuration , 2011, LION.