Leveraging big data for adaptive robust optimization of scheduling under uncertainty

In this paper, we propose a data-driven outlier-insensitive adaptive robust optimization framework that leverages big data in industries. A Bayesian nonparametric model - the Dirichlet process mixture model - is adopted to extract the information embedded within uncertainty data via a variational inference algorithm. We then devise data-driven uncertainty sets for adaptive robust optimization. This Bayesian nonparametric model is seamlessly integrated with adaptive optimization approach through a novel four-level robust optimization framework. This framework explicitly considers the correlation, asymmetry and multimode of uncertainty data, and as a result generates less conservative solutions. Additionally, this framework is robust not only to parameter variations, but also to data outliers. An efficient tailored column-and-constraint generation algorithm is proposed for the resulting problem that cannot be solved by any off-the-shelf optimization solvers. The effectiveness and advantages of the modeling framework and solution algorithm are demonstrated through an industrial application in batch process scheduling.

[1]  Yee Whye Teh,et al.  Dirichlet Process , 2017, Encyclopedia of Machine Learning and Data Mining.

[2]  Jonathan P. How,et al.  Bayesian nonparametric set construction for robust optimization , 2015, 2015 American Control Conference (ACC).

[3]  Fengqi You,et al.  Planning and scheduling of flexible process networks under uncertainty with stochastic inventory: MINLP models and algorithm , 2013 .

[4]  Fengqi You,et al.  A computational framework and solution algorithms for two‐stage adaptive robust scheduling of batch manufacturing processes under uncertainty , 2016 .

[5]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[6]  Fengqi You,et al.  Optimal supply chain design and operations under multi-scale uncertainties: Nested stochastic robust optimization modeling framework and solution algorithm , 2016 .

[7]  Fengqi You,et al.  Efficient scheduling method of complex batch processes with general network structure via agent‐based modeling , 2013 .

[8]  Yinyu Ye,et al.  Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems , 2010, Oper. Res..

[9]  Yongpei Guan,et al.  Uncertainty Sets for Robust Unit Commitment , 2014, IEEE Transactions on Power Systems.

[10]  Fengqi You,et al.  Optimal processing network design under uncertainty for producing fuels and value‐added bioproducts from microalgae: Two‐stage adaptive robust mixed integer fractional programming model and computationally efficient solution algorithm , 2017 .

[11]  Robert J. Vanderbei,et al.  Robust Optimization of Large-Scale Systems , 1995, Oper. Res..

[12]  Fengqi You,et al.  Sustainable scheduling of batch processes under economic and environmental criteria with MINLP models and algorithms , 2013, Comput. Chem. Eng..

[13]  Alain Billionnet,et al.  2-stage robust MILP with continuous recourse variables , 2014, Discret. Appl. Math..

[14]  Constantine Caramanis,et al.  Theory and Applications of Robust Optimization , 2010, SIAM Rev..

[15]  S. Joe Qin,et al.  Process data analytics in the era of big data , 2014 .

[16]  Long Zhao,et al.  Solving two-stage robust optimization problems using a column-and-constraint generation method , 2013, Oper. Res. Lett..

[17]  Fengqi You,et al.  Stochastic inventory management for tactical process planning under uncertainties: MINLP models and algorithms , 2011 .

[18]  Yuan Yuan,et al.  Robust optimization under correlated uncertainty: Formulations and computational study , 2016, Comput. Chem. Eng..

[19]  Arkadi Nemirovski,et al.  Robust optimization – methodology and applications , 2002, Math. Program..

[20]  Nikolaos V. Sahinidis,et al.  Optimization under uncertainty: state-of-the-art and opportunities , 2004, Comput. Chem. Eng..

[21]  Tara L. Terry,et al.  Robust Linear Optimization With Recourse , 2009 .

[22]  Nikolaos V. Sahinidis,et al.  Multiperiod investment model for processing networks with dedicated and flexible plants. [Erratum to document cited in CA114(26):250093n] , 1991 .

[23]  Michael I. Jordan,et al.  Variational inference for Dirichlet process mixtures , 2006 .

[24]  Fengqi You,et al.  Deciphering and handling uncertainty in shale gas supply chain design and optimization: Novel modeling framework and computationally efficient solution algorithm , 2015 .

[25]  Fengqi You,et al.  Unraveling Optimal Biomass Processing Routes from Bioconversion Product and Process Networks under Uncertainty: An Adaptive Robust Optimization Approach , 2016 .

[26]  Fengqi You,et al.  Sustainable design and synthesis of energy systems , 2015 .

[27]  Vishal Gupta,et al.  Data-driven robust optimization , 2013, Math. Program..

[28]  A. Ben-Tal,et al.  Adjustable robust solutions of uncertain linear programs , 2004, Math. Program..

[29]  Shabbir Ahmed,et al.  Robust Process Planning under Uncertainty , 1998 .

[30]  Ignacio E. Grossmann,et al.  Data-driven individual and joint chance-constrained optimization via kernel smoothing , 2015, Comput. Chem. Eng..

[31]  Donghua Zhou,et al.  Hidden Markov Model-Based Statistics Pattern Analysis for Multimode Process Monitoring: An Index-Switching Scheme , 2014 .

[32]  Fengqi You,et al.  Integrated Scheduling and Dynamic Optimization of Sequential Batch Processes with Online Implementation , 2013 .