Deciphering Latent Uncertainty Sources with Principal Component Analysis for Adaptive Robust Optimization

Abstract This paper proposes a novel data-driven robust optimization framework that leverages the power of machine learning for decision-making under uncertainty. By performing principal component analysis on uncertainty data, the correlations among uncertain parameters are effectively captured, and latent uncertainty sources are identified. Uncertainty data are then projected onto each principal component to facilitate extracting distributional information of latent uncertainties with kernel density estimation technique. To explicitly account for asymmetric uncertainties, we introduce forward and backward deviation vectors in an uncertainty set. The resulting data-driven uncertainty set is general enough to be employed in adaptive robust optimization model. The proposed framework not only significantly ameliorates the conservatism of robust optimization but also enjoys computational efficiency and wide applicability. An application of optimization under uncertainty on batch process scheduling is presented to demonstrate the effectiveness of the proposed general framework. We also investigate a data-driven uncertainty set in a low-dimensional subspace and derive a theoretical bound on the performance gap between ARO solutions due to the dimension reduction of uncertainties.

[1]  Robert J. Vanderbei,et al.  Robust Optimization of Large-Scale Systems , 1995, Oper. Res..

[2]  Fengqi You,et al.  Unraveling Optimal Biomass Processing Routes from Bioconversion Product and Process Networks under Uncertainty: An Adaptive Robust Optimization Approach , 2016 .

[3]  Fengqi You,et al.  Data-Driven Stochastic Robust Optimization: General Computational Framework and Algorithm Leveraging Machine Learning for Optimization under Uncertainty in the Big Data Era , 2017, Comput. Chem. Eng..

[4]  Shie Mannor,et al.  Statistical Optimization in High Dimensions , 2012, Oper. Res..

[5]  Arkadi Nemirovski,et al.  Robust optimization – methodology and applications , 2002, Math. Program..

[6]  Vishal Gupta,et al.  Data-driven robust optimization , 2013, Math. Program..

[7]  Chao Shang,et al.  A data-driven robust optimization approach to scenario-based stochastic model predictive control , 2018, Journal of Process Control.

[8]  F. You,et al.  A data-driven multistage adaptive robust optimization framework for planning and scheduling under uncertainty , 2017 .

[9]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[10]  Fengqi You,et al.  Optimal supply chain design and operations under multi-scale uncertainties: Nested stochastic robust optimization modeling framework and solution algorithm , 2016 .

[11]  Fengqi You,et al.  Data‐driven adaptive nested robust optimization: General modeling framework and efficient computational algorithm for decision making under uncertainty , 2017 .

[12]  Jean-Philippe Vial,et al.  Deriving robust counterparts of nonlinear uncertain inequalities , 2012, Math. Program..

[13]  Fengqi You,et al.  Resilient design and operations of process systems: Nonlinear adaptive robust optimization model and algorithm for resilience analysis and enhancement , 2017, Comput. Chem. Eng..

[14]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[15]  Martha Martins Carvalho,et al.  Demand response models with correlated price data: A robust optimization approach , 2012 .

[16]  Fengqi You,et al.  Efficient scheduling method of complex batch processes with general network structure via agent‐based modeling , 2013 .

[17]  Fengqi You,et al.  A computational framework and solution algorithms for two‐stage adaptive robust scheduling of batch manufacturing processes under uncertainty , 2016 .

[18]  Chao Shang,et al.  Data-driven robust optimization based on kernel learning , 2017, Comput. Chem. Eng..