A New Approach Based on Support Vector Machine for Solving Stochastic Optimization

Making decision usually occurs in the state of being uncertain. These kinds of problems often expresses in a formula as optimization problems. It is desire for decision makers to find a solution for optimization problems. Typically, solving optimization problems in uncertain environment is difficult. This paper proposes a new hybrid intelligent algorithm to solve a kind of stochastic optimization i.e. dependent chance programming (DCP) model. In order to speed up the solution process, we used support vector machine regression (SVM regression) to approximate chance functions which is the probability of a sequence of uncertain event occurs based on the training data generated by the stochastic simulation. The proposed algorithm consists of three steps: (1) generate data to estimate the objective function, (2) utilize SVM regression to reveal a trend hidden in the data (3) apply genetic algorithm (GA) based on SVM regression to obtain an estimation for the chance function. Numerical example is presented to show the ability of algorithm in terms of time-consuming and precision.

[1]  Panos Stinis,et al.  Stochastic global optimization as a filtering problem , 2009, J. Comput. Phys..

[2]  Spyros Voutetakis,et al.  A data mining approach for efficient systems optimization under uncertainty using stochastic search methods , 2011 .

[3]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[4]  Xinyang Li,et al.  Comparison of several stochastic parallel optimization algorithms for adaptive optics system without a wavefront sensor , 2011 .

[5]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[6]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[7]  A. Charnes,et al.  Chance-Constrained Programming , 1959 .

[8]  Fulya Altiparmak,et al.  Multi-objective optimization of a stochastic assembly line balancing: A hybrid simulated annealing algorithm , 2011, Comput. Ind. Eng..

[9]  Dongjing Pan.  Fuzzy Random Dependent-Chance Programming Models of Loan Portfolio , 2011, J. Softw..

[10]  Xiao Ning,et al.  A Hybrid Intelligent Algorithm for Stochastic Dependent-Chance Programming , 2008, First International Workshop on Knowledge Discovery and Data Mining (WKDD 2008).

[11]  Chih-Jen Lin,et al.  Training v-Support Vector Regression: Theory and Algorithms , 2002, Neural Computation.

[12]  Siddhartha,et al.  Stochastic techniques used for optimization in solar systems: A review , 2012 .

[13]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[14]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[15]  Huicheng Zhou,et al.  A fuzzy‐dependent chance multi‐objective programming for water resources planning of a coastal city under fuzzy environment , 2011 .

[16]  高金伍,et al.  Dependent-Chance Programming Models for Capital Budgeting in Fuzzy Environments , 2008 .

[17]  Xiaodong Ding,et al.  A Novel Algorithm of Stochastic Chance-Constrained Linear Programming and Its Application , 2012 .

[18]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[20]  Abbas Afshar,et al.  Stochastic time–cost optimization using non-dominated archiving ant colony approach , 2011 .

[21]  Baoding Liu.  Dependent-Chance Programming: A Class of Stochastic Optimization , 1997 .

[22]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[23]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[24]  Charles Audet,et al.  A method for stochastic constrained optimization using derivative-free surrogate pattern search and collocation , 2010, J. Comput. Phys..

[25]  Shiwei He,et al.  Stochastic dependent-chance programming model and hybrid adaptive genetic algorithm for vendor selection problem , 2008, 2008 IEEE International Conference on Service Operations and Logistics, and Informatics.

[26]  Rui Zhang,et al.  A two-stage hybrid particle swarm optimization algorithm for the stochastic job shop scheduling problem , 2012, Knowl. Based Syst..