Simulation-Based Optimization as a Service for Dynamic Data-Driven Applications Systems

Dynamic data-driven applications systems (DDDAS) must be adaptive in the face of highly fluctuating and uncertain environments. An important means to such adaptability is through the use of simulation models which can be leveraged for dynamic decision support. To provide high quality decision support, one can use simulations in an optimization loop to derive the best values of system parameters for a given system state particularly when the system has too many parameters and traditional means to optimize the outcomes are intractable. To that end, simulation-based optimization methods have emerged to enable optimization in the context of complex, black-box simulations thereby obviating the need for specific and accurate model information, such as gradient computation. An important challenge in using simulation-based optimization is optimizing the decision parameters. However, to ensure scalability and real-time decision support, one must be able to rapidly deploy simulation-based optimization in a way that makes the best use of available computing resources given the time and budget constraints. To address these needs, we propose a cloud-based framework for simulation-based optimization as a service (SBOaaS) to enable a flexible and highly parallelizable dynamic decision support for such environments. We illustrate the framework by using it to design a dynamic traffic light control system through simulation-based optimizations using the Simulation of Urban Mobility (SUMO) traffic simulation model that adjusts to the observed vehicle flow.

[1]  Peter Richtárik,et al.  Distributed Coordinate Descent Method for Learning with Big Data , 2013, J. Mach. Learn. Res..

[2]  Aniruddha S. Gokhale,et al.  A simulation as a service cloud middleware , 2016, Ann. des Télécommunications.

[3]  Salim Hariri,et al.  Resilient and Trustworthy Dynamic Data-driven Application Systems (DDDAS) Services for Crisis Management Environments , 2015, ICCS.

[4]  Daniel Vanderpooten,et al.  Multiobjective and multimodal adaptive traffic light control on single junctions , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[5]  Stéphane Lafortune,et al.  A decentralized scheme for real-time optimization of traffic signals , 1996, Proceeding of the 1996 IEEE International Conference on Control Applications IEEE International Conference on Control Applications held together with IEEE International Symposium on Intelligent Contro.

[6]  José Ramón Gil-García,et al.  Understanding Smart Cities: An Integrative Framework , 2012, HICSS.

[7]  Tag Gon Kim,et al.  DEXSim: an experimental environment for distributed execution of replicated simulators using a concept of single simulation multiple scenarios , 2014, Simul..

[8]  Yu Ding,et al.  Optimal Engineering System Design Guided by Data-Mining Methods , 2005, Technometrics.

[9]  Massimiliano Rak,et al.  mJADES: Concurrent Simulation in the Cloud , 2012, 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems.

[10]  Jean-Baptiste Thibault,et al.  A three-dimensional statistical approach to improved image quality for multislice helical CT. , 2007, Medical physics.

[11]  Dirk Merkel,et al.  Docker: lightweight Linux containers for consistent development and deployment , 2014 .

[12]  Alexander J. Smola,et al.  Scaling Distributed Machine Learning with the Parameter Server , 2014, OSDI.

[13]  Gabriel Wainer,et al.  Distributed Simulation Using RESTful Interoperability Simulation Environment (RISE) Middleware , 2011 .

[14]  Yaoliang Yu,et al.  Petuum: A New Platform for Distributed Machine Learning on Big Data , 2015, IEEE Trans. Big Data.

[15]  Pradeep Ravikumar,et al.  Sparse inverse covariance matrix estimation using quadratic approximation , 2011, MLSLP.

[16]  Marc'Aurelio Ranzato,et al.  Large Scale Distributed Deep Networks , 2012, NIPS.

[17]  Frederica Darema,et al.  Dynamic Data Driven Applications Systems: A New Paradigm for Application Simulations and Measurements , 2004, International Conference on Computational Science.

[18]  Chih-Jen Lin,et al.  A dual coordinate descent method for large-scale linear SVM , 2008, ICML '08.

[19]  Z.-Q. Luo,et al.  Error bounds and convergence analysis of feasible descent methods: a general approach , 1993, Ann. Oper. Res..

[20]  Ken D. Sauer,et al.  A local update strategy for iterative reconstruction from projections , 1993, IEEE Trans. Signal Process..

[21]  R. Tibshirani,et al.  PATHWISE COORDINATE OPTIMIZATION , 2007, 0708.1485.

[22]  Ambuj Tewari,et al.  Stochastic methods for l1 regularized loss minimization , 2009, ICML '09.

[23]  Daniel Krajzewicz,et al.  SUMO - Simulation of Urban MObility An Overview , 2011 .

[24]  Michael C. Fu,et al.  ONLINE TRAFFIC LIGHT CONTROL THROUGH GRADIENT ESTIMATION USING STOCHASTIC FLUID MODELS , 2005 .

[25]  Haibin Ling,et al.  A Container-Based Elastic Cloud Architecture for Pseudo Real-Time Exploitation of Wide Area Motion Imagery (WAMI) Stream , 2017, J. Signal Process. Syst..

[26]  Stephen J. Wright Coordinate descent algorithms , 2015, Mathematical Programming.

[27]  P. Tseng,et al.  On the convergence of the coordinate descent method for convex differentiable minimization , 1992 .

[28]  Inderjit S. Dhillon,et al.  Fast coordinate descent methods with variable selection for non-negative matrix factorization , 2011, KDD.

[29]  Nhan Nguyen,et al.  A closed-loop context aware data acquisition and resource allocation framework for dynamic data driven applications systems (DDDAS) on the cloud , 2015, J. Syst. Softw..

[30]  Gül Gürkan,et al.  Sample-path optimization in simulation , 1994, Proceedings of Winter Simulation Conference.

[31]  N. Tomizawa,et al.  On some techniques useful for solution of transportation network problems , 1971, Networks.

[32]  Gabrielle Allen Building a Dynamic Data Driven Application System for Hurricane Forecasting , 2007, International Conference on Computational Science.

[33]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[34]  Tomàs Margalef,et al.  Applying a Dynamic Data Driven Genetic Algorithm to Improve Forest Fire Spread Prediction , 2008, ICCS.

[35]  Peter Richtárik,et al.  Iteration complexity of randomized block-coordinate descent methods for minimizing a composite function , 2011, Mathematical Programming.

[36]  Erik Blasch,et al.  Static Versus Dynamic Data Information Fusion Analysis Using DDDAS for Cyber Security Trust , 2014, ICCS.

[37]  Sung-Joo Lee,et al.  A Traffic Light Controlling FLC Considering the Traffic Congestion , 2002, AFSS.

[38]  Michael C. Fu,et al.  Sensitivity Analysis for Monte Carlo Simulation of Option Pricing , 1995, Probability in the Engineering and Informational Sciences.

[39]  Stephen J. Wright,et al.  Hogwild: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent , 2011, NIPS.

[40]  Wilfred W. Recker,et al.  Stochastic adaptive control model for traffic signal systems , 2006 .

[41]  Christos G. Cassandras,et al.  Infinitesimal Perturbation Analysis for Quasi-Dynamic Traffic Light Controllers , 2014, WODES.