Theory to practice: global sensitivity analysis of the Aimsun meso model

This paper examines a metamodel-based technique for model sensitivity analysis and applies it to the Aimsun mesoscopic model. The paper argues that sensitivity analysis is crucial for the best use of the traffic simulation models while also acknowledging that the main obstacle to an extensive use of the most sophisticated techniques is the high number of model runs they usually require. To get around this problem, the paper considers the possibility of performing sensitivity analysis not on a model but on its metamodel approximation. Important issues arising when estimating a metamodel have been investigated and commented on in the specific application to the Aimsun model. Among these issues is the importance of selecting a proper sampling strategy based on low discrepancy random number sequences and the importance of selecting a class of metamodels able to reproduce the inputs-ouputs relationship in a robust and reliable way. Sobol sequences and Gaussian process metamodels have been recognized as the appropriate choices. The paper assesses the proposed methodology by comparing the results of the application of variancebased sensitivity analysis techniques to the simulation model and to a metamodel estimated with 512 model runs, on a variety of traffic scenarios and model outputs. Results confirm the powerfulness of the proposed methodology and also open up to a more extensive application of sensitivity analysis techniques to complex traffic simulation models.

[1]  Paola Annoni,et al.  Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index , 2010, Comput. Phys. Commun..

[2]  Saltelli Andrea,et al.  Global Sensitivity Analysis: The Primer , 2008 .

[3]  B. Iooss,et al.  Global sensitivity analysis for a numerical model of radionuclide migration from the RRC “Kurchatov Institute” radwaste disposal site , 2008 .

[4]  Jack P. C. Kleijnen,et al.  Kriging Metamodeling in Simulation: A Review , 2007, Eur. J. Oper. Res..

[5]  Shuangzhe Liu,et al.  Global Sensitivity Analysis: The Primer by Andrea Saltelli, Marco Ratto, Terry Andres, Francesca Campolongo, Jessica Cariboni, Debora Gatelli, Michaela Saisana, Stefano Tarantola , 2008 .

[6]  Jon C. Helton,et al.  Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models , 2009, Reliab. Eng. Syst. Saf..

[7]  Jack P. C. Kleijnen Design and Analysis of Simulation Experiments , 2007 .

[8]  Paola Annoni,et al.  Sixth International Conference on Sensitivity Analysis of Model Output How to avoid a perfunctory sensitivity analysis , 2010 .

[9]  Bertrand Iooss,et al.  An efficient methodology for modeling complex computer codes with Gaussian processes , 2008, Comput. Stat. Data Anal..

[10]  Marcello Montanino,et al.  Global sensitivity analysis techniques to simplify the calibration of traffic simulation models. Methodology and application to the IDM car-following model , 2014 .

[11]  I. Sobola,et al.  Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[12]  Søren Nymand Lophaven,et al.  Aspects of the Matlab toolbox DACE , 2002 .

[13]  Vincenzo Punzo,et al.  “No Free Lunch” Theorems Applied to the Calibration of Traffic Simulation Models , 2014, IEEE Transactions on Intelligent Transportation Systems.

[14]  I. Sobol Uniformly distributed sequences with an additional uniform property , 1976 .

[15]  P. G. Gipps,et al.  A behavioural car-following model for computer simulation , 1981 .

[16]  Stefano Tarantola,et al.  Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models , 2004 .

[17]  Roger Woodard,et al.  Interpolation of Spatial Data: Some Theory for Kriging , 1999, Technometrics.

[18]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[19]  Bertrand Iooss,et al.  Numerical Study of the Metamodel Validation Process , 2009, 2009 First International Conference on Advances in System Simulation.

[20]  G. Matheron Principles of geostatistics , 1963 .

[21]  I. Sobol On the distribution of points in a cube and the approximate evaluation of integrals , 1967 .