Convergence theory for nonconvex stochastic programming with an application to mixed logit

Monte Carlo methods have extensively been used and studied in the area of stochastic programming. Their convergence properties typically consider global minimizers or first-order critical points of the sample average approximation (SAA) problems and minimizers of the true problem, and show that the former converge to the latter for increasing sample size. However, the assumption of global minimization essentially restricts the scope of these results to convex problems. We review and extend these results in two directions: we allow for local SAA minimizers of possibly nonconvex problems and prove, under suitable conditions, almost sure convergence of local second-order solutions of the SAA problem to second-order critical points of the true problem. We also apply this new theory to the estimation of mixed logit models for discrete choice analysis. New useful convergence properties are derived in this context, both for the constrained and unconstrained cases, and associated estimates of the simulation bias and variance are proposed.

[1]  K. Parthasarathy,et al.  Probability measures on metric spaces , 1967 .

[2]  K. Parthasarathy.  PROBABILITY MEASURES IN A METRIC SPACE , 1967 .

[3]  Nicholas I. M. Gould,et al.  On practical conditions for the existence and uniqueness of solutions to the general equality quadratic programming problem , 1985, Math. Program..

[4]  Michael A. Saunders,et al.  Properties of a representation of a basis for the null space , 1985, Math. Program..

[5]  Stephen M. Robinson,et al.  Local epi-continuity and local optimization , 1987, Math. Program..

[6]  Mark D. Uncles,et al.  Discrete Choice Analysis: Theory and Application to Travel Demand , 1987 .

[7]  István Deák,et al.  Multidimensional Integration and Stochastic Programming , 1988 .

[8]  D. McFadden,et al.  The method of simulated scores for the estimation of LDV models , 1998 .

[9]  J. Davidson.  Stochastic Limit Theory , 1994 .

[10]  Peter Kall,et al.  Stochastic Programming , 1995 .

[11]  André de Palma,et al.  Discrete Choice Theory of Product Differentiation , 1995 .

[12]  D. McFadden,et al.  Consumers' Evaluation of New Products: Learning from Self and Others , 1996, Journal of Political Economy.

[13]  Stephen M. Robinson,et al.  Analysis of Sample-Path Optimization , 1996, Math. Oper. Res..

[14]  Martin Gugat.  A parametric view on the Mangasarian–Fromovitz constraint qualification , 1996, Math. Program..

[15]  Christian Gourieroux,et al.  Simulation-based econometric methods , 1996 .

[16]  Ronald L. Wasserstein,et al.  Monte Carlo: Concepts, Algorithms, and Applications , 1997 .

[17]  C. Montmarquette,et al.  How do Young People Choose College Majors , 2002 .

[18]  John M. Wilson,et al.  Introduction to Stochastic Programming , 1998, J. Oper. Res. Soc..

[19]  Peter E. Rossi,et al.  Marketing models of consumer heterogeneity , 1998 .

[20]  Gül Gürkan,et al.  Sample-path solution of stochastic variational inequalities , 1999, Math. Program..

[21]  K. Train,et al.  Joint mixed logit models of stated and revealed preferences for alternative-fuel vehicles , 1999, Controlling Automobile Air Pollution.

[22]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[23]  S. M. Robinson,et al.  Solving stochastic optimization problems with stochastic constraints: an application in network design , 1999, WSC'99. 1999 Winter Simulation Conference Proceedings. 'Simulation - A Bridge to the Future' (Cat. No.99CH37038).

[24]  Gül Gürkan,et al.  Solving stochastic optimization problems with stochastic constraints: an application in network design , 1999, WSC '99.

[25]  C. Bhat.  Quasi-random maximum simulated likelihood estimation of the mixed multinomial logit model , 2001 .

[26]  René Boel,et al.  Discrete Event Systems , 2000 .

[27]  A. Shapiro.  Statistical Inference of Stochastic Optimization Problems , 2000 .

[28]  Alexander Shapiro,et al.  Stochastic programming by Monte Carlo simulation methods , 2000 .

[29]  S. Uryasev.  Probabilistic constrained optimization : methodology and applications , 2000 .

[30]  K. Train.  Halton Sequences for Mixed Logit , 2000 .

[31]  Chandra R. Bhat,et al.  A UNIFIED MIXED LOGIT FRAMEWORK FOR MODELING REVEALED AND STATED PREFERENCES: FORMULATION AND APPLICATION TO CONGESTION PRICING ANALYSIS IN THE SAN FRANCISCO BAY AREA , 2002 .

[32]  Kay W. Axhausen,et al.  Mode choice of complex tours , 2002 .

[33]  David A. Hensher,et al.  The Mixed Logit Model: the State of Practice and Warnings for the Unwary , 2001 .

[34]  C. Bhat.  Simulation estimation of mixed discrete choice models using randomized and scrambled Halton sequences , 2003 .

[35]  A. Daly,et al.  On the performance of the shuffled Halton sequence in the estimation of discrete choice models , 2003 .

[36]  A. Shapiro.  Monte Carlo Sampling Methods , 2003 .

[37]  F. Koppelman,et al.  Activity-Based Modeling of Travel Demand , 2003 .

[38]  Kenneth E. Train,et al.  Discrete Choice Methods with Simulation , 2016 .

[39]  R. Garrido.  Estimation Performance of Low Discrepancy Sequences in Stated Preferences , 2003 .

[40]  P. Toint,et al.  Numerical Experiments with AMLET, a New Monte-Carlo Al- gorithm for Estimating Mixed Logit Models , 2003 .

[41]  A. Ruszczynski.  Stochastic Programming Models , 2003 .

[42]  David A. Hensher,et al.  Willingness to pay for road curviness and road type , 2003 .

[43]  Zsolt Sándor,et al.  Quasi-random simulation of discrete choice models , 2004 .

[44]  C. Bhat,et al.  Simulation Estimation of Mixed Discrete Choice Models with the Use of Randomized Quasi–Monte Carlo Sequences , 2005 .

[45]  F. Bastin,et al.  Evaluation of Optimization Methods for Estimating Mixed Logit Models , 2005 .

[46]  Philippe L. Toint,et al.  An adaptive Monte Carlo algorithm for computing mixed logit estimators , 2006, Comput. Manag. Sci..

[47]  Stephane Hess,et al.  On the use of a Modified Latin Hypercube Sampling (MLHS) method in the estimation of a Mixed Logit Model for vehicle choice , 2006 .