A general framework for the integration of complex choice models into mixed integer optimization

The objective of this thesis is to develop a general methodology to incorporate a disaggregate demand representation in supply-oriented optimization problems that allows to capture the interplay between the behavior of individuals and the decisions to be optimized. To this end, we propose a modeling framework for the integration of discrete choice models (DCM) in mixed-integer linear problems (MILP), and we show that it is both flexible and operational on realistic instances. In particular, we develop algorithms to enhance the tractability of the framework, and we illustrate its applicability with two relevant optimization problems that arise in a great deal of contexts. The demand functions generated from DCM are highly non-linear and non-convex, and are not always available in closed form. In this thesis, we avoid the use of such functions by specifying the preference structure of DCM directly in terms of the related structural equations (utility functions). We rely on simulation in order to handle the probabilistic nature of these equations by drawing from the distribution of the associated random component. This yields a mixed-integer linear set of constraints that can be embedded in any MILP formulation. The only requirement is that the decisions to be optimized that are also explanatory variables of the DCM, and therefore capture the interactions, appear linearly in the structural equations. The disaggregate nature of DCM, together with the associated simulation-based linearization, comes with a high computational complexity. Motivated by the decomposable structure of the framework along the two dimensions it is built on, the individuals and the simulation draws, we characterize a Lagrangian decomposition scheme that enables to solve larger instances, at least approximatively. Indeed, the performed tests show that near-optimal solutions are obtained in a much reduced computational time (by running only 10% of the computational time used by the exact method). The framework is sufficiently general to accommodate a wide variety of relevant optimization problems. The main strength is that the DCM does not need to be tailored to the formulation, i.e., it can be taken as such from the literature. In particular, it does not have to be a DCM that relies on simplistic assumptions, such as the logit model, and more advanced DCM such as mixtures of logit models can be integrated. In this thesis, we consider and solve two problems in order to illustrate the versatility of the framework, namely operator-centric profit maximization and traveler-centric design of a

[1]  W. Lieberman The Theory and Practice of Revenue Management , 2005 .

[2]  D. McFadden Conditional logit analysis of qualitative choice behavior , 1972 .

[3]  Juan Pablo Vielma,et al.  Mixed Integer Linear Programming Formulation Techniques , 2015, SIAM Rev..

[4]  Martin W. P. Savelsbergh,et al.  Pricing to Accelerate Demand Learning in Dynamic Assortment Planning for Perishable Products , 2013, Eur. J. Oper. Res..

[5]  B. Borger,et al.  Transport externalities and optimal pricing and supply decisions in urban transportation: a simulation analysis for Belgium , 1998 .

[6]  E. Hopkins Adaptive learning models of consumer behavior , 2007 .

[7]  Lei Guo,et al.  A single-level reformulation of mixed integer bilevel programming problems , 2017, Oper. Res. Lett..

[8]  E. Verhoef,et al.  Basic Economic Principles of Road Pricing: From Theory to Applications , 2006 .

[9]  Bruno De Borger,et al.  Public transport subsidies versus road pricing: An empirical analysis for interregional transport in Belgium , 1999 .

[10]  Todd Litman,et al.  Evaluating Carsharing Benefits , 2000 .

[11]  Marshall L. Fisher,et al.  Optimal Solution of Scheduling Problems Using Lagrange Multipliers: Part I , 1973, Oper. Res..

[12]  C. Manski The structure of random utility models , 1977 .

[13]  Nelson Maculan,et al.  Lagrangean Decomposition In Integer Linear Programming: A New Scheme , 1992 .

[14]  Otto Anker Nielsen,et al.  Passenger arrival and waiting time distributions dependent on train service frequency and station characteristics: A smart card data analysis , 2018 .

[15]  John M. Rose,et al.  Allowing for intra-respondent variations in coefficients estimated on repeated choice data , 2009 .

[16]  Francisco Barahona,et al.  The volume algorithm: producing primal solutions with a subgradient method , 2000, Math. Program..

[17]  Michel Bierlaire,et al.  Simulation based Population Synthesis , 2013 .

[18]  Maarten H. van der Vlerk,et al.  Stochastic integer programming:General models and algorithms , 1999, Ann. Oper. Res..

[19]  Stephan Dempe,et al.  The bilevel programming problem: reformulations, constraint qualifications and optimality conditions , 2013, Math. Program..

[20]  Michel Bierlaire,et al.  Exogenous priority rules for the capacitated passenger assignment problem , 2017 .

[21]  M. Ben-Akiva,et al.  Discrete choice models with latent choice sets , 1995 .

[22]  Joseph N. Prashker,et al.  Discrete choice analysis: Theory and application to travel demand: Moshe Ben-Akiva and Steven R. Lerman. MIT Press, Cambridge, MA, 1985. 390 pp. + xx. $32.50 , 1988 .

[23]  François Vanderbeck,et al.  On Dantzig-Wolfe Decomposition in Integer Programming and ways to Perform Branching in a Branch-and-Price Algorithm , 2000, Oper. Res..

[24]  Garrett J. van Ryzin,et al.  Revenue Management Under a General Discrete Choice Model of Consumer Behavior , 2004, Manag. Sci..

[25]  Daniel McFadden,et al.  Modelling the Choice of Residential Location , 1977 .

[26]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[27]  S. Ahipasaoglu,et al.  On the flexibility of using marginal distribution choice models in traffic equilibrium , 2016 .

[28]  Marshall L. Fisher,et al.  The Lagrangian Relaxation Method for Solving Integer Programming Problems , 2004, Manag. Sci..

[29]  Xiangdong Xu,et al.  Examining the scaling effect and overlapping problem in logit-based stochastic user equilibrium models , 2012 .

[30]  Marvin Kraus,et al.  The welfare gains from pricing road congestion using automatic vehicle identification and on-vehicle meters , 1989 .

[31]  M. Fisher,et al.  A multiplier adjustment method for the generalized assignment problem , 1986 .

[32]  Andrzej Ruszczynski,et al.  On augmented Lagrangian decomposition methods for multistage stochastic programs , 1996, Ann. Oper. Res..

[33]  John M. Mulvey,et al.  A New Scenario Decomposition Method for Large-Scale Stochastic Optimization , 1995, Oper. Res..

[34]  Bilge Atasoy,et al.  Efficient Simulation-Based Toll Optimization for Large-Scale Networks , 2021, Transp. Sci..

[35]  André de Palma,et al.  Congestion pricing on a road network: A study using the dynamic equilibrium simulator METROPOLIS , 2005 .

[36]  James P. Warren,et al.  Analysing road pricing implementation processes in the UK and Norway , 2007 .

[37]  Kenneth A. Small,et al.  BUS PRIORITY AND CONGESTION PRICING ON URBAN EXPRESSWAYS , 1983 .

[38]  J. E. Kelley,et al.  The Cutting-Plane Method for Solving Convex Programs , 1960 .

[39]  Jirí V. Outrata,et al.  A note on the usage of nondifferentiable exact penalties in some special optimization problems , 1988, Kybernetika.

[40]  P. Marcotte,et al.  A bilevel model of taxation and its application to optimal highway pricing , 1996 .

[41]  Panayotis Christidis,et al.  Measuring road congestion , 2012 .

[42]  Hai-Jun Huang,et al.  Fares and tolls in a competitive system with transit and highway: the case with two groups of commuters , 2000 .

[43]  C. Lemaréchal Chapter VII Nondifferentiable optimization , 1989 .

[44]  Roberto Cominetti,et al.  Markovian traffic equilibrium , 2007, Math. Program..

[45]  Dazhi Sun,et al.  Bi‐level Programming Formulation and Heuristic Solution Approach for Dynamic Traffic Signal Optimization , 2006, Comput. Aided Civ. Infrastructure Eng..

[46]  Michel Bierlaire,et al.  Integrating advanced discrete choice models in mixed integer linear optimization , 2021 .

[47]  C. A. Guevara,et al.  Congestion pricing, transit subsidies and dedicated bus lanes: Efficient and practical solutions to congestion , 2011 .

[48]  I. Parry,et al.  Revenue Recycling and the Welfare Effects of Road Pricing , 1999 .

[49]  Antonio Frangioni,et al.  On the computational efficiency of subgradient methods: a case study with Lagrangian bounds , 2017, Mathematical Programming Computation.

[50]  Donald W. Hearn,et al.  Congestion Pricing for Multi-Modal Transportation Systems , 2007 .

[51]  Toshihiko Mukoyama Understanding the welfare effects of unemployment insurance policy in general equilibrium , 2013 .

[52]  Hai-Jun Huang,et al.  Pricing and logit-based mode choice models of a transit and highway system with elastic demand , 2002, Eur. J. Oper. Res..

[53]  R. Wets,et al.  L-SHAPED LINEAR PROGRAMS WITH APPLICATIONS TO OPTIMAL CONTROL AND STOCHASTIC PROGRAMMING. , 1969 .

[54]  Michel Bierlaire,et al.  Lagrangian relaxation for the integration of discrete choice models in mixed integer linear problems , 2017 .

[55]  Maria Grazia Scutellà,et al.  A branch-and-Benders-cut method for nonlinear power design in green wireless local area networks , 2016, Eur. J. Oper. Res..

[56]  Rüdiger Schultz,et al.  Dual decomposition in stochastic integer programming , 1999, Oper. Res. Lett..

[57]  M. Bierlaire,et al.  Integrating advanced demand models within the framework of mixed integer linear problems: A Lagrangian relaxation method for the uncapacitated case , 2017 .

[58]  Richard M. Karp,et al.  The traveling-salesman problem and minimum spanning trees: Part II , 1971, Math. Program..

[59]  K. Haase,et al.  A Multiperiod School Location Planning Approach with Free School Choice , 2009 .

[60]  Richard D. Wollmer,et al.  Two stage linear programming under uncertainty with 0–1 integer first stage variables , 1980, Math. Program..

[61]  Vsevolod I. Ivanov,et al.  Duality in nonlinear programming , 2013, Optim. Lett..

[62]  Laureano F. Escudero,et al.  Cluster Lagrangean decomposition in multistage stochastic optimization , 2016, Comput. Oper. Res..

[63]  Ignacio E. Grossmann,et al.  An outer-approximation algorithm for a class of mixed-integer nonlinear programs , 1987, Math. Program..

[64]  Gonçalo Homem de Almeida Correia,et al.  Solving the station-based one-way carsharing network planning problem with relocations and non-linear demand , 2018 .

[65]  Garrett van Ryzin,et al.  Future of Revenue Management: Models of demand , 2005 .

[66]  Glenn Lyons,et al.  Evidence based review: Attitudes to road pricing , 2004 .

[67]  Gloria Pérez,et al.  Scenario Cluster Decomposition of the Lagrangian dual in two-stage stochastic mixed 0-1 optimization , 2013, Comput. Oper. Res..

[68]  R. Lindsey,et al.  Reducing Urban Road Transportation Externalities: Road Pricing in Theory and in Practice , 2011, Review of Environmental Economics and Policy.

[69]  Garrett J. van Ryzin,et al.  On the Choice-Based Linear Programming Model for Network Revenue Management , 2008, Manuf. Serv. Oper. Manag..

[70]  R. E. Marsten,et al.  The Boxstep Method for Large-Scale Optimization , 2011, Oper. Res..

[71]  Moshe Ben-Akiva,et al.  Discrete Choice Analysis: Theory and Application to Travel Demand , 1985 .

[72]  Karthik Natarajan,et al.  Distributionally Robust Markovian Traffic Equilibrium , 2019, Transp. Sci..

[73]  Nikolas Geroliminis,et al.  An optimization framework for the development of efficient one-way car-sharing systems , 2015, Eur. J. Oper. Res..

[74]  Sven Müller,et al.  A comparison of linear reformulations for multinomial logit choice probabilities in facility location models , 2014, Eur. J. Oper. Res..

[75]  M. Guignard Lagrangean relaxation , 2003 .

[76]  Frauke Korfmann Essays on Advanced Discrete Choice Applications , 2018 .

[77]  A. Lodi,et al.  Heuristics in Mixed Integer Programming , 2011 .

[78]  Ravi Seshadri,et al.  Real-Time Predictive Control Strategy Optimization , 2019, ArXiv.

[79]  Moshe Ben-Akiva,et al.  Congestion tolling - dollars versus tokens: A comparative analysis , 2018 .

[80]  Michel Bierlaire,et al.  A new mathematical formulation to integrate supply and demand within a choice-based optimization framework , 2016 .

[81]  Gilbert Laporte,et al.  The integer L-shaped method for stochastic integer programs with complete recourse , 1993, Oper. Res. Lett..

[82]  Michel Bierlaire,et al.  Optimization: Principles and Algorithms , 2015 .

[83]  Maria Bordagaray,et al.  Modelling parking choices considering user heterogeneity , 2014 .

[84]  Stefan Voß,et al.  Public transport and road pricing: a survey and simulation experiments , 2010, Public Transp..

[85]  Cornelia Schön Market-Oriented Airline Service Design , 2006, OR.

[86]  Garrett J. van Ryzin,et al.  OM Practice - Choice-Based Revenue Management: An Empirical Study of Estimation and Optimization , 2010, Manuf. Serv. Oper. Manag..

[87]  Jean-Philippe Vial,et al.  Convex nondifferentiable optimization: A survey focused on the analytic center cutting plane method , 2002, Optim. Methods Softw..

[88]  R. Ratliff,et al.  A multi-flight recapture heuristic for estimating unconstrained demand from airline bookings , 2008 .

[89]  Z. Shen,et al.  Customer Behavior Modeling in Revenue Management and Auctions: A Review and New Research Opportunities , 2007 .

[90]  Simon Shepherd,et al.  Designing optimal urban transport strategies: The role of individual policy instruments and the impact of financial constraints , 2006 .

[91]  Joan L. Walker Extended discrete choice models : integrated framework, flexible error structures, and latent variables , 2001 .

[92]  D. Levinson Equity Effects of Road Pricing: A Review , 2010 .

[93]  Michel Bierlaire,et al.  A new mathematical representation of demand using choice-based optimization method , 2016 .

[94]  Lei Xie,et al.  Dynamic Assortment Customization with Limited Inventories , 2015, Manuf. Serv. Oper. Manag..

[95]  Teodor Gabriel Crainic,et al.  Partial Benders Decomposition Strategies for Two-Stage Stochastic Integer Programs , 2016 .

[96]  Teodor Gabriel Crainic,et al.  Scenario grouping in a progressive hedging-based meta-heuristic for stochastic network design , 2014, Comput. Oper. Res..

[97]  M. Bierlaire,et al.  Choice Probability Generating Functions , 2012 .

[98]  Huseyin Topaloglu,et al.  Revenue Management Under the Markov Chain Choice Model , 2017, Oper. Res..

[99]  Vedat Verter,et al.  The impact of client choice on preventive healthcare facility network design , 2012, OR Spectr..

[100]  Monique Guignard-Spielberg,et al.  Lagrangean decomposition: A model yielding stronger lagrangean bounds , 1987, Math. Program..

[101]  Hugo E. Silva,et al.  Efficiency and Substitutability of Transit Subsidies and Other Urban Transport Policies , 2014 .

[102]  Giuseppe Bellei,et al.  Network pricing optimization in multi-user and multimodal context with elastic demand , 2002 .

[103]  Jørgen Tind,et al.  L-shaped decomposition of two-stage stochastic programs with integer recourse , 1998, Math. Program..

[104]  Siamak Ardekani,et al.  ECONOMIC EVALUATION OF TOLL PLAZA OPERATIONS , 1991 .

[105]  Alexander Shapiro Simulation based optimization , 1996, Winter Simulation Conference.

[106]  Stephan Dempe,et al.  Is bilevel programming a special case of a mathematical program with complementarity constraints? , 2012, Math. Program..

[107]  R. Tyrrell Rockafellar,et al.  Scenarios and Policy Aggregation in Optimization Under Uncertainty , 1991, Math. Oper. Res..

[108]  F. Knight Some Fallacies in the Interpretation of Social Cost , 1924 .

[109]  Jacques F. Benders,et al.  Partitioning procedures for solving mixed-variables programming problems , 2005, Comput. Manag. Sci..

[110]  H. Williams On the Formation of Travel Demand Models and Economic Evaluation Measures of User Benefit , 1977 .

[111]  Z. Caner Taşkın Tutorial Guide to Mixed-Integer Programming Models and Solution Techniques , 2008 .

[112]  Philippe Rigo,et al.  A review on simulation-based optimization methods applied to building performance analysis , 2014 .

[113]  Y. K. Tse,et al.  Examining customer perception and behaviour through social media research – An empirical study of the United Airlines overbooking crisis , 2019, Transportation Research Part E: Logistics and Transportation Review.

[114]  Hai Yang,et al.  Design of more equitable congestion pricing and tradable credit schemes for multimodal transportation networks , 2012 .

[115]  Michael Patriksson,et al.  The Traffic Assignment Problem: Models and Methods , 2015 .

[116]  C. Fisk GAME THEORY AND TRANSPORTATION SYSTEMS MODELLING , 1984 .

[117]  Patrice Marcotte,et al.  Mixed-logit network pricing , 2014, Comput. Optim. Appl..

[118]  Tal Raviv,et al.  Regulating vehicle sharing systems through parking reservation policies: Analysis and performance bounds , 2016, Eur. J. Oper. Res..

[119]  Pierre Hansen,et al.  The maximum capture problem with random utilities: Problem formulation and algorithms , 2002, Eur. J. Oper. Res..

[120]  Michel Bierlaire,et al.  An Integrated Airline Scheduling, Fleeting, and Pricing Model for a Monopolized Market , 2014, Comput. Aided Civ. Infrastructure Eng..

[121]  Y. She Urban Transportation Networks: Equilibrium Analysis with Mathematical Programming Methods , 1985 .

[122]  Kenneth A. Small,et al.  The incidence of congestion tolls on urban highways , 1983 .

[124]  W. D. Northup,et al.  USING DUALITY TO SOLVE DISCRETE OPTIMIZATION PROBLEMS: THEORY AND COMPUTATIONAL EXPERIENCE* , 1975 .

[125]  Kalyanmoy Deb,et al.  A Review on Bilevel Optimization: From Classical to Evolutionary Approaches and Applications , 2017, IEEE Transactions on Evolutionary Computation.

[126]  J. Blanchet,et al.  A markov chain approximation to choice modeling , 2013, EC '13.

[127]  M. Bierlaire,et al.  Discrete-continuous maximum likelihood for the estimation of nested logit models , 2017 .

[128]  M. Bierlaire,et al.  Incorporating advanced behavioral models in mixed linear optimization , 2016 .

[129]  Stefan Voß,et al.  Design and evaluation of road pricing: state-of-the-art and methodological advances , 2009 .

[130]  George B. Dantzig,et al.  Decomposition Principle for Linear Programs , 1960 .

[131]  Michel Bierlaire,et al.  Integrating supply and demand within the framework of mixed integer optimization problems , 2016 .

[132]  J. Schade,et al.  Acceptability of urban transport pricing strategies , 2003 .

[133]  Ivana Ljubic,et al.  Outer approximation and submodular cuts for maximum capture facility location problems with random utilities , 2018, Eur. J. Oper. Res..

[134]  Donald Erlenkotter,et al.  A Dual-Based Procedure for Uncapacitated Facility Location , 1978, Oper. Res..

[135]  A. Ruszczynski Stochastic Programming Models , 2003 .

[136]  Vladimir Marianov,et al.  p-Hub approach for the optimal park-and-ride facility location problem , 2013, Eur. J. Oper. Res..

[137]  Stefano Benati,et al.  The maximum capture problem with heterogeneous customers , 1999, Comput. Oper. Res..

[138]  Serge P. Hoogendoorn,et al.  Hybrid Route Choice Modeling in Dynamic Traffic Assignment , 2009 .

[139]  Philip Wolfe,et al.  Validation of subgradient optimization , 1974, Math. Program..

[140]  Jeffrey I. McGill,et al.  Revenue Management: Research Overview and Prospects , 1999, Transp. Sci..

[141]  Michel Gendreau,et al.  The Benders decomposition algorithm: A literature review , 2017, Eur. J. Oper. Res..

[142]  William A. Brock,et al.  Discrete Choice with Social Interactions , 2001 .

[143]  P. Camerini,et al.  On improving relaxation methods by modified gradient techniques , 1975 .

[144]  K. Haase,et al.  Management of school locations allowing for free school choice , 2013 .

[145]  Patrice Marcotte,et al.  Logit network pricing , 2014, Comput. Oper. Res..

[146]  M. Bierlaire,et al.  Attitudes towards mode choice in Switzerland , 2013 .

[147]  Cornelia Schön Integrated airline schedule design, fleet assignment and pricing , 2008 .

[148]  Sven-Eric Andersson,et al.  Passenger choice analysis for seat capacity control: a pilot project in Scandinavian Airlines , 1998 .

[149]  M. Bierlaire,et al.  Introduction to Disaggregate Demand Models , 2013 .

[150]  Zhen Qian,et al.  A Hybrid Route Choice Model for Dynamic Traffic Assignment , 2012, Networks and Spatial Economics.

[151]  Knut Haase,et al.  Discrete location planning , 2009 .

[152]  Yukihiro Kidokoro Revenue recycling within transport networks , 2010 .

[153]  Arthur M. Geoffrion,et al.  Lagrangian Relaxation for Integer Programming , 2010, 50 Years of Integer Programming.

[154]  M. Ben-Akiva,et al.  Bayesian estimator for Logit Mixtures with inter- and intra-consumer heterogeneity , 2018, Transportation Research Part B: Methodological.

[155]  Michel Bierlaire,et al.  Integrating supply and demand within the framework of mixed integer linear problems , 2017 .

[156]  T. Ralphs,et al.  Decomposition Methods , 2010 .

[157]  Sergio R. Jara-Díaz,et al.  Integrating congestion pricing, transit subsidies and mode choice , 2012 .

[158]  A. C. Pigou Economics of welfare , 1920 .

[159]  Garth A. Gibson,et al.  Update of the handbook on external costs of transport: final report for the European Commission: DG-MOVE , 2014 .

[160]  D. McFadden,et al.  MIXED MNL MODELS FOR DISCRETE RESPONSE , 2000 .

[161]  Wilfredo F. Yushimito,et al.  A branch-and-bound algorithm for the maximum capture problem with random utilities , 2016, Eur. J. Oper. Res..

[162]  Patrice Marcotte,et al.  A Numerical Study of the Logit Network Pricing Problem , 2015, Transp. Sci..