Solving Noisy, Large-Scale Fixed-Point Problems and Systems of Nonlinear Equations

Many complex transportation models can be formulated as fixed-point problems. Typical examples are the equilibrium-like models, motivated by the need to capture the interaction between the transport supply (that is, the infrastructure) and transport demand (that is, travelers behavior) in various ways. In this paper, we propose a new approach for solving fixed-point problems and, equivalently, systems of nonlinear equations. It is a generalization of secant methods, and uses several previous iterates to generate a linear approximation of the nonlinear function. Although it belongs to the quasi-Newton family of methods, our algorithm is matrix free, allowing it to solve large-scale systems of equations without derivative and without any particular assumption about the structure of the problem or its Jacobian. Computational experiments on standard problems show that this algorithm outperforms classical, large-scale quasi-Newton methods in terms of efficiency and robustness. Its numerical performances are similar to Newton-Krylov methods currently considered as the best algorithms to solve large-scale nonlinear systems of equations. Furthermore, our approach, using multiple previous iterates to build a linear approximation of the nonlinear function, exhibits robust behavior in the presence of noise in the equations, which makes it particularly well adapted to transportation problems. We run our algorithm on a simple origin-destination (OD) matrix estimation problem and on some instances of the consistent anticipatory route guidance (CARG) problem, to illustrate the applicability of the proposed method and to show its significant superiority to the classical method of successive averages (MSA). Regarding size, we were able to solve a CARG problem with more than 120,000 variables. We were also able to solve classical problems with up to two million variables.

[1]  André de Palma,et al.  Does providing information to drivers reduce traffic congestion , 1991 .

[2]  Jorge J. Moré,et al.  Testing Unconstrained Optimization Software , 1981, TOMS.

[3]  L. Luksan Inexact trust region method for large sparse systems of nonlinear equations , 1994 .

[4]  Johnson,et al.  Modified Broyden's method for accelerating convergence in self-consistent calculations. , 1988, Physical review. B, Condensed matter.

[5]  Martin L. Hazelton,et al.  Estimation of origin-destination matrices from link flows on uncongested networks , 2000 .

[6]  J. D. Perkins,et al.  A New Sparsity Preserving Quasi-Newton Update for Solving Nonlinear Equations , 1990, SIAM J. Sci. Comput..

[7]  José Mario Martínez,et al.  Comparing Algorithms for Solving Sparse Nonlinear Systems of Equations , 1992, SIAM J. Sci. Comput..

[8]  M. Bierlaire MEUSE: an origin-destination matrix estimator that exploits structure , 1995 .

[9]  Issam A. R. Moghrabi,et al.  Alternating multi-step quasi-Newton methods for unconstrained optimization , 1997 .

[10]  Márcia A. Gomes-Ruggiero,et al.  A numerical study on large-scale nonlinear solvers , 1996 .

[11]  Homer F. Walker,et al.  Least-Change Sparse Secant Update Methods with Inaccurate Secant Conditions , 1985 .

[12]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[13]  Jorge Nocedal,et al.  Representations of quasi-Newton matrices and their use in limited memory methods , 1994, Math. Program..

[14]  José Mario Martínez,et al.  Three new algorithms based on the sequential secant method , 1979 .

[15]  José Mario Martínez,et al.  A Quasi-Newton method with modification of one column per iteration , 1984, Computing.

[16]  Michael G.H. Bell,et al.  The Estimation of an Origin-Destination Matrix from Traffic Counts , 1983 .

[17]  C. Kelley Solving Nonlinear Equations with Newton's Method , 1987 .

[18]  Jon Alan Bottom,et al.  Consistent anticipatory route guidance , 2000 .

[19]  Michael Florian,et al.  Comparison of Three Methods for Dynamic Network Loading , 2001 .

[20]  Jan Vlček,et al.  Computational experience with globally convergent descent methods for large sparse systems of nonlinear equations , 1998 .

[21]  Giulio Erberto Cantarella,et al.  A General Fixed-Point Approach to Multimode Multi-User Equilibrium Assignment with Elastic Demand , 1997, Transp. Sci..

[22]  Harilaos N. Koutsopoulos,et al.  A microscopic traffic simulator for evaluation of dynamic traffic management systems , 1996 .

[23]  Philip Wolfe,et al.  The Secant method for simultaneous nonlinear equations , 1959, CACM.

[24]  C. G. Broyden A Class of Methods for Solving Nonlinear Simultaneous Equations , 1965 .

[25]  Henk J van Zuylen,et al.  The most likely trip matrix estimated from traffic counts , 1980 .

[26]  Michel Bierlaire,et al.  DynaMIT: a simulation-based system for traffic prediction and guidance generation , 1998 .

[27]  Steven G. Louie,et al.  Total energies of diamond (111) surface reconstructions by a linear combination of atomic orbitals method , 1984 .

[28]  Markos Papageorgiou,et al.  METANET: A MACROSCOPIC SIMULATION PROGRAM FOR MOTORWAY NETWORKS , 1990 .

[29]  Frank Crittin New algorithmic methods for real-time transportation problems , 2004 .

[30]  Michael Bierlaire,et al.  The total demand scale: a new measure of quality for static and dynamic origin–destination trip tables , 2002 .

[31]  Michel Bierlaire,et al.  An Efficient Algorithm for Real-Time Estimation and Prediction of Dynamic OD Tables , 2004, Oper. Res..

[32]  Hani S Mahmassani,et al.  DEVELOPMENT AND TESTING OF DYNAMIC TRAFFIC ASSIGNMENT AND SIMULATION PROCEDURES FOR ATIS/ATMS APPLICATIONS , 1994 .

[33]  Haris N. Koutsopoulos,et al.  Real Time Simulation of Traffic Demand-Supply Interactions within DynaMIT , 1999 .

[34]  Issam A. R. Moghrabi,et al.  Alternative parameter choices for multi-step Quasi-Newton methods , 1993 .

[35]  Jon D Fricker,et al.  Estimating an origin-destination table using a method based on shortest augmenting paths , 1994 .

[36]  R. D. Murphy,et al.  Iterative solution of nonlinear equations , 1994 .

[37]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[38]  J. M. Martínez,et al.  Solving nonlinear systems of equations by means of quasi-neston methods with a nonmonotone stratgy ∗ , 1997 .

[39]  S. M. Roberts,et al.  On the closed form solution of Troesch's problem , 1976 .

[40]  Mário C. Zambaldi,et al.  An inverse column-updating method for solving large–scale nonlinear systems of equations , 1992 .

[41]  Michel Gendreau,et al.  Transportation and Network Analysis: Current Trends , 2002 .

[42]  Mgh Bell,et al.  LOG-LINEAR MODELS FOR THE ESTIMATION OF ORIGIN-DESTINATION MATRICES FROM TRAFFIC COUNTS: AN APPROXIMATION , 1984 .

[43]  Guangye Li,et al.  Successive column correction algorithms for solving sparse nonlinear systems of equations , 1989, Math. Program..

[44]  Ennio Cascetta,et al.  Transportation Systems Engineering: Theory and Methods , 2001 .

[45]  Isam Kaysi,et al.  The Impact of Predictive Information on Guidance Efficiency: An Analytical Approach , 1996 .

[46]  C. T. Kelley,et al.  Superlinear Convergence and Implicit Filtering , 1999, SIAM J. Optim..

[47]  Ph. L. Toint Numerical solution of large sets of algebraic nonlinear equations , 1986 .

[48]  Haris N. Koutsopoulos,et al.  Investigation of Route Guidance Generation Issues by Simulation with DynaMIT , 1999 .

[49]  Maria Nadia Postorino,et al.  Fixed Point Approaches to the Estimation of O/D Matrices Using Traffic Counts on Congested Networks , 2001, Transp. Sci..

[50]  Randolph W. Hall,et al.  The Fastest Path through a Network with Random Time-Dependent Travel Times , 1986, Transp. Sci..

[51]  Zhijian Huang,et al.  Numerical experience with newton-like methods for nonlinear algebraic systems , 1997, Computing.

[52]  E. Cascetta Estimation of trip matrices from traffic counts and survey data: A generalized least squares estimator , 1984 .

[53]  J. J. Moré,et al.  Quasi-Newton Methods, Motivation and Theory , 1974 .

[54]  V. Eyert A Comparative Study on Methods for Convergence Acceleration of Iterative Vector Sequences , 1996 .

[55]  H. Spiess A MAXIMUM LIKELIHOOD MODEL FOR ESTIMATING ORIGIN-DESTINATION MATRICES , 1987 .

[56]  José Mario Martínez,et al.  Practical quasi-Newton methods for solving nonlinear systems , 2000 .

[57]  S. Banach Sur les opérations dans les ensembles abstraits et leur application aux équations intégrales , 1922 .

[58]  Michael A. Saunders,et al.  LSQR: An Algorithm for Sparse Linear Equations and Sparse Least Squares , 1982, TOMS.

[59]  John W. Eaton,et al.  GNU octave : a high-level interactive language for numerical computations : Octave version 2.0.17 (stable) , 1997 .

[60]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[61]  Stephen J. Wright,et al.  Numerical Optimization (Springer Series in Operations Research and Financial Engineering) , 2000 .

[62]  Y. Saad,et al.  GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems , 1986 .

[63]  Nenad Ujevic,et al.  A method for solving nonlinear equations , 2006, Appl. Math. Comput..

[64]  C. G. Broyden A simple algebraic proof of Farkas's lemma and related theorems , 1998 .

[65]  Issam A. R. Moghrabi,et al.  Multi-step quasi-Newton methods for optimization , 1994 .

[66]  C. Kelley Iterative Methods for Linear and Nonlinear Equations , 1987 .

[67]  G. Stewart,et al.  A Stable Variant of the Secant Method for Solving Nonlinear Equations , 1976 .

[68]  Moshe Ben-Akiva,et al.  Discrete Choice Models with Applications to Departure Time and Route Choice , 2003 .

[69]  Jorge J. Moré,et al.  Digital Object Identifier (DOI) 10.1007/s101070100263 , 2001 .