Online Spatio-Temporal Matching in Stochastic and Dynamic Domains

Spatio-temporal matching of services to customers online is a problem that arises on a large scale in many domains associated with shared transportation (ex: taxis, ride sharing, super shuttles, etc.) and delivery services (ex: food, equipment, clothing, home fuel, etc.). A key characteristic of these problems is that matching of services to customers in one round has a direct impact on the matching of services to customers in the next round. For instance, in the case of taxis, in the second round taxis can only pick up customers closer to the drop off point of the customer from the first round of matching. Traditionally, greedy myopic approaches have been adopted to address such large scale online matching problems. While they provide solutions in a scalable manner, due to their myopic nature the quality of matching obtained can be improved significantly (demonstrated in our experimental results). In this paper, we present a two stage stochastic optimization formulation to consider expected future demand. We then provide multiple enhancements to solve large scale problems more effectively and efficiently. Finally, we demonstrate the significant improvement provided by our techniques over myopic approaches on two real world taxi data sets.

[1]  Verena Schmid,et al.  Hybrid column generation and large neighborhood search for the dial-a-ride problem , 2013, Comput. Oper. Res..

[2]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[3]  Alan J. Hoffman,et al.  Integral Boundary Points of Convex Polyhedra , 2010, 50 Years of Integer Programming.

[4]  Mikhail Kapralov,et al.  Improved Bounds for Online Stochastic Matching , 2010, ESA.

[5]  Jian Yang,et al.  Real-Time Multivehicle Truckload Pickup and Delivery Problems , 2004, Transp. Sci..

[6]  Richard M. Karp,et al.  An optimal algorithm for on-line bipartite matching , 1990, STOC '90.

[7]  Warren B. Powell,et al.  Dynamic-Programming Approximations for Stochastic Time-Staged Integer Multicommodity-Flow Problems , 2006, INFORMS J. Comput..

[8]  Russell Bent,et al.  Regrets Only! Online Stochastic Optimization under Time Constraints , 2004, AAAI.

[9]  Yajun Wang,et al.  Two-sided Online Bipartite Matching and Vertex Cover: Beating the Greedy Algorithm , 2015, ICALP.

[10]  Richard F. Hartl,et al.  Dynamic programming based metaheuristics for the dial-a-ride problem , 2016, Ann. Oper. Res..

[11]  James K. Murphy Benders, Nested Benders and Stochastic Programming: An Intuitive Introduction , 2013, ArXiv.

[12]  John N. Tsitsiklis,et al.  Introduction to linear optimization , 1997, Athena scientific optimization and computation series.

[13]  Eduardo C. Xavier,et al.  Dynamic Taxi and Ridesharing: A Framework and Heuristics for the Optimization Problem , 2013, IJCAI.

[14]  Dimitris Bertsimas,et al.  Optimization over integers , 2005 .

[15]  Gilbert Laporte,et al.  Models and branch-and-cut algorithms for pickup and delivery problems with time windows , 2007 .

[16]  Allan Borodin,et al.  Online computation and competitive analysis , 1998 .

[17]  Csaba Szepesvári,et al.  Algorithms for Reinforcement Learning , 2010, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[18]  Leen Stougie,et al.  On-Line Dial-a-Ride Problems under a Restricted Information Model , 2002, ESA.

[19]  Russell Bent,et al.  Scenario-Based Planning for Partially Dynamic Vehicle Routing with Stochastic Customers , 2004, Oper. Res..

[20]  Hassan Artail,et al.  The shared-taxi problem: Formulation and solution methods , 2014 .

[21]  Gianpaolo Ghiani,et al.  A Comparison of Anticipatory Algorithms for the Dynamic and Stochastic Traveling Salesman Problem , 2012, Transp. Sci..

[22]  Thomas J. Walsh,et al.  Towards a Unified Theory of State Abstraction for MDPs , 2006, AI&M.

[23]  Warren B. Powell,et al.  “Approximate dynamic programming: Solving the curses of dimensionality” by Warren B. Powell , 2007, Wiley Series in Probability and Statistics.

[24]  Michael Weber,et al.  A genetic and insertion heuristic algorithm for solving the dynamic ridematching problem with time windows , 2012, GECCO '12.

[25]  Warren B. Powell,et al.  The Dynamic Assignment Problem , 2004, Transp. Sci..

[26]  Gagan Goel,et al.  Online Vertex-Weighted Bipartite Matching and Single-bid Budgeted Allocations , 2010, SODA.

[27]  Aranyak Mehta,et al.  Online budgeted matching in random input models with applications to Adwords , 2008, SODA '08.

[28]  Warren B. Powell,et al.  An Approximate Dynamic Programming Algorithm for Large-Scale Fleet Management: A Case Application , 2009, Transp. Sci..

[29]  Warren B. Powell,et al.  An Adaptive Dynamic Programming Algorithm for Dynamic Fleet Management, I: Single Period Travel Times , 2002, Transp. Sci..

[30]  Eli Upfal,et al.  Commitment under uncertainty: Two-stage stochastic matching problems , 2007, Theor. Comput. Sci..

[31]  Guangming Zhang,et al.  Dynamic planning for urban drayage operations , 2011 .

[32]  Patrick Jaillet,et al.  Dynamic Repositioning to Reduce Lost Demand in Bike Sharing Systems , 2017, J. Artif. Intell. Res..

[33]  Avrim Blum,et al.  Planning in the Presence of Cost Functions Controlled by an Adversary , 2003, ICML.

[34]  Avrim Blum,et al.  Online algorithms for market clearing , 2002, SODA '02.

[35]  Hoong Chuin Lau,et al.  Risk Based Optimization for Improving Emergency Medical Systems , 2015, AAAI.

[36]  Patrick Jaillet,et al.  Online Stochastic Matching: New Algorithms with Better Bounds , 2014, Math. Oper. Res..

[37]  Emilio Frazzoli,et al.  On-demand high-capacity ride-sharing via dynamic trip-vehicle assignment , 2017, Proceedings of the National Academy of Sciences.

[38]  Jacques F. Benders,et al.  Partitioning procedures for solving mixed-variables programming problems , 2005, Comput. Manag. Sci..

[39]  Pascal Van Hentenryck,et al.  Performance Analysis of Online Anticipatory Algorithms for Large Multistage Stochastic Integer Programs , 2007, IJCAI.

[40]  Pascal Van Hentenryck,et al.  An anytime multistep anticipatory algorithm for online stochastic combinatorial optimization , 2011, Ann. Oper. Res..

[41]  Patrick Jaillet,et al.  Dynamic Redeployment to Counter Congestion or Starvation in Vehicle Sharing Systems , 2015, SOCS.

[42]  Steffen Rebennack,et al.  Combining sampling-based and scenario-based nested Benders decomposition methods: application to stochastic dual dynamic programming , 2015, Mathematical Programming.

[43]  Leen Stougie,et al.  Online multi-server dial-a-ride problems , 2006 .

[44]  Patrick Jaillet,et al.  A stochastic algorithm for online bipartite resource allocation problems , 2016, Comput. Oper. Res..

[45]  Warren B. Powell,et al.  A Stochastic Formulation of the Dynamic Assignment Problem, with an Application to Truckload Motor Carriers , 1996, Transp. Sci..

[46]  Yu Zheng,et al.  T-share: A large-scale dynamic taxi ridesharing service , 2013, 2013 IEEE 29th International Conference on Data Engineering (ICDE).

[47]  Aranyak Mehta,et al.  Online Stochastic Matching: Beating 1-1/e , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[48]  Peter L. Bartlett,et al.  Online Learning in Markov Decision Processes with Adversarially Chosen Transition Probability Distributions , 2013, NIPS.

[49]  Yishay Mansour,et al.  Online Markov Decision Processes , 2009, Math. Oper. Res..

[50]  Amin Saberi,et al.  Online stochastic matching: online actions based on offline statistics , 2010, SODA '11.

[51]  Aranyak Mehta,et al.  Online Matching and Ad Allocation , 2013, Found. Trends Theor. Comput. Sci..

[52]  Niels A. H. Agatz,et al.  The Value of Optimization in Dynamic Ride-Sharing: A Simulation Study in Metro Atlanta , 2010 .

[53]  Alexander Shapiro,et al.  On complexity of multistage stochastic programs , 2006, Oper. Res. Lett..

[54]  Aravind Srinivasan,et al.  Allocation Problems in Ride-sharing Platforms , 2017, AAAI.

[55]  Leen Stougie,et al.  On-line single-server dial-a-ride problems , 2001, Theor. Comput. Sci..

[56]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[57]  Richard F. Hartl,et al.  A survey on dynamic and stochastic vehicle routing problems , 2016 .