An Enhanced Approximate Dynamic Programming Approach to On-demand Ride Pooling

Ride-pooling services have been growing in popularity, increasing the need for efficient and effective operations. The main goal of ride-pooling services is to maximize the number of passengers served while minimizing wait and delay times. However, factors such as the timing and volume of passenger requests, pick-up and drop-off locations, available vehicle capacity, and the trajectory to fulfill multiple requests introduce high degrees of uncertainty, creating challenges for ride-pooling operators. This study aims to expand the current state-of-the-art Approximate Dynamic Programming (ADP) approach for ride-pooling services, introduce key extensions, and perform a comparative analysis with the Neural Approximate Dynamic Programming (NeurADP) approach to optimize the efficiency and effectiveness of these services. Specifically, we develop an ADP approach that incorporates three important problem specifications: (i) pick-up and drop-off deadlines, (ii) vehicle rebalancing, and (iii) allowing more than two passengers in a vehicle. We conduct a detailed numerical study with the New York City taxi-cab dataset and a novel dataset of taxi-cab requests collected in the city of Chicago. We also provide a sensitivity analysis on key model parameters such as wait and delay times, passenger group sizes, and vehicle capacity, along with the investigation of the effects of vehicle rebalancing. Our comparative analysis highlights the strengths and limitations of both ADP and NeurADP methodologies. Network density and road directionality are found to significantly impact the performance. NeurADP is found to be more efficient in learning value function approximations for larger and more complex problem settings than the ADP approach. However, for smaller settings, ADP is shown to outperform NeurADP.

[1]  Yunqiang Yin,et al.  Optimization of ride-sharing with passenger transfer via deep reinforcement learning , 2023, Transportation Research Part E: Logistics and Transportation Review.

[2]  Mingyao Qi,et al.  Optimality-guaranteed algorithms on the dynamic shared-taxi problem , 2022, Transportation Research Part E: Logistics and Transportation Review.

[3]  Pradeep Varakantham,et al.  Conditional Expectation based Value Decomposition for Scalable On-Demand Ride Pooling , 2021, ArXiv.

[4]  Yafeng Yin,et al.  Optimizing matching time intervals for ride-hailing services using reinforcement learning , 2021, Transportation Research Part C: Emerging Technologies.

[5]  Siqian Shen,et al.  An Integrated Decomposition and Approximate Dynamic Programming Approach for On-Demand Ride Pooling , 2020, IEEE Transactions on Intelligent Transportation Systems.

[6]  Jintao Ke,et al.  Learning to Delay in Ride-Sourcing Systems: A Multi-Agent Deep Reinforcement Learning Framework , 2020, IEEE Transactions on Knowledge and Data Engineering.

[7]  Pradeep Varakantham,et al.  Neural Approximate Dynamic Programming for On-Demand Ride-Pooling , 2019, AAAI.

[8]  Patrick Jaillet,et al.  ZAC: A Zone Path Construction Approach for Effective Real-Time Ridesharing , 2019, ICAPS.

[9]  Warren B. Powell,et al.  Approximate Dynamic Programming for Planning a Ride-Sharing System using Autonomous Fleets of Electric Vehicles , 2018, Eur. J. Oper. Res..

[10]  Yunjun Gao,et al.  PTRider: A Price-and-Time-Aware Ridesharing System , 2018, Proc. VLDB Endow..

[11]  Jieping Ye,et al.  A Unified Approach to Route Planning for Shared Mobility , 2018, Proc. VLDB Endow..

[12]  H. Oliver Gao,et al.  A scalable non-myopic dynamic dial-a-ride and pricing problem for competitive on-demand mobility systems , 2018, Transportation Research Part C: Emerging Technologies.

[13]  Jieping Ye,et al.  Order Dispatch in Price-aware Ridesharing , 2018, Proc. VLDB Endow..

[14]  Ali Najmi,et al.  Novel dynamic formulations for real-time ride-sharing systems , 2017 .

[15]  Jieping Ye,et al.  A Taxi Order Dispatch Model based On Combinatorial Optimization , 2017, KDD.

[16]  Emilio Frazzoli,et al.  On-demand high-capacity ride-sharing via dynamic trip-vehicle assignment , 2017, Proceedings of the National Academy of Sciences.

[17]  David Silver,et al.  Deep Reinforcement Learning with Double Q-Learning , 2015, AAAI.

[18]  Warren B. Powell,et al.  An Approximate Dynamic Programming Algorithm for Large-Scale Fleet Management: A Case Application , 2009, Transp. Sci..

[19]  Panos M. Pardalos,et al.  Approximate dynamic programming: solving the curses of dimensionality , 2009, Optim. Methods Softw..

[20]  Warrren B Powell,et al.  Value Function Approximation using Multiple Aggregation for Multiattribute Resource Management , 2008 .

[21]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[22]  Warren B. Powell,et al.  Adaptive stepsizes for recursive estimation with applications in approximate dynamic programming , 2006, Machine Learning.

[23]  Pradeep Varakantham,et al.  Hierarchical Value Decomposition for Effective On-demand Ride-Pooling , 2022, AAMAS.

[24]  W. Yeoh,et al.  Improving Zonal Fairness While Maintaining Efficiency in Rideshare Matching , 2022, ATT@IJCAI.

[25]  Ted K. Ralphs,et al.  Integer and Combinatorial Optimization , 2013 .

[26]  許鉅秉,et al.  國際期刊 Transportation Research-Part E---Logistics and Transportation Review 特刊編輯補助 , 2006 .