A Reinforcement Learning Based Algorithm for Multi-hop Ride-sharing: Model-free Approach

The growth of autonomous vehicles and self driving technology will bring a shift in the way ride hailing platforms plan out their services. In this paper, we propose a novel multi-hop ride-sharing (MHRS) algorithm that uses deep reinforcement learning to learn optimal vehicle dispatch and matching decisions by interacting with the external environment. By allowing customers to transfer between vehicles, i.e., ride with one vehicle for sometime and then transfer to another one, MHRS helps in attaining 30% lower cost and 20% more efficient utilization of fleets, as compared to the ride-sharing algorithms. This flexibility of multi-hop feature gives a seamless experience to customers and ride-sharing companies, and thus improves ride-sharing services.

[1]  Shengyu Zhang,et al.  Algorithms for Trip-Vehicle Assignment in Ride-Sharing , 2018, AAAI.

[2]  Carlee Joe-Wong,et al.  MOVI: A Model-Free Approach to Dynamic Fleet Management , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[3]  Yu Zheng,et al.  Real-Time City-Scale Taxi Ridesharing , 2015, IEEE Transactions on Knowledge and Data Engineering.

[4]  R. Jayakrishnan,et al.  A Model Based on Deep Learning for Predicting Travel Mode Choice , 2017 .

[5]  John Paul Shen,et al.  Space-Time Graph Modeling of Ride Requests Based on Real-World Data , 2017, AAAI Workshops.

[6]  Jian Yang,et al.  Real-Time Multivehicle Truckload Pickup and Delivery Problems , 2004, Transp. Sci..

[7]  George J. Pappas,et al.  Taxi Dispatch With Real-Time Sensing Data in Metropolitan Areas: A Receding Horizon Control Approach , 2016, IEEE Trans Autom. Sci. Eng..

[8]  Vaneet Aggarwal,et al.  A Distributed Model-Free Algorithm for Multi-Hop Ride-Sharing Using Deep Reinforcement Learning , 2019, IEEE Transactions on Intelligent Transportation Systems.

[9]  Jie Wu,et al.  Online to Offline Business: Urban Taxi Dispatching with Passenger-Driver Matching Stability , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[10]  Todd Litman,et al.  Autonomous Vehicle Implementation Predictions: Implications for Transport Planning , 2015 .

[11]  Christoph M. Flath,et al.  The Economics of Multi-Hop Ride Sharing , 2015, Bus. Inf. Syst. Eng..

[12]  Nidhi Kalra,et al.  Autonomous Vehicle Technology: A Guide for Policymakers , 2014 .

[13]  Marco Pavone,et al.  Control of robotic mobility-on-demand systems: A queueing-theoretical perspective , 2014, Int. J. Robotics Res..

[14]  Valéria Cesário Times,et al.  ComeWithMe: An Activity-Oriented Carpooling Approach , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[15]  Theja Tulabandhula,et al.  The Costs and Benefits of Ridesharing: Sequential Individual Rationality and Sequential Fairness , 2016, ArXiv.

[16]  Patrick Jaillet,et al.  Online Vehicle Routing: The Edge of Optimization in Large-Scale Applications , 2019, Oper. Res..

[17]  David C. Wyld,et al.  Where is my suitcase? RFID and airline customer service , 2005 .

[18]  Dennis Luxen,et al.  Multi-Hop Ride Sharing , 2013, SOCS.

[19]  Vaneet Aggarwal,et al.  DeepPool: Distributed Model-Free Algorithm for Ride-Sharing Using Deep Reinforcement Learning , 2019, IEEE Transactions on Intelligent Transportation Systems.

[20]  Hamid R. Ekbia,et al.  Expanding the Design Horizon for Self-Driving Vehicles: Distributing Benefits and Burdens , 2016, IEEE Technology and Society Magazine.

[21]  Sirajum Munir,et al.  Taxi-Passenger-Demand Modeling Based on Big Data from a Roving Sensor Network , 2017, IEEE Transactions on Big Data.