Multi-Agent Pickup And Delivery Planning With Transfers

Many logistics problems require mobile agents to retrieve and deliver a set of items. For example, postal services and couriers retrieve and deliver letters and packages, while taxis pick up and drop off passengers. These problems are instances of the Pickup and Delivery Problem (PDP), in which a set of mobile agents services a set of spatially-located requests. The goal is to find a schedule that minimizes fuel usage or delivery time, under constraints such as time, vehicle capacities, and task priorities. The general PDP is a well-studied, NP-hard problem. As autonomous mobile robots become increasingly capable and available, they offer new applications of the PDP. In fact, robots are already deployed in warehouses to retrieve and prepare goods for shipping, and our CoBot robots autonomously deliver mail to occupants of an office building. Approximation algorithms and heuristics exist for some variants of the PDP, with varying levels of effectiveness. In this thesis, I will introduce a novel approach to plan for multi-agent retrievals and deliveries with transfers. Instead of having a single mobile agent retrieve and deliver each item, each agent can transfer items to other agents (or chains of agents) for delivery. By transferring items between mobile agents, a reduction in fuel cost and time is possible. Allowing transfers increases the number of possible delivery schedules exponentially, and leads to an especially challenging planning problem. In this thesis, I will address the problem of planning with transfers under various constraints, such as capacities, times, and task priorities. I will consider both the offline and the online cases, where the tasks are not known beforehand. I will evaluate the algorithms for planning with transfers both in simulation and on physical robots. I have already accomplished several steps towards my overall thesis goal of planning to retrieve and deliver items with transfers. First, I have developed an approximation algorithm, based on the construction of a minimum spanning tree, for retrieving a set of items and delivering them to a central location, with transfers only at pickup and dropoff points. I proved that this algorithm is two-approximate to the optimal solution, and showed that the optimal solution with transfers only at these fixed points in turn gives a two-approximation to the optimal solution with transfers that can occur anywhere. I showed that transferring items reduces the time taken and distance traveled, and demonstrated the algorithm on the CoBot and the CreBot robots, which perform delivery tasks requested by users in an office building. The CreBot robots transfer items autonomously by aligning their custom-built tilting trays. Second, I have developed three algorithms to plan for ridesharing with transfers, in which passengers plan to catch rides from a sequence of drivers: a greedy algorithm, an auction algorithm, and an algorithm based on finding the shortest path in a graph. Each of these algorithms provides a tradeoff between computational cost and solution effectiveness. I demonstrated on routes taken by San Francisco drivers that transferring passengers between vehicles can reduce total fuel use. Furthermore, I have developed a distributed algorithm to dispatch mobile robots to handle events detected by a wireless sensor network. In this thesis, I will extend this work to develop a distributed algorithm to plan for deliveries with transfers. My proposed remaining work for this thesis will include studying the online version of the problem, in which the delivery tasks (and the vehicle routes themselves, in the

[1]  Geir Hasle,et al.  Industrial Vehicle Routing , 2007, Geometric Modelling, Numerical Simulation, and Optimization.

[2]  Charlotte Diane Jacobs The vehicle routing problem with backhauls , 1987 .

[3]  Joseph S. B. Mitchell,et al.  Guillotine Subdivisions Approximate Polygonal Subdivisions: A Simple Polynomial-Time Approximation Scheme for Geometric TSP, k-MST, and Related Problems , 1999, SIAM J. Comput..

[4]  Jan Dethloff,et al.  Vehicle routing and reverse logistics: The vehicle routing problem with simultaneous delivery and pick-up , 2001, OR Spectr..

[5]  Fabien Lehuédé,et al.  The Dial-A-Ride Problem with Transfers , 2014, Comput. Oper. Res..

[6]  James C. Boerkoel,et al.  Distributed Algorithms for Incrementally Maintaining Multiagent Simple Temporal Networks , 2013, ICAPS.

[7]  Sam R. Thangiah,et al.  Real-time split-delivery pickup and delivery time window problems with transfers , 2007, Central Eur. J. Oper. Res..

[8]  Gilbert Laporte,et al.  The Pickup And Delivery Problem With Time Windows And Transshipment , 2006 .

[9]  Reid G. Simmons,et al.  Lessons learned from Xavier , 2000, IEEE Robotics Autom. Mag..

[10]  Roland Siegwart,et al.  Interacting Mobile Robots on the Web , 1999 .

[11]  Adam Meyerson,et al.  Approximation algorithms for deadline-TSP and vehicle routing with time-windows , 2004, STOC '04.

[12]  Pawel Zebrowski,et al.  Energy Efficient Robot Rendezvous , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[13]  Hiroshi Nagamochi,et al.  Worst Case Analysis for a Pickup and Delivery Problem with Single Transfer (Numerical Optimization methods, theory and applications) , 2008 .

[14]  Richard F. Hartl,et al.  An improved Ant System algorithm for theVehicle Routing Problem , 1999, Ann. Oper. Res..

[15]  Morton E. O'Kelly,et al.  Hub‐and‐Spoke Networks in Air Transportation: An Analytical Review , 1999 .

[16]  Susan Shaheen,et al.  Ridesharing in North America: Past, Present, and Future , 2012 .

[17]  Gilbert Laporte,et al.  Dynamic pickup and delivery problems , 2010, Eur. J. Oper. Res..

[18]  J Dethloff,et al.  Relation between vehicle routing problems: an insertion heuristic for the vehicle routing problem with simultaneous delivery and pick-up applied to the vehicle routing problem with backhauls , 2002, J. Oper. Res. Soc..

[19]  Manuela M. Veloso,et al.  Localization and navigation of the CoBots over long-term deployments , 2013, Int. J. Robotics Res..

[20]  Richard F. Hartl,et al.  A Variable Neighborhood Search for the Multi Depot Vehicle Routing Problem with Time Windows , 2004, J. Heuristics.

[21]  Martin W. P. Savelsbergh,et al.  Drive: Dynamic Routing of Independent Vehicles , 1998, Oper. Res..

[22]  Daniel J. Rosenkrantz,et al.  An Analysis of Several Heuristics for the Traveling Salesman Problem , 1977, SIAM J. Comput..

[23]  Karen Zita Haigh,et al.  A layered architecture for office delivery robots , 1997, AGENTS '97.

[24]  David Pisinger,et al.  An Adaptive Large Neighborhood Search Heuristic for the Pickup and Delivery Problem with Time Windows , 2006, Transp. Sci..

[25]  Fermín Alfredo Tang Montané,et al.  A tabu search algorithm for the vehicle routing problem with simultaneous pick-up and delivery service , 2006, Comput. Oper. Res..

[26]  Michael P. Wellman,et al.  Auction Protocols for Decentralized Scheduling , 2001, Games Econ. Behav..

[27]  Sanjeev Arora,et al.  Polynomial time approximation schemes for Euclidean traveling salesman and other geometric problems , 1998, JACM.

[28]  Allan Larsen,et al.  The Dynamic Vehicle Routing Problem , 2000 .

[29]  Manuela M. Veloso,et al.  Corrective Gradient Refinement for mobile robot localization , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Alexandr O. Ivanov,et al.  The Steiner Ratio Gilbert–Pollak Conjecture Is Still Open , 2011, Algorithmica.

[31]  Manuela M. Veloso,et al.  Effective Semi-autonomous Telepresence , 2012, RoboCup.

[32]  Manuela M. Veloso,et al.  Multi-observation sensor resetting localization with ambiguous landmarks , 2013, Auton. Robots.

[33]  Manuela M. Veloso,et al.  Scheduling mobile exploration tasks for environment learning , 2013, AAMAS.

[34]  Gregory Dudek,et al.  Collaborative Robot Exploration and Rendezvous: Algorithms, Performance Bounds and Observations , 2001, Auton. Robots.

[35]  Stephanie Rosenthal,et al.  Human-centered planning for effective tast autonomy , 2012 .

[36]  Rina Dechter,et al.  Temporal Constraint Networks , 1989, Artif. Intell..

[37]  Yu-Chee Tseng,et al.  Exploring Load-Balance to Dispatch Mobile Sensors in Wireless Sensor Networks , 2007, 2007 16th International Conference on Computer Communications and Networks.

[38]  Subbarao Kambhampati,et al.  A Theory of Intra-Agent Replanning , 2013 .

[39]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[40]  Manuela M. Veloso,et al.  Learning environmental knowledge from task-based human-robot dialog , 2013, 2013 IEEE International Conference on Robotics and Automation.

[41]  S. Abdel-Naby,et al.  Auctions Negotiation for Mobile Rideshare Service , 2007, 2007 2nd International Conference on Pervasive Computing and Applications.

[42]  Sophie N. Parragh,et al.  A survey on pickup and delivery models Part II : Transportation between pickup and delivery locations , 2007 .

[43]  Stephen F. Smith,et al.  Incremental Management of Oversubscribed Vehicle Schedules in Dynamic Dial-A-Ride Problems , 2012, AAAI.

[44]  Dimitris Sacharidis,et al.  Dynamic Pickup and Delivery with Transfers , 2011, SSTD.

[45]  Terrence Fong,et al.  Effective vehicle teleoperation on the World Wide Web , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[46]  Maged M. Dessouky,et al.  A new insertion-based construction heuristic for solving the pickup and delivery problem with time windows , 2006, Eur. J. Oper. Res..

[47]  John M. Evans,et al.  HelpMate: an autonomous mobile robot courier for hospitals , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[48]  Nidhi Kalra,et al.  Market-Based Multirobot Coordination: A Survey and Analysis , 2006, Proceedings of the IEEE.

[49]  Gilbert Laporte,et al.  Models and branch‐and‐cut algorithms for pickup and delivery problems with time windows , 2007, Networks.

[50]  T. Bektaş The multiple traveling salesman problem: an overview of formulations and solution procedures , 2006 .

[51]  Ali Haghani,et al.  Genetic Algorithm for a Pickup and Delivery Problem with Time Windows , 2000 .

[52]  Andrew Lim,et al.  A metaheuristic for the pickup and delivery problem with time windows , 2001, Proceedings 13th IEEE International Conference on Tools with Artificial Intelligence. ICTAI 2001.

[53]  Brian Coltin,et al.  Interruptable Autonomy: Towards Dialog-Based Robot Task Management , 2013, AAAI 2013.

[54]  Fabien Lehuédé,et al.  Efficient feasibility testing for request insertion in the pickup and delivery problem with transfers , 2013, Oper. Res. Lett..

[55]  Fabien Lehuédé,et al.  An Adaptive Large Neighborhood Search for the Pickup and Delivery Problem with Transfers , 2011, Transp. Sci..

[56]  Paolo Toth,et al.  Models, relaxations and exact approaches for the capacitated vehicle routing problem , 2002, Discret. Appl. Math..

[57]  Brian Coltin,et al.  Developing a Low-Cost Robot Colony , 2007, AAAI Fall Symposium: Regarding the Intelligence in Distributed Intelligent Systems.

[58]  Anthony Stentz,et al.  Multi-robot exploration controlled by a market economy , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[59]  Nicos Christofides Worst-Case Analysis of a New Heuristic for the Travelling Salesman Problem , 1976, Operations Research Forum.

[60]  Douglas A. Popken Controlling order circuity in pickup and delivery problems , 2006 .

[61]  Stephanie Rosenthal,et al.  Symbiotic-Autonomous Service Robots for User-Requested Tasks in a Multi-Floor Building , 2012, IROS 2012.

[62]  Tucker R. Balch,et al.  Behavior-based formation control for multirobot teams , 1998, IEEE Trans. Robotics Autom..

[63]  Dennis Luxen,et al.  Real-time routing with OpenStreetMap data , 2011, GIS.

[64]  Barrie M. Baker,et al.  A genetic algorithm for the vehicle routing problem , 2003, Comput. Oper. Res..

[65]  Lynne E. Parker,et al.  ALLIANCE: an architecture for fault tolerant multirobot cooperation , 1998, IEEE Trans. Robotics Autom..

[66]  Ian M. Mitchell,et al.  Efficient dynamic programming for optimal multi-location robot rendezvous , 2008, 2008 47th IEEE Conference on Decision and Control.

[67]  Wolfram Burgard,et al.  Web interfaces for mobile robots in public places , 2000, IEEE Robotics Autom. Mag..

[68]  Manuela M. Veloso,et al.  Multi-sensor Mobile Robot Localization for Diverse Environments , 2013, RoboCup.

[69]  H. Nagamochi,et al.  Worst Case Analysis for a Pickup and Delivery Problem with Single Transfer , 2010 .

[70]  Pawel Zebrowski,et al.  The Frugal Feeding Problem: Energy-efficient, multi-robot, multi-place rendezvous , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[71]  J. Wesley Barnes,et al.  Solving the Pickup and Delivery Problem with Time Windows Using Reactive Tabu Search Transportation , 2000 .

[72]  Manuela M. Veloso,et al.  Depth camera based indoor mobile robot localization and navigation , 2012, 2012 IEEE International Conference on Robotics and Automation.

[73]  Gilbert Laporte,et al.  General solutions to the single vehicle routing problem with pickups and deliveries , 2007, Eur. J. Oper. Res..

[74]  Moses Charikar,et al.  The finite capacity dial-a-ride problem , 1998, Proceedings 39th Annual Symposium on Foundations of Computer Science (Cat. No.98CB36280).

[75]  Stephanie Rosenthal,et al.  An effective personal mobile robot agent through symbiotic human-robot interaction , 2010, AAMAS.

[76]  Martín Matamala,et al.  The pickup and delivery problem with transfers: Formulation and a branch-and-cut solution method , 2010, Eur. J. Oper. Res..

[77]  Gaurav S. Sukhatme,et al.  Spreading Out: A Local Approach to Multi-robot Coverage , 2002, DARS.

[78]  Stephen F. Smith,et al.  Dynamic Management of Paratransit Vehicle Schedules , 2012 .

[79]  Ali Haghani,et al.  A dynamic vehicle routing problem with time-dependent travel times , 2005, Comput. Oper. Res..

[80]  Cláudio T. Silva,et al.  Visual Exploration of Big Spatio-Temporal Urban Data: A Study of New York City Taxi Trips , 2013, IEEE Transactions on Visualization and Computer Graphics.

[81]  Eric Horvitz,et al.  Collaboration and shared plans in the open world: studies of ridesharing , 2009, IJCAI 2009.

[82]  Saïd Salhi,et al.  Heuristic algorithms for single and multiple depot vehicle routing problems with pickups and deliveries , 2005, Eur. J. Oper. Res..

[83]  Matthias Grossglauser,et al.  A parsimonious model of mobile partitioned networks with clustering , 2009, 2009 First International Communication Systems and Networks and Workshops.

[84]  Maged M. Dessouky,et al.  An Exact Algorithm for the Multiple Vehicle Pickup and Delivery Problem , 2004, Transp. Sci..

[85]  Andrew M Amey Real-time ridesharing : exploring the opportunities and challenges of designing a technology-based rideshare trial for the MIT community , 2010 .

[86]  Francesco Mondada,et al.  KhepOnTheWeb: open access to a mobile robot on the Internet , 2000, IEEE Robotics Autom. Mag..

[87]  Gilbert Laporte,et al.  A Tabu Search Heuristic for the Static Multi-Vehicle Dial-a-Ride Problem , 2002 .

[88]  Laurent Keller,et al.  Ant-like task allocation and recruitment in cooperative robots , 2000, Nature.

[89]  Michael Weber,et al.  Evolutionary Multiobjective Route Planning in Dynamic Multi-hop Ridesharing , 2011, EvoCOP.

[90]  Rachid Alami,et al.  M+: a scheme for multi-robot cooperation through negotiated task allocation and achievement , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[91]  Evangelos Markakis,et al.  The Power of Sequential Single-Item Auctions for Agent Coordination , 2006, AAAI.

[92]  Russell Bent,et al.  A Two-Stage Hybrid Local Search for the Vehicle Routing Problem with Time Windows , 2004, Transp. Sci..

[93]  Manuela M. Veloso,et al.  Mobile robot task allocation in hybrid wireless sensor networks , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[94]  Ibrahim H. Osman,et al.  Metastrategy simulated annealing and tabu search algorithms for the vehicle routing problem , 1993, Ann. Oper. Res..

[95]  Devavrat Shah,et al.  Fundamental Performance Limits for Multi-Stage Vehicle Routing Problems , 2007 .

[96]  Manuela M. Veloso,et al.  Ridesharing with passenger transfers , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[97]  R. Ravi,et al.  Dial a Ride from k-forest , 2007, TALG.

[98]  Voratas Kachitvichyanukul,et al.  A particle swarm optimization for the vehicle routing problem with simultaneous pickup and delivery , 2009, Comput. Oper. Res..

[99]  Michael Weber,et al.  A genetic and insertion heuristic algorithm for solving the dynamic ridematching problem with time windows , 2012, GECCO '12.

[100]  Manuela M. Veloso,et al.  Optimizing for Transfers in a Multi-vehicle Collection and Delivery Problem , 2012, DARS.

[101]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[102]  Binay K. Bhattacharya,et al.  Approximation Algorithms for the Multi-Vehicle Scheduling Problem , 2010, ISAAC.

[103]  Richard F. Hartl,et al.  A survey on pickup and delivery problems , 2008 .

[104]  Kristina Lerman,et al.  Analysis of Dynamic Task Allocation in Multi-Robot Systems , 2006, Int. J. Robotics Res..

[105]  Manuela M. Veloso,et al.  Using the Web to Interactively Learn to Find Objects , 2012, AAAI.

[106]  Bernhard Nebel,et al.  A Mechanism for Dynamic Ride Sharing Based on Parallel Auctions , 2011, IJCAI.

[107]  Jean-Yves Potvin,et al.  A Tabu Search Heuristic for the Vehicle Routing Problem with Backhauls and Time Windows , 1997, Transp. Sci..

[108]  Jen S. Shang,et al.  Multicriteria pickup and delivery problem with transfer opportunity , 1996 .

[109]  Brett Browning,et al.  STP: Skills, tactics, and plays for multi-robot control in adversarial environments , 2005 .

[110]  Burak Eksioglu,et al.  The vehicle routing problem: A taxonomic review , 2009, Comput. Ind. Eng..

[111]  Gilbert Laporte,et al.  Static pickup and delivery problems: a classification scheme and survey , 2007 .

[112]  Stefan Voß,et al.  Dispatching of an Electric Monorail System: Applying Metaheuristics to an Online Pickup and Delivery Problem , 2004, Transp. Sci..

[113]  Zhi-Long Chen,et al.  Solving a Practical Pickup and Delivery Problem , 2003, Transp. Sci..

[114]  Robert B. Dial,et al.  Autonomous dial-a-ride transit introductory overview , 1995 .

[115]  Chengbin Chu,et al.  The study of a dynamic dial-a-ride problem under time-dependent and stochastic environments , 2008, Eur. J. Oper. Res..

[116]  Sophie N. Parragh,et al.  A survey on pickup and delivery problems Part I : Transportation between customers and depot , 2007 .

[117]  Manuela M. Veloso,et al.  Multi-humanoid world modeling in Standard Platform robot soccer , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[118]  Manuela M. Veloso,et al.  Dynamic User Task Scheduling for Mobile Robots , 2011, Automated Action Planning for Autonomous Mobile Robots.

[119]  Inge Li Gørtz,et al.  Minimum Makespan Multi-Vehicle Dial-a-Ride , 2009, ACM Trans. Algorithms.

[120]  Gal A. Kaminka,et al.  Integration of Coordination Mechanisms in the BITE Multi-Robot Architecture , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.