Path Planning Algorithms for Robotic Agents

Author(s): Agharkar, Pushkarini | Advisor(s): Bullo, Francesco | Abstract: The focus of this work is path planning algorithms for autonomous agents. Specifically, we study problems in three areas where path planning to direct the motion of autonomous agents is critical for their performance. The first problem is a vehicle routing problem in which mobile demands appear in an environment and the task of the autonomous agent is to stop the demands from escaping the environment boundary. We first propose two fundamental performance bounds for the proposed problem. We then propose routing algorithms for this problem with performance guarantees. We examine the gap between these guarantees and the fundamental performance bounds. The second problem is a surveillance problem in a networked environment. The tasks of the autonomous surveillance agent in this problem are to (1) detect unknown intruder locations and (2) detect anomalies based on noisy measurements. We propose Markov chain based routing algorithms for the surveillance agent to achieve these goals. We parameterize these routing algorithms using a property of Markov chains called the mean first passage time. We also frame optimization problems to obtain optimal algorithms for the two surveillance tasks. The third problem studied in this work is a boundary guarding problem in which the task of a set of patrolling agents constrained to move on a ring is to achieve synchronization using only local communication. We propose a coordination algorithm to solve this problem and identify initial agent configurations under which synchronization is guaranteed.

[1]  J. Kaufman,et al.  Response time effectiveness: comparison of response time and survival in an urban emergency medical services system. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[2]  Emilio Frazzoli,et al.  Dynamic Vehicle Routing for Robotic Systems , 2011, Proceedings of the IEEE.

[3]  Francesco Bullo,et al.  On Dynamic Vehicle Routing With Time Constraints , 2014, IEEE Transactions on Robotics.

[4]  Carl D. Meyer,et al.  Matrix Analysis and Applied Linear Algebra , 2000 .

[5]  Martin,et al.  Finite size and dimensional dependence in the Euclidean traveling salesman problem. , 1996, Physical review letters.

[6]  D. Siegmund Sequential Analysis: Tests and Confidence Intervals , 1985 .

[7]  Luc Moreau,et al.  Stability of multiagent systems with time-dependent communication links , 2005, IEEE Transactions on Automatic Control.

[8]  P. Diaconis,et al.  Geometric Bounds for Eigenvalues of Markov Chains , 1991 .

[9]  F. Spieksma,et al.  Effective graph resistance , 2011 .

[10]  Mark Levene,et al.  Kemeny's Constant and the Random Surfer , 2002, Am. Math. Mon..

[11]  Jacques Wainer,et al.  Probabilistic Multiagent Patrolling , 2008, SBIA.

[12]  Sebastian Thrun,et al.  Robotic mapping: a survey , 2003 .

[13]  J. Baillieul,et al.  Stochastic Strategies for Autonomous Robotic Surveillance , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[14]  Sean P. Meyn,et al.  Minimax Robust Quickest Change Detection , 2009, IEEE Transactions on Information Theory.

[15]  J. Michael Steele,et al.  Probabilistic and Worst Case Analyses of Classical Problems of Combinatorial Optimization in Euclidean Space , 1990, Math. Oper. Res..

[16]  A. Albert Conditions for Positive and Nonnegative Definiteness in Terms of Pseudoinverses , 1969 .

[17]  Lada A. Adamic,et al.  The role of social networks in information diffusion , 2012, WWW.

[18]  Christos G. Cassandras,et al.  A Cooperative receding horizon controller for multivehicle uncertain environments , 2006, IEEE Transactions on Automatic Control.

[19]  Marius M. Solomon,et al.  Algorithms for the Vehicle Routing and Scheduling Problems with Time Window Constraints , 1987, Oper. Res..

[20]  Mac Schwager,et al.  Persistent Robotic Tasks: Monitoring and Sweeping in Changing Environments , 2011, IEEE Transactions on Robotics.

[21]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[22]  Emilio Frazzoli,et al.  A Stochastic and Dynamic Vehicle Routing Problem with Time Windows and Customer Impatience , 2009, Mob. Networks Appl..

[23]  Mwp Martin Savelsbergh,et al.  VEHICLE ROUTING WITH TIME WINDOWS: OPTIMIZATION AND APPROXIMATION. VEHICLE ROUTING: METHOD AND STUDIES. STUDIES IN MANAGEMENT SCIENCE AND SYSTEMS - VOLUME 16 , 1987 .

[24]  Zonghua Liu,et al.  How community structure influences epidemic spread in social networks , 2008 .

[25]  Jeffrey J. Hunter,et al.  Mathematical techniques of applied probability , 1985 .

[26]  J. F. Pierce,et al.  ON THE TRUCK DISPATCHING PROBLEM , 1971 .

[27]  Daniela Rus,et al.  Multi-robot monitoring in dynamic environments with guaranteed currency of observations , 2010, 49th IEEE Conference on Decision and Control (CDC).

[28]  Yehuda Elmaliach,et al.  A realistic model of frequency-based multi-robot polyline patrolling , 2008, AAMAS.

[29]  Yann Chevaleyre,et al.  Recent Advances on Multi-agent Patrolling , 2004, SBIA.

[30]  Michel Gendreau,et al.  Vehicle Routing Problem with Time Windows, Part I: Route Construction and Local Search Algorithms , 2005, Transp. Sci..

[31]  Jeffrey J. Hunter,et al.  Mathematical Techniques of Applied Probability Volume 2 Discrete Time Models: Techniques and Applications , 2008 .

[32]  Peter G. Doyle,et al.  Random Walks and Electric Networks: REFERENCES , 1987 .

[33]  Gilbert Laporte,et al.  Dynamic transportation of patients in hospitals , 2010, OR Spectr..

[34]  P. Varaiya,et al.  Differential games , 1971 .

[35]  Yuichi Asahiro,et al.  Grasp and Delivery for Moving Objects on Broken Lines , 2007, Theory of Computing Systems.

[36]  Steve Kirkland,et al.  Fastest expected time to mixing for a Markov chain on a directed graph , 2010 .

[37]  Antonio Franchi,et al.  On Cooperative Patrolling: Optimal Trajectories, Complexity Analysis, and Approximation Algorithms , 2011, IEEE Transactions on Robotics.

[38]  Efstathios Bakolas,et al.  Optimal pursuit of moving targets using dynamic Voronoi diagrams , 2010, 49th IEEE Conference on Decision and Control (CDC).

[39]  Gilbert Laporte,et al.  Parallel Tabu search heuristics for the dynamic multi-vehicle dial-a-ride problem , 2004, Parallel Comput..

[40]  Ira B. Schwartz,et al.  A collective motion algorithm for tracking time-dependent boundaries , 2005, Math. Comput. Simul..

[41]  Volker Gruhn,et al.  A General Vehicle Routing Problem , 2008, Eur. J. Oper. Res..

[42]  Francesco Bullo,et al.  Robotic surveillance and Markov chains with minimal first passage time , 2014, 53rd IEEE Conference on Decision and Control.

[43]  Giorgio Cannata,et al.  A Minimalist Algorithm for Multirobot Continuous Coverage , 2011, IEEE Transactions on Robotics.

[44]  Luca Schenato,et al.  A Survey on Distributed Estimation and Control Applications Using Linear Consensus Algorithms , 2010 .

[45]  Barrett W. Thomas Waiting Strategies for Anticipating Service Requests from Known Customer Locations , 2007, Transp. Sci..

[46]  David A. Anisi,et al.  Cooperative Minimum Time Surveillance With Multiple Ground Vehicles , 2010, IEEE Transactions on Automatic Control.

[47]  Ricardo G. Sanfelice,et al.  On the synchronization of two impulsive oscillators under communication constraints , 2012, 2012 American Control Conference (ACC).

[48]  Raffaello D'Andrea,et al.  Coordinating Hundreds of Cooperative, Autonomous Vehicles in Warehouses , 2007, AI Mag..

[49]  Yann Chevaleyre,et al.  Theoretical analysis of the multi-agent patrolling problem , 2004, Proceedings. IEEE/WIC/ACM International Conference on Intelligent Agent Technology, 2004. (IAT 2004)..

[50]  Dimitris Bertsimas,et al.  Stochastic and Dynamic Vehicle Routing in the Euclidean Plane with Multiple Capacitated Vehicles , 1993, Oper. Res..

[51]  Joaquín López,et al.  WatchBot: A building maintenance and surveillance system based on autonomous robots , 2013, Robotics Auton. Syst..

[52]  S. Wittevrongel,et al.  Queueing Systems , 2019, Introduction to Stochastic Processes and Simulation.

[53]  Dusan M. Stipanovic,et al.  On a stochastic robotic surveillance problem , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[54]  Lin Chen,et al.  A Game Theoretical Framework on Intrusion Detection in Heterogeneous Networks , 2009, IEEE Transactions on Information Forensics and Security.

[55]  George J. Pappas,et al.  Self-triggered coordination of robotic networks for optimal deployment , 2011, Proceedings of the 2011 American Control Conference.

[56]  Sonia Martínez,et al.  Monitoring Environmental Boundaries With a Robotic Sensor Network , 2006, IEEE Transactions on Control Systems Technology.

[57]  Karen Zita Haigh,et al.  Xavier: experience with a layered robot architecture , 1997, SGAR.

[58]  Randal W. Beard,et al.  Decentralized Perimeter Surveillance Using a Team of UAVs , 2005, IEEE Transactions on Robotics.

[59]  Jean-Jacques E. Slotine,et al.  On partial contraction analysis for coupled nonlinear oscillators , 2004, Biological Cybernetics.

[60]  José Luis Palacios Closed‐form formulas for Kirchhoff index , 2001 .

[61]  Jacques Desrosiers,et al.  Time Constrained Routing and Scheduling , 1992 .

[62]  Naomi Ehrich Leonard,et al.  Coordinated patterns of unit speed particles on a closed curve , 2007, Syst. Control. Lett..

[63]  Alex Zelikovsky,et al.  The moving-target traveling salesman problem , 2003, J. Algorithms.

[64]  L.E. Parker,et al.  Intruder detection using a wireless sensor network with an intelligent mobile robot response , 2008, IEEE SoutheastCon 2008.

[65]  Francesco Bullo,et al.  Stochastic surveillance strategies for spatial quickest detection , 2011, IEEE Conference on Decision and Control and European Control Conference.

[66]  Michel Gendreau,et al.  A review of dynamic vehicle routing problems , 2013, Eur. J. Oper. Res..

[67]  Gilbert Laporte,et al.  The vehicle routing problem: An overview of exact and approximate algorithms , 1992 .

[68]  João Pedro Hespanha,et al.  Dynamic Vehicle Routing for Translating Demands: Stability Analysis and Receding-Horizon Policies , 2010, IEEE Transactions on Automatic Control.

[69]  Jeffrey J. Hunter,et al.  Mathematical Techniques of Applied Probability. Volume 1: Discrete Time Models; Basic Theory , 1983 .

[70]  J. Hunter Generalized inverses and their application to applied probability problems , 1982 .

[71]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[72]  J. Hunter The Role of Kemeny's Constant in Properties of Markov Chains , 2012, 1208.4716.

[73]  M. Degroot Reaching a Consensus , 1974 .

[74]  Rafael Fierro,et al.  Mobile robotic sensors for perimeter detection and tracking. , 2007, ISA transactions.

[75]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.

[76]  B. Nordstrom FINITE MARKOV CHAINS , 2005 .

[77]  Martin Desrochers,et al.  A New Optimization Algorithm for the Vehicle Routing Problem with Time Windows , 1990, Oper. Res..

[78]  Bengt J. Nilsson,et al.  Approximation Results for Kinetic Variants of TSP , 1999, ICALP.

[79]  Carl F. R. Weiman,et al.  Helpmate autonomous mobile robot nav-igation system , 1991 .

[80]  Wei Ren,et al.  Information consensus in multivehicle cooperative control , 2007, IEEE Control Systems.

[81]  Bengt J. Nilsson,et al.  Approximation Results for Kinetic Variants of TSP , 2002, Discret. Comput. Geom..

[82]  Hrvoje Gold,et al.  Vehicle Routing Problem , 2008, Encyclopedia of GIS.

[83]  Emilio Frazzoli,et al.  Adaptive and Distributed Algorithms for Vehicle Routing in a Stochastic and Dynamic Environment , 2009, IEEE Transactions on Automatic Control.

[84]  Timothy W. McLain,et al.  Cooperative forest fire surveillance using a team of small unmanned air vehicles , 2006, Int. J. Syst. Sci..

[85]  Branislav Bosanský,et al.  Computing time-dependent policies for patrolling games with mobile targets , 2011, AAMAS.

[86]  Leonard Kleinrock,et al.  Queueing Systems: Volume I-Theory , 1975 .

[87]  Dimitris Bertsimas,et al.  A Stochastic and Dynamic Vehicle Routing Problem in the Euclidean Plane , 1991, Oper. Res..

[88]  Sarit Kraus,et al.  Multi-robot perimeter patrol in adversarial settings , 2008, 2008 IEEE International Conference on Robotics and Automation.

[89]  Lynne E. Parker,et al.  Behavioral control for multi-robot perimeter patrol: A Finite State Automata approach , 2009, 2009 IEEE International Conference on Robotics and Automation.

[90]  Stephen P. Boyd,et al.  Fastest Mixing Markov Chain on a Graph , 2004, SIAM Rev..

[91]  Milton Abramowitz,et al.  Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables , 1964 .

[92]  Wolfram Burgard,et al.  Experiences with an Interactive Museum Tour-Guide Robot , 1999, Artif. Intell..

[93]  V. Climenhaga Markov chains and mixing times , 2013 .

[94]  Nicolas Jozefowiez,et al.  The vehicle routing problem: Latest advances and new challenges , 2007 .

[95]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[96]  Christos D. Tarantilis,et al.  Dynamic Vehicle Routing Problems , 2014, Vehicle Routing.

[97]  Paul K. Newton,et al.  Iterated Impact Dynamics of N-Beads on a Ring , 2005, SIAM Rev..

[98]  M. Randic,et al.  Resistance distance , 1993 .

[99]  A. Patcha,et al.  A game theoretic approach to modeling intrusion detection in mobile ad hoc networks , 2004, Proceedings from the Fifth Annual IEEE SMC Information Assurance Workshop, 2004..

[100]  Stephen P. Boyd,et al.  Minimizing Effective Resistance of a Graph , 2008, SIAM Rev..

[101]  Rodolphe Sepulchre,et al.  Kick synchronization versus diffusive synchronization , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[102]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[103]  Rajeev Motwani,et al.  Approximating Capacitated Routing and Delivery Problems , 1999, SIAM J. Comput..

[104]  Ying Lan Multiple mobile robot cooperative target intercept with local coordination , 2012, 2012 24th Chinese Control and Decision Conference (CCDC).