Specification Decomposition and Formal Behavior Generation in Multi-Robot Systems

While autonomous robot systems are becoming increasingly common, their usage is still mostly limited to rather simple tasks. This primarily results from the need for manually programming the execut ...

[1]  Emilio Frazzoli,et al.  Vehicle Routing Problem with Metric Temporal Logic Specifications , 2008, 2008 47th IEEE Conference on Decision and Control.

[2]  Hadas Kress-Gazit,et al.  Let's talk: Autonomous conflict resolution for robots carrying out individual high-level tasks in a shared workspace , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Daniel S. Weld,et al.  UCPOP: A Sound, Complete, Partial Order Planner for ADL , 1992, KR.

[4]  Evangelos Markakis,et al.  Auction-Based Multi-Robot Routing , 2005, Robotics: Science and Systems.

[5]  Joel W. Burdick,et al.  Simultaneous model identification and task satisfaction in the presence of temporal logic constraints , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[6]  L. R. Ford,et al.  NETWORK FLOW THEORY , 1956 .

[7]  Erez Karpas,et al.  Sensible Agent Technology Improving Coordination and Communication in Biosurveillance Domains , 2009, IJCAI.

[8]  Calin Belta,et al.  Temporal Logic Motion Planning and Control With Probabilistic Satisfaction Guarantees , 2012, IEEE Transactions on Robotics.

[9]  Han-Lim Choi,et al.  Consensus-Based Decentralized Auctions for Robust Task Allocation , 2009, IEEE Transactions on Robotics.

[10]  Jan Peters,et al.  Reinforcement learning in robotics: A survey , 2013, Int. J. Robotics Res..

[11]  Lovekesh Vig,et al.  Non-additive multi-objective robot coalition formation , 2014, Expert Syst. Appl..

[12]  Evangelos Markakis,et al.  The Power of Sequential Single-Item Auctions for Agent Coordination , 2006, AAAI.

[13]  Calin Belta,et al.  Robust Satisfaction of Temporal Logic Specifications via Reinforcement Learning , 2015, ArXiv.

[14]  Ivan Serina,et al.  A Privacy-preserving Model for the Multi-agent Propositional Planning Problem , 2014, ECAI.

[15]  S. Shankar Sastry,et al.  A learning based approach to control synthesis of Markov decision processes for linear temporal logic specifications , 2014, 53rd IEEE Conference on Decision and Control.

[16]  Ufuk Topcu,et al.  Environment-Independent Task Specifications via GLTL , 2017, ArXiv.

[17]  Paolo Traverso,et al.  Automated Planning and Acting , 2016 .

[18]  Bernhard Nebel,et al.  The FF Planning System: Fast Plan Generation Through Heuristic Search , 2011, J. Artif. Intell. Res..

[19]  Amnon Shashua,et al.  Safe, Multi-Agent, Reinforcement Learning for Autonomous Driving , 2016, ArXiv.

[20]  Yi Wu,et al.  Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments , 2017, NIPS.

[21]  Manuel Lopes,et al.  Relational activity processes for modeling concurrent cooperation , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[22]  K.J. Kyriakopoulos,et al.  Automatic synthesis of multi-agent motion tasks based on LTL specifications , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[23]  Julie A. Shah,et al.  Fast Scheduling of Multi-Robot Teams with Temporospatial Constraints , 2013, Robotics: Science and Systems.

[24]  Giuseppe De Giacomo,et al.  Linear Temporal Logic and Linear Dynamic Logic on Finite Traces , 2013, IJCAI.

[25]  Hakim Mitiche,et al.  A taxonomy for task allocation problems with temporal and ordering constraints , 2017, Robotics Auton. Syst..

[26]  Daniele Magazzeni,et al.  Short-Term Human-Robot Interaction through Conditional Planning and Execution , 2017, ICAPS.

[27]  Stephen Cresswell,et al.  Compilation of LTL Goal Formulas into PDDL , 2004, ECAI.

[28]  Dimos V. Dimarogonas,et al.  Decomposition of Finite LTL Specifications for Efficient Multi-agent Planning , 2016, DARS.

[29]  Patrik Haslum,et al.  Deterministic planning in the fifth international planning competition: PDDL3 and experimental evaluation of the planners , 2009, Artif. Intell..

[30]  Dejan Nickovic,et al.  Monitoring Temporal Properties of Continuous Signals , 2004, FORMATS/FTRTFT.

[31]  Pedro U. Lima,et al.  LTL-based decentralized supervisory control of multi-robot tasks modelled as petri nets , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Ufuk Topcu,et al.  Efficient reactive controller synthesis for a fragment of linear temporal logic , 2013, 2013 IEEE International Conference on Robotics and Automation.

[33]  Gerard J. Holzmann,et al.  The SPIN Model Checker - primer and reference manual , 2003 .

[34]  Patrik Haslum,et al.  Domain-Independent Construction of Pattern Database Heuristics for Cost-Optimal Planning , 2007, AAAI.

[35]  Emilio Frazzoli,et al.  On-demand high-capacity ride-sharing via dynamic trip-vehicle assignment , 2017, Proceedings of the National Academy of Sciences.

[36]  Nathan R. Sturtevant,et al.  Conflict-based search for optimal multi-agent pathfinding , 2012, Artif. Intell..

[37]  Sven Koenig,et al.  Multi-Agent Path Finding with Delay Probabilities , 2016, AAAI.

[38]  Dimos V. Dimarogonas,et al.  Cooperative decentralized multi-agent control under local LTL tasks and connectivity constraints , 2014, 53rd IEEE Conference on Decision and Control.

[39]  Sridhar Mahadevan,et al.  Coarticulation: an approach for generating concurrent plans in Markov decision processes , 2005, ICML.

[40]  Daniela Rus,et al.  Multi-robot path planning for a swarm of robots that can both fly and drive , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[41]  Yushan Chen,et al.  Formal Approach to the Deployment of Distributed Robotic Teams , 2012, IEEE Transactions on Robotics.

[42]  Dimos V. Dimarogonas,et al.  Multi-objective search for optimal multi-robot planning with finite LTL specifications and resource constraints , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[43]  Gethin Norman,et al.  Verification and control of partially observable probabilistic systems , 2017, Real-Time Systems.

[44]  Marco Montali,et al.  Reasoning on LTL on Finite Traces: Insensitivity to Infiniteness , 2014, AAAI.

[45]  Martin W. P. Savelsbergh,et al.  Optimization for dynamic ride-sharing: A review , 2012, Eur. J. Oper. Res..

[46]  Anatol Rapoport,et al.  Theories of Coalition Formation , 1998 .

[47]  Hadas Kress-Gazit,et al.  Reactive high-level behavior synthesis for an Atlas humanoid robot , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[48]  Nikos A. Vlassis,et al.  Collaborative Multiagent Reinforcement Learning by Payoff Propagation , 2006, J. Mach. Learn. Res..

[49]  Pierre Wolper,et al.  Simple on-the-fly automatic verification of linear temporal logic , 1995, PSTV.

[50]  Davide Bicego,et al.  Towards robotic MAGMaS: Multiple aerial-ground manipulator systems , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[51]  Bengt Jonsson,et al.  A logic for reasoning about time and reliability , 1990, Formal Aspects of Computing.

[52]  Xavier Gandibleux,et al.  Martins' algorithm revisited for multi-objective shortest path problems with a MaxMin cost function , 2006, 4OR.

[53]  Alberto Martelli,et al.  Optimizing decision trees through heuristically guided search , 1978, CACM.

[54]  Calin Belta,et al.  A Hierarchical Reinforcement Learning Method for Persistent Time-Sensitive Tasks , 2016, ArXiv.

[55]  E. Martins.  On a multicriteria shortest path problem , 1984 .

[56]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[57]  Gerhard Lakemeyer,et al.  On the Synthesis of Guaranteed-Quality Plans for Robot Fleets in Logistics Scenarios via Optimization Modulo Theories , 2017, 2017 IEEE International Conference on Information Reuse and Integration (IRI).

[58]  Sylvie Thiébaux,et al.  Heuristic Search in Dual Space for Constrained Stochastic Shortest Path Problems , 2016, ICAPS.

[59]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[60]  Hong Xu,et al.  Improved Solvers for Bounded-Suboptimal Multi-Agent Path Finding , 2016, IJCAI.

[61]  Nathan Michael,et al.  An MDP-based approximation method for goal constrained multi-MAV planning under action uncertainty , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[62]  Vijay Kumar,et al.  Distributed multi-robot task assignment and formation control , 2008, 2008 IEEE International Conference on Robotics and Automation.

[63]  Jie Fu,et al.  Concurrent multi-agent systems with temporal logic objectives: game theoretic analysis and planning through negotiation , 2015 .

[64]  Alin Stefanescu,et al.  Automatic synthesis of distributed transition systems , 2006 .

[65]  Nidhi Kalra,et al.  Hoplites: A Market-Based Framework for Planned Tight Coordination in Multirobot Teams , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[66]  Zhang Liu,et al.  Interior-point methods for large-scale cone programming , 2011 .

[67]  Vijay Kumar,et al.  An Approximation Algorithm for Time Optimal Multi-Robot Routing , 2014, WAFR.

[68]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[69]  Dimos V. Dimarogonas,et al.  Cooperative task planning of multi-agent systems under timed temporal specifications , 2016, 2016 American Control Conference (ACC).

[70]  Pierre Wolper,et al.  Constructing Automata from Temporal Logic Formulas: A Tutorial , 2002, European Educational Forum: School on Formal Methods and Performance Analysis.

[71]  Nidhi Kalra,et al.  Market-Based Multirobot Coordination: A Survey and Analysis , 2006, Proceedings of the IEEE.

[72]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[73]  Robert Givan,et al.  FF-Replan: A Baseline for Probabilistic Planning , 2007, ICAPS.

[74]  Carmel Domshlak,et al.  Landmarks, Critical Paths and Abstractions: What's the Difference Anyway? , 2009, ICAPS.

[75]  Nicholas R. Jennings,et al.  Learning to be Competitive in the Market , 1999, AAAI 1999.

[76]  Stephen F. Smith,et al.  Smart Urban Signal Networks: Initial Application of the SURTRAC Adaptive Traffic Signal Control System , 2013, ICAPS.

[77]  Emilio Frazzoli,et al.  Provably safe and deadlock-free execution of multi-robot plans under delaying disturbances , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[78]  Andreas Krause,et al.  Advances in Neural Information Processing Systems (NIPS) , 2014 .

[79]  Howie Choset,et al.  M*: A complete multirobot path planning algorithm with performance bounds , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[80]  Sergey Levine,et al.  Trust Region Policy Optimization , 2015, ICML.

[81]  Pieter Abbeel,et al.  Constrained Policy Optimization , 2017, ICML.

[82]  George J. Pappas,et al.  Robustness of temporal logic specifications for continuous-time signals , 2009, Theor. Comput. Sci..

[83]  Guy Desaulniers,et al.  The shortest path problem with forbidden paths , 2002, Eur. J. Oper. Res..

[84]  Christel Baier,et al.  Principles of model checking , 2008 .

[85]  Dimos V. Dimarogonas,et al.  Decomposition of multi-agent planning under distributed motion and task LTL specifications , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[86]  Eva Onaindia,et al.  Cooperative Multi-Agent Planning , 2017, ACM Comput. Surv..

[87]  Calin Belta,et al.  Minimum-violation scLTL motion planning for mobility-on-demand , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[88]  Panagiotis Tsiotras,et al.  Hierarchical state abstractions for decision-making problems with computational constraints , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[89]  Tom Duckett,et al.  FreMEn: Frequency Map Enhancement for Long-Term Mobile Robot Autonomy in Changing Environments , 2017, IEEE Transactions on Robotics.

[90]  Jingjin Yu,et al.  Constant Factor Time Optimal Multi-Robot Routing on High-Dimensional Grids in Mostly Sub-Quadratic Time , 2018, Robotics: Science and Systems.

[91]  Calin Belta,et al.  Provably Correct Persistent Surveillance for Unmanned Aerial Vehicles Subject to Charging Constraints , 2014, ISER.

[92]  R. Bellman.  A Markovian Decision Process , 1957 .

[93]  Malte Helmert,et al.  The Fast Downward Planning System , 2006, J. Artif. Intell. Res..

[94]  Seyedshams Feyzabadi,et al.  Risk-aware path planning using hirerachical constrained Markov Decision Processes , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[95]  Timothy Patten,et al.  Decentralised Monte Carlo Tree Search for Active Perception , 2016, WAFR.

[96]  Nick Hawes,et al.  Task scheduling for mobile robots using interval algebra , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[97]  Mathijs de Weerdt,et al.  Bounding the Probability of Resource Constraint Violations in Multi-Agent MDPs , 2017, AAAI.

[98]  Natàlia Hurtós,et al.  ROSPlan: Planning in the Robot Operating System , 2015, ICAPS.

[99]  Manuel Lopes,et al.  Efficient behavior learning in human–robot collaboration , 2018, Auton. Robots.

[100]  Marc Toussaint,et al.  Differentiable Physics and Stable Modes for Tool-Use and Manipulation Planning , 2018, Robotics: Science and Systems.

[101]  Natashia Boland,et al.  Accelerated label setting algorithms for the elementary resource constrained shortest path problem , 2006, Oper. Res. Lett..

[102]  Scott Sanner,et al.  Bayesian Real-Time Dynamic Programming , 2009, IJCAI.

[103]  T. Lindvall.  ON A ROUTING PROBLEM , 2004, Probability in the Engineering and Informational Sciences.

[104]  Rüdiger Ehlers,et al.  Generalized Rabin(1) Synthesis with Applications to Robust System Synthesis , 2011, NASA Formal Methods.

[105]  J. M. Paixão,et al.  Labeling Methods for the General Case of the Multi-objective Shortest Path Problem – A Computational Study , 2013 .

[106]  Thomas A. Henzinger,et al.  The benefits of relaxing punctuality , 1991, PODC '91.

[107]  Calin Belta,et al.  Optimality and Robustness in Multi-Robot Path Planning with Temporal Logic Constraints , 2013, Int. J. Robotics Res..

[108]  Moshe Y. Vardi.  An Automata-Theoretic Approach to Linear Temporal Logic , 1996, Banff Higher Order Workshop.

[109]  Jendrik Seipp,et al.  Counterexample-Guided Cartesian Abstraction Refinement , 2013, ICAPS.

[110]  P. M. Shiroma,et al.  CoMutaR: A framework for multi-robot coordination and task allocation , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[111]  Raghvendra V. Cowlagi,et al.  Motion-planning with linear temporal logic specifications for a nonholonomic vehicle kinematic model , 2016, 2016 American Control Conference (ACC).

[112]  Patrice Perny,et al.  On Finding Compromise Solutions in Multiobjective Markov Decision Processes , 2010, ECAI.

[113]  Calin Belta,et al.  LTL Control in Uncertain Environments with Probabilistic Satisfaction Guarantees , 2011, ArXiv.

[114]  T. Bektaş.  The multiple traveling salesman problem: an overview of formulations and solution procedures , 2006 .

[115]  Nick Hawes,et al.  Multi-Objective Policy Generation for Mobile Robots under Probabilistic Time-Bounded Guarantees , 2017, ICAPS.

[116]  Calin Belta,et al.  Optimal path planning for surveillance with temporal-logic constraints* , 2011, Int. J. Robotics Res..

[117]  Marta Z. Kwiatkowska,et al.  PRISM 4.0: Verification of Probabilistic Real-Time Systems , 2011, CAV.

[118]  Ron Koymans,et al.  Specifying real-time properties with metric temporal logic , 1990, Real-Time Systems.

[119]  Mark Reynolds,et al.  Continuous Temporal Models , 2001, Australian Joint Conference on Artificial Intelligence.

[120]  Steven Lake Waslander,et al.  Planning Paths for Package Delivery in Heterogeneous Multirobot Teams , 2015, IEEE Transactions on Automation Science and Engineering.

[121]  Mathias Bürger,et al.  On the Design of Penalty Structures for Minimum-Violation LTL Motion Planning , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[122]  Jie Fu,et al.  Sampling-based approximate optimal temporal logic planning , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[123]  Hadas Kress-Gazit,et al.  Temporal-Logic-Based Reactive Mission and Motion Planning , 2009, IEEE Transactions on Robotics.

[124]  Malik Ghallab,et al.  Planning and Robotics (Dagstuhl Seminar 17031) , 2017, Dagstuhl Reports.

[125]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[126]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[127]  László Lovász,et al.  Semi-matchings for bipartite graphs and load balancing , 2003, J. Algorithms.

[128]  Maja J. Mataric,et al.  Sold!: auction methods for multirobot coordination , 2002, IEEE Trans. Robotics Autom..

[129]  Michael Brenner.  A Multiagent Planning Language , 2003 .

[130]  Changjoo Nam,et al.  Bundling Policies for Sequential Stochastic Tasks in Multi-robot Systems , 2016, DARS.

[131]  Amir Pnueli,et al.  Synthesis of Reactive(1) designs , 2006, J. Comput. Syst. Sci..

[132]  Lydia E. Kavraki,et al.  Asymptotically Optimal Stochastic Motion Planning with Temporal Goals , 2014, WAFR.

[133]  Yushan Chen,et al.  LTL robot motion control based on automata learning of environmental dynamics , 2012, 2012 IEEE International Conference on Robotics and Automation.

[134]  Dimos V. Dimarogonas,et al.  Multi-agent planning under local LTL specifications and event-based synchronization , 2016, Autom..

[135]  Gaurav S. Sukhatme,et al.  Informative planning and online learning with sparse Gaussian processes , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[136]  Dimos V. Dimarogonas,et al.  Improving Multi-Robot Behavior Using Learning-Based Receding Horizon Task Allocation , 2018, Robotics: Science and Systems.

[137]  David W. Pentico,et al.  Assignment problems: A golden anniversary survey , 2007, Eur. J. Oper. Res..

[138]  John Lygeros,et al.  The Linear Programming Approach to Reach-Avoid Problems for Markov Decision Processes , 2014, J. Artif. Intell. Res..

[139]  Oskar von Stryk,et al.  A Comprehensive Software Framework for Complex Locomotion and Manipulation Tasks Applicable to Different Types of Humanoid Robots , 2016, Front. Robot. AI.

[140]  Sven Koenig,et al.  Optimal Target Assignment and Path Finding for Teams of Agents , 2016, AAMAS.

[141]  Sean Luke,et al.  Cooperative Multi-Agent Learning: The State of the Art , 2005, Autonomous Agents and Multi-Agent Systems.

[142]  Calin Belta,et al.  Q-Learning for robust satisfaction of signal temporal logic specifications , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[143]  Amir Pnueli,et al.  On the synthesis of a reactive module , 1989, POPL '89.

[144]  Håkan L. S. Younes,et al.  PPDDL 1 . 0 : An Extension to PDDL for Expressing Planning Domains with Probabilistic Effects , 2004 .

[145]  Rupak Majumdar,et al.  Antlab: A Multi-Robot Task Server , 2017, ACM Trans. Embed. Comput. Syst..

[146]  Xu Chu Ding,et al.  Strategic planning under uncertainties via constrained Markov Decision Processes , 2013, 2013 IEEE International Conference on Robotics and Automation.

[147]  Andrew Coles,et al.  Forward-Chaining Partial-Order Planning , 2010, ICAPS.

[148]  Dimos V. Dimarogonas,et al.  A receding horizon approach to multi-agent planning from local LTL specifications , 2014, 2014 American Control Conference.

[149]  Peng Dai,et al.  Focused Topological Value Iteration , 2009, ICAPS.

[150]  Calin Belta,et al.  Time window temporal logic , 2017, Theor. Comput. Sci..

[151]  Thomas G. Dietterich.  Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition , 1999, J. Artif. Intell. Res..

[152]  Dimos V. Dimarogonas,et al.  Simultaneous task allocation and planning for temporal logic goals in heterogeneous multi-robot systems , 2018, Int. J. Robotics Res..

[153]  Doina Precup,et al.  Between MDPs and Semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning , 1999, Artif. Intell..

[154]  Sven Koenig,et al.  Sequential Bundle-Bid Single-Sale Auction Algorithms for Decentralized Control , 2007, IJCAI.

[155]  Tae-Eog Lee,et al.  Automata-based supervisory control logic design for a multi-robot assembly cell , 2002, Int. J. Comput. Integr. Manuf..

[156]  Yushan Chen,et al.  An Approximate Dynamic Programming Approach to Multiagent Persistent Monitoring in Stochastic Environments With Temporal Logic Constraints , 2017, IEEE Transactions on Automatic Control.

[157]  S. Sieber.  On a decision method in restricted second-order arithmetic , 1960 .

[158]  Nick Hawes,et al.  Optimal Policy Generation for Partially Satisfiable Co-Safe LTL Specifications , 2015, IJCAI.

[159]  Emilio Frazzoli,et al.  Linear temporal logic vehicle routing with applications to multi‐UAV mission planning , 2011 .

[160]  Bart De Schutter,et al.  A Comprehensive Survey of Multiagent Reinforcement Learning , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[161]  Calin Belta,et al.  A probabilistic approach for control of a stochastic system from LTL specifications , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[162]  Oskar von Stryk,et al.  Human-robot collaborative high-level control with application to rescue robotics , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[163]  Ufuk Topcu,et al.  Synthesis of Control Protocols for Autonomous Systems , 2013 .

[164]  Antonio Bicchi,et al.  Symbolic planning and control of robot motion [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[165]  Anthony Stentz,et al.  Complex Task Allocation For Multiple Robots , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[166]  Cristian Mahulea,et al.  Accomplish multi-robot tasks via Petri net models , 2015, 2015 IEEE International Conference on Automation Science and Engineering (CASE).

[167]  John N. Tsitsiklis,et al.  Neuro-dynamic programming: an overview , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[168]  Dimos V. Dimarogonas,et al.  Bottom-up motion and task coordination for loosely-coupled multi-agent systems with dependent local tasks , 2015, 2015 IEEE International Conference on Automation Science and Engineering (CASE).

[169]  Ufuk Topcu,et al.  Optimal control in Markov decision processes via distributed optimization , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[170]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[171]  Ahmed M. Elmogy,et al.  Multi-robot Task Allocation: A Review of the State-of-the-Art , 2015, Advances in Social Media Analysis.

[172]  Hadas Kress-Gazit,et al.  Collaborative Autonomy between High‐level Behaviors and Human Operators for Remote Manipulation Tasks using Different Humanoid Robots , 2017, J. Field Robotics.

[173]  Calin Belta,et al.  Formal Methods for Discrete-Time Dynamical Systems , 2017 .

[174]  Anthony Stentz,et al.  Traderbots: a new paradigm for robust and efficient multirobot coordination in dynamic environments , 2004 .

[175]  Krishnendu Chatterjee,et al.  Qualitative analysis of POMDPs with temporal logic specifications for robotics applications , 2014, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[176]  Stefan Irnich,et al.  Shortest Path Problems with Resource Constraints , 2005 .

[177]  Orna Kupferman,et al.  Model Checking of Safety Properties , 1999, Formal Methods Syst. Des..

[178]  Patrizio Pelliccione,et al.  Variability Modeling of Service Robots: Experiences and Challenges , 2019, VaMoS.

[179]  Anthony Stentz,et al.  A comprehensive taxonomy for multi-robot task allocation , 2013, Int. J. Robotics Res..

[180]  Marta Z. Kwiatkowska,et al.  Pareto Curves for Probabilistic Model Checking , 2012, ATVA.

[181]  Blai Bonet,et al.  Planning as heuristic search , 2001, Artif. Intell..

[182]  Dimos V. Dimarogonas,et al.  Auctioning over Probabilistic Options for Temporal Logic-Based Multi-Robot Cooperation Under Uncertainty , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[183]  Magnus Egerstedt,et al.  A Distributed Version of the Hungarian Method for Multirobot Assignment , 2017, IEEE Transactions on Robotics.

[184]  Jan Maluszy¿ski.  Verification, Model Checking, and Abstract Interpretation , 2009, Lecture Notes in Computer Science.

[185]  Jonathan P. How,et al.  Decentralized control of multi-robot partially observable Markov decision processes using belief space macro-actions , 2017, Int. J. Robotics Res..

[186]  Fabio Maria Carlucci,et al.  Explicit representation of social norms for social robots , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[187]  Steven M. LaValle,et al.  Optimal Multirobot Path Planning on Graphs: Complete Algorithms and Effective Heuristics , 2015, IEEE Transactions on Robotics.

[188]  Calin Belta,et al.  LTL receding horizon control for finite deterministic systems , 2014, Autom..

[189]  Edwin P. D. Pednault,et al.  ADL: Exploring the Middle Ground Between STRIPS and the Situation Calculus , 1989, KR.

[190]  Insoon Yang,et al.  Safety-Aware Optimal Control of Stochastic Systems Using Conditional Value-at-Risk , 2018, 2018 Annual American Control Conference (ACC).

[191]  Shlomo Zilberstein,et al.  Memory-Bounded Dynamic Programming for DEC-POMDPs , 2007, IJCAI.

[192]  Ufuk Topcu,et al.  TuLiP: a software toolbox for receding horizon temporal logic planning , 2011, HSCC '11.

[193]  Ronen I. Brafman,et al.  From One to Many: Planning for Loosely Coupled Multi-Agent Systems , 2008, ICAPS.

[194]  Rainer E. Burkard,et al.  Linear Assignment Problems and Extensions , 1999, Handbook of Combinatorial Optimization.

[195]  Nick Hawes,et al.  Simultaneous Task Allocation and Planning Under Uncertainty , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[196]  Ufuk Topcu,et al.  Optimization-based trajectory generation with linear temporal logic specifications , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[197]  Jonathan P. How,et al.  Predictive positioning and quality of service ridesharing for campus mobility on demand systems , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[198]  Ufuk Topcu,et al.  Robust control of uncertain Markov Decision Processes with temporal logic specifications , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[199]  Lucas Beyer,et al.  The STRANDS Project: Long-Term Autonomy in Everyday Environments , 2016, IEEE Robotics Autom. Mag..

[200]  Julie A. Adams,et al.  Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence , 2001, AI Mag..

[201]  Calin Belta,et al.  Reactive sampling-based temporal logic path planning , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[202]  Alexandre Duret-Lutz,et al.  Spot 2 . 0 — a framework for LTL and ω-automata manipulation , 2016 .

[203]  Sridhar Mahadevan,et al.  Recent Advances in Hierarchical Reinforcement Learning , 2003, Discret. Event Dyn. Syst..

[204]  Sven Koenig,et al.  Bounded Suboptimal Multi-Agent Path Finding Using Highways , 2016, IJCAI.

[205]  Shlomo Zilberstein,et al.  Heuristic Search in Cyclic AND/OR Graphs , 1998, AAAI/IAAI.

[206]  Sridhar Mahadevan,et al.  Hierarchical Multiagent Reinforcement Learning , 2004 .

[207]  Vijay Kumar,et al.  Automated composition of motion primitives for multi-robot systems from safe LTL specifications , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[208]  D. Bertsekas.  The auction algorithm: A distributed relaxation method for the assignment problem , 1988 .

[209]  A. Agung Julius,et al.  An MILP approach for real-time optimal controller synthesis with Metric Temporal Logic specifications , 2016, 2016 American Control Conference (ACC).

[210]  Calin Belta,et al.  Robust multi-robot optimal path planning with temporal logic constraints , 2012, 2012 IEEE International Conference on Robotics and Automation.

[211]  Craig A. Knoblock,et al.  PDDL-the planning domain definition language , 1998 .

[212]  Fahiem Bacchus,et al.  Planning for temporally extended goals , 1996, Annals of Mathematics and Artificial Intelligence.

[213]  Carla Limongelli,et al.  Linear temporal logic as an executable semantics for planning languages , 2007, J. Log. Lang. Inf..

[214]  Hadas Kress-Gazit,et al.  Synthesis for multi-robot controllers with interleaved motion , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[215]  Calin Belta,et al.  Automatic Deployment of Distributed Teams of Robots From Temporal Logic Motion Specifications , 2010, IEEE Transactions on Robotics.

[216]  Christel Baier,et al.  Reduction Techniques for Model Checking Markov Decision Processes , 2008, 2008 Fifth International Conference on Quantitative Evaluation of Systems.

[217]  Calin Belta,et al.  Reinforcement learning with temporal logic rewards , 2016, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[218]  Maria Fox,et al.  AUV mission control via temporal planning , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[219]  Michal Stolba,et al.  Competition of Distributed and Multiagent Planners (CoDMAP) , 2016, AAAI.

[220]  Nick Hawes,et al.  Optimal and dynamic planning for Markov decision processes with co-safe LTL specifications , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[221]  Geoffrey J. Gordon,et al.  Multi-robot coordination and competition using mixed integer and linear programs , 2004 .

[222]  Ugur Kuter,et al.  Incremental plan aggregation for generating policies in MDPs , 2010, AAMAS.

[223]  Reid G. Smith,et al.  The Contract Net Protocol: High-Level Communication and Control in a Distributed Problem Solver , 1980, IEEE Transactions on Computers.

[224]  Marc Hanheide,et al.  Now or later? Predicting and maximising success of navigation actions from long-term experience , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[225]  Lynne E. Parker,et al.  Decision Making as Optimization in Multi-robot Teams , 2012, ICDCIT.

[226]  Henrik I. Christensen,et al.  Learning Task Performance in Market-Based Task Allocation , 2012, IAS.

[227]  Ronen I. Brafman,et al.  Distributed Heuristic Forward Search for Multi-agent Planning , 2014, J. Artif. Intell. Res..

[228]  Paul Gastin,et al.  Fast LTL to Büchi Automata Translation , 2001, CAV.

[229]  E.L. Lawler,et al.  Optimization and Approximation in Deterministic Sequencing and Scheduling: a Survey , 1977 .

[230]  Hadas Kress-Gazit,et al.  Iterative Temporal Planning in Uncertain Environments With Partial Satisfaction Guarantees , 2016, IEEE Transactions on Robotics.

[231]  Hadas Kress-Gazit,et al.  Temporal logic robot mission planning for slow and fast actions , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[232]  George J. Pappas,et al.  Translating Temporal Logic to Controller Specifications , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[233]  Hadas Kress-Gazit,et al.  Collaborative Autonomy Between High-Level Behaviors and Human Operators for Control of Complex Tasks with Different Humanoid Robots , 2018 .

[234]  Anthony Stentz,et al.  An auction-based approach to complex task allocation for multirobot teams , 2006 .

[235]  Blai Bonet,et al.  Strengthening Landmark Heuristics via Hitting Sets , 2010, ECAI.

[236]  Shimon Whiteson,et al.  A Survey of Multi-Objective Sequential Decision-Making , 2013, J. Artif. Intell. Res..

[237]  D. Bertsekas,et al.  Parallel asynchronous label-correcting methods for shortest paths , 1996 .

[238]  Calin Belta,et al.  Finite state abstraction and formal methods for traffic flow networks , 2016, 2016 American Control Conference (ACC).

[239]  Jorge A. Baier,et al.  Planning with First-Order Temporally Extended Goals using Heuristic Search , 2006, AAAI.

[240]  Hadas Kress-Gazit,et al.  Synthesis for Robots: Guarantees and Feedback for Robot Behavior , 2018, Annu. Rev. Control. Robotics Auton. Syst..