Multi-robot systems in cognitive factories: representation, reasoning, execution and monitoring

We propose the use of causality-based formal representation and automated reasoning methods from artificial intelligence to endow multiple teams of robots in a factory, with high-level cognitive capabilities, such as optimal planning and diagnostic reasoning. We present a framework that features bilateral interaction between task and motion planning, and embeds geometric reasoning in causal reasoning. We embed this planning framework inside an execution and monitoring framework and show its applicability on multi-robot systems. In particular, we focus on two domains that are relevant to cognitive factories: i) a manipulation domain with multiple robots working concurrently / co-operatively to achieve a common goal and ii) a factory domain with multiple teams of robots utilizing shared resources. In the manipulation domain two pantograph robots perform a complex task that requires true concurrency. The monitoring framework checks plan execution for two sorts of failures: collisions with unknown obstacles and change of the world due to human interventions. Depending on the cause of the failures, recovery is done by calling the motion planner (to find a different trajectory) or the causal reasoner (to find a new task plan). Therefore, recovery relies on not only motion planning but also causal reasoning. We extend our planning and monitoring framework for the factory domain with multiple teams of robots by introducing algorithms for finding optimal decoupled plans and diagnosing the cause of a failure/discrepancy (e.g., robots may get broken or tasks may get reassigned to teams). We show the applicability of these algorithms on an intelligent factory scenario through dynamic simulations and physical experiments.

[1]  Richard Fikes,et al.  Monitored Execution of Robot Plans Producted by STRIPS , 1971, IFIP Congress.

[2]  Wolfgang Faber,et al.  Undoing the effects of action sequences , 2008, J. Appl. Log..

[3]  Patrick Doherty,et al.  A temporal logic-based planning and execution monitoring framework for unmanned aircraft systems , 2009, Autonomous Agents and Multi-Agent Systems.

[4]  Vladimir Lifschitz,et al.  Answer Set Programming , 2019 .

[5]  Amy L. Lansky,et al.  Reactive Reasoning and Planning , 1987, AAAI.

[6]  Dejan Pangercic,et al.  Structured reactive controllers and transformational planning for manufacturing , 2008, 2008 IEEE International Conference on Emerging Technologies and Factory Automation.

[7]  Gerhard Lakemeyer,et al.  Cognitive Robotics , 2008, Handbook of Knowledge Representation.

[8]  Mikhail Soutchanski,et al.  High-level Robot Programming and Program Execution , 2003 .

[9]  Ronald J. Brachman,et al.  Systems That Know What They're Doing , 2002, IEEE Intell. Syst..

[10]  Giuseppe De Giacomo,et al.  Execution Monitoring of High-Level Robot Programs , 1998, KR.

[11]  Olaf Stursberg,et al.  Hierarchical Hybrid Modeling and Control of Cognitive Manufacturing Systems , 2008 .

[12]  Michael Beetz,et al.  Cognitive Technical Systems - What Is the Role of Artificial Intelligence? , 2007, KI.

[13]  R. James Firby,et al.  An Investigation into Reactive Planning in Complex Domains , 1987, AAAI.

[14]  Froduald Kabanza,et al.  Reasoning about Robot Actions: A Model Checking Approach , 2001, Advances in Plan-Based Control of Robotic Agents.

[15]  Alex M. Andrew,et al.  Knowledge in Action: Logical Foundations for Specifying and Implementing Dynamical Systems , 2002 .

[16]  Karen Zita Haigh,et al.  Planning, Execution and Learning in a Robotic Agent , 1998, AIPS.

[17]  Reid G. Simmons,et al.  Lessons learned from Xavier , 2000, IEEE Robotics Autom. Mag..

[18]  Kristina Shea,et al.  The cognitive factory , 2010, Adv. Eng. Informatics.

[19]  Esra Erdem,et al.  Bridging the Gap between High-Level Reasoning and Low-Level Control , 2009, LPNMR.

[20]  P. Pandurang Nayak,et al.  A Model-Based Approach to Reactive Self-Configuring Systems , 1996, AAAI/IAAI, Vol. 2.

[21]  Michael Beetz,et al.  Improving Robot Plans During Their Execution , 1994, AIPS.

[22]  Tansel Uras,et al.  Applications of AI planning in genome rearrangement and in multi-robot systems , 2011 .

[23]  Reid G. Simmons,et al.  Robust execution monitoring for navigation plans , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[24]  S. LaValle Rapidly-exploring random trees : a new tool for path planning , 1998 .

[25]  Lakhdar Sais,et al.  Control-Based Clause Sharing in Parallel SAT Solving , 2009, IJCAI.

[26]  Fangzhen Lin,et al.  Embracing Causality in Specifying the Indirect Effects of Actions , 1995, IJCAI.

[27]  Hudson Turner,et al.  Causal Theories of Action and Change , 1997, AAAI/IAAI.

[28]  Karen L. Myers CPEF: A Continuous Planning and Execution Framework , 1999, AI Mag..

[29]  Michael Thielscher,et al.  Under Consideration for Publication in Theory and Practice of Logic Programming Flux: a Logic Programming Method for Reasoning Agents , 2003 .

[30]  Dejan Pangercic,et al.  Integration of perception, global planning and local planning in the manufacturing domain , 2009, 2009 IEEE Conference on Emerging Technologies & Factory Automation.

[31]  Wolfgang Faber,et al.  A Logic-Based Approach to Finding Explanations for Discrepancies in Optimistic Plan Execution , 2007, Fundam. Informaticae.

[32]  Alois Knoll,et al.  Joint-action for humans and industrial robots for assembly tasks , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[33]  Michael Thielscher,et al.  The Concurrent, Continuous Fluent Calculus , 2001, Stud Logica.

[34]  Vladimir Lifschitz,et al.  Representing Transition Systems by Logic Programs , 1999, LPNMR.

[35]  Kristina Shea,et al.  Design-to-fabrication automation for the cognitive machine shop , 2010, Adv. Eng. Informatics.

[36]  Michael Thielscher,et al.  Intelligent Execution Monitoring in Dynamic Environments , 2003, Fundam. Informaticae.

[37]  Thomas Rühr,et al.  Automated plan assessment in cognitive manufacturing , 2010, Adv. Eng. Informatics.

[38]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[39]  Hector J. Levesque,et al.  GOLOG: A Logic Programming Language for Dynamic Domains , 1997, J. Log. Program..

[40]  Manuela M. Veloso,et al.  Rationale-Based Monitoring for Planning in Dynamic Environments , 1998, AIPS.

[41]  Vladimir Lifschitz,et al.  Action Languages, Answer Sets, and Planning , 1999, The Logic Programming Paradigm.

[42]  Ola Pettersson,et al.  Execution monitoring in robotics: A survey , 2005, Robotics Auton. Syst..

[43]  Sonja Stork,et al.  Artificial Cognition in Production Systems , 2011, IEEE Transactions on Automation Science and Engineering.

[44]  Félix Ingrand,et al.  Interleaving Temporal Planning and Execution in Robotics Domains , 2004, AAAI.

[45]  Bart Selman,et al.  Planning as Satisfiability , 1992, ECAI.

[46]  Niklas Sörensson,et al.  An Extensible SAT-solver , 2003, SAT.

[47]  Sam Steel,et al.  Integrating Planning, Execution and Monitoring , 1988, AAAI.