Artificial intelligence planners for multi-head path planning of SwarmItFIX agents

Sheet metal manufacturing is finding wide applications in automotive and aerospace industries. Handling of giant sheet materials in manufacturing industries is one of the key problems. Utilization of robots, viz SwarmItFIX, will address this problem and automate the fixturing process, which greatly reduces lead time and thus the production cost. Implementation of intelligence into the robots will further improve efficiency in handling and reduce manufacturing inaccuracies. In this work, two different novel planners are proposed which do path planning for the heads of the SwarmItFIX agents. The environment of the problem is modeled as a Markov Decision Problem. The first planner uses the Value Iteration and Policy Iteration (PI) algorithms individually and the second planner performs the Monte Carlo control reinforcement learning. Finally, when the simulation is done and parameters of the proposed three algorithms along with existing Constraint Satisfaction Problem algorithm are compared with each other. It is observed that the proposed PI algorithm returns the plan much faster than the other algorithms. In the near future, the efficient planning model will be tested and implemented into the SwarmItFIX setup at the PMAR laboratory, University of Genoa, Italy.

[1]  Zoran Miljkovic,et al.  Neural network Reinforcement Learning for visual control of robot manipulators , 2013, Expert Syst. Appl..

[2]  Matteo Zoppi,et al.  Multi-Goal Path Planning for Robotic Agents With Discrete-Step Locomotion , 2017 .

[3]  C.W. de Silva,et al.  Sequential $Q$ -Learning With Kalman Filtering for Multirobot Cooperative Transportation , 2010, IEEE/ASME Transactions on Mechatronics.

[4]  Marie Jonsson,et al.  Aspects of reconfigurable and flexible fixtures , 2010, Prod. Eng..

[5]  Cezary Zieliński,et al.  Path planning for robotized mobile supports , 2014 .

[6]  Jian Huang,et al.  An assembly strategy scheduling method for human and robot coordinated cell manufacturing , 2011, Int. J. Intell. Comput. Cybern..

[7]  Cezary Zielinski,et al.  Control and programming of a multi-robot-based reconfigurable fixture , 2013, Ind. Robot.

[8]  Z. M. Bi,et al.  Flexible fixture design and automation: Review, issues and future directions , 2001 .

[9]  Matteo Zoppi,et al.  Reconfigurable swarm fixtures , 2009, 2009 ASME/IFToMM International Conference on Reconfigurable Mechanisms and Robots.

[10]  Matteo Zoppi,et al.  Design of the Locomotion and Docking System of the SwarmItFIX Mobile Fixture Agent , 2013 .

[11]  Wojciech Szynkiewicz,et al.  Task planning for cooperating self-reconfigurable mobile fixtures , 2013 .

[12]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[13]  Matteo Zoppi,et al.  Coordinated Selection and Timing of Multiple Trajectories of Discretely Mobile Robots , 2018 .

[14]  Cezary Zielinski,et al.  Motion Generation in the MRROC++ Robot Programming Framework , 2010, Int. J. Robotics Res..

[15]  Dimiter Zlatanov,et al.  Direct Kinematics of the Exechon Tripod , 2016 .

[16]  Kunikazu Kobayashi,et al.  Adaptive swarm behavior acquisition by a neuro-fuzzy system and reinforcement learning algorithm , 2009, Int. J. Intell. Comput. Cybern..

[17]  Adil Baykasoglu,et al.  A multi-agent based approach to dynamic scheduling with flexible processing capabilities , 2017, J. Intell. Manuf..

[18]  Teresa Zielinska,et al.  A hierarchical CSP search for path planning of cooperating self-reconfigurable mobile fixtures , 2014, Eng. Appl. Artif. Intell..

[19]  Dimiter Zlatanov,et al.  Orientation Planning for Multi-Agents With Discrete-Step Locomotion and Multiple Goals , 2018 .

[20]  Mohammad Reza Emami,et al.  Concurrent Markov decision processes for robot team learning , 2015, Eng. Appl. Artif. Intell..

[21]  M. Sreekumar,et al.  Path Planning of a Material Handling Agent With Novel Locomotion , 2016 .

[22]  Germano Veiga,et al.  Online inspection system based on machine learning techniques: real case study of fabric textures classification for the automotive industry , 2019, J. Intell. Manuf..

[23]  Ahmed Kouider,et al.  Distributed multi-agent scheduling and control system for robotic flexible assembly cells , 2019, J. Intell. Manuf..

[24]  Leslie Pack Kaelbling,et al.  On the Complexity of Solving Markov Decision Problems , 1995, UAI.

[25]  Matteo Zoppi,et al.  The SwarmItFix Pilot , 2017 .

[26]  Roberto Beraldi,et al.  A swarm of robots using RFID tags for synchronization and cooperation , 2009, Int. J. Intell. Comput. Cybern..

[27]  Kurt Driessens Thesis: relational reinforcement learning , 2005 .

[28]  Lionel Amodeo,et al.  Efficient metaheuristics for pick and place robotic systems optimization , 2014, J. Intell. Manuf..

[29]  Robert Babuska,et al.  Decentralized Reinforcement Learning of Robot Behaviors , 2018, Artif. Intell..

[30]  Eric Allender,et al.  Complexity of finite-horizon Markov decision process problems , 2000, JACM.

[31]  Tarek AlGeddawy,et al.  Planning of Modular Fixtures in a Robotic Assembly System , 2016 .

[32]  S. Russel and P. Norvig,et al.  “Artificial Intelligence – A Modern Approach”, Second Edition, Pearson Education, 2003. , 2015 .

[33]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .