A Stochastic Learning Approach for Construction of Brick Structures with a Ground Robot

Abstract In this paper, we describe an architectural framework by which a mobile robot can learn how to autonomously assemble solid 3D brick structures according to user-specified designs. The policies of actions to perform the construction task are obtained from a simulation environment using Reinforcement Learning (RL) and Particle Swarm Optimization (PSO) approaches. The proposed planning architecture is used to simultaneously solve three problems: 1) to generate feasible construction policies, 2) to define the set of maneuvers for the vehicle to carry out the assembly task, and 3) to obtain the set of trajectories for handling and mounting parts while avoiding fixed obstacles. During the learning process the power limitation of the ground robot is taken into account. Simulation results show that the set of learned actions may efficiently perform the construction procedures without resulting in conditions which prevent the fulfillment of the assembly procedures. The synthesis of this system opens the way to the development of intelligent construction approaches using ground robots.

[1]  Libor Preucil,et al.  Robot Path Planning using Particle Swarm Optimization of Ferguson Splines , 2006, 2006 IEEE Conference on Emerging Technologies and Factory Automation.

[2]  Gaurav S. Sukhatme,et al.  Collective construction with multiple robots , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Radhika Nagpal,et al.  Designing Collective Behavior in a Termite-Inspired Robot Construction Team , 2014, Science.

[4]  Terrance L. Huntsberger,et al.  Behavior-based multi-robot collaboration for autonomous construction tasks , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Vijay Kumar,et al.  Construction with quadrotor teams , 2012, Auton. Robots.

[6]  Cairo L. Nascimento,et al.  Autonomous Construction of Multiple Structures Using Learning Automata: Description and Experimental Validation , 2015, IEEE Systems Journal.

[7]  R. Andrew Russell,et al.  A Distributed Feedback Mechanism to Regulate Wall Construction by a Robotic Swarm , 2006, Adapt. Behav..

[8]  Francesco Mondada,et al.  Autonomous construction using scarce resources in unknown environments , 2012, Auton. Robots.