Teaching Robots to Perform Construction Tasks via Learning from Demonstration

Robots are expected to be widely used on future construction sites to assist human workers in the performance of repetitive physically-demanding tasks. Unlike typical manufacturing assembly lines, where parts are delivered to robots and workers in stationary workstations, construction robots and human workers must accumulate all necessary resources and repeatedly navigate to desired assembly locations on-site to perform useful work. The condition of such resources and the geometry of the environment are constantly changing and generally unstructured. As a result, the motion trajectories of any robot arms cannot be programmed beforehand. The robots must define the trajectory based on the encountered workspace geometry. Learning from Demonstration (LfD) methods have the potential to be used in teaching robots specific skills through human demonstration such that the robots can repeat the same process in different conditions. In this research, we explore the LfD method to teach robots to perform repetitive but geometrically adaptive construction tasks of installing suspended ceiling tiles within pre-assembled ceiling grids. The developed method translates the work context from the set of training videos demonstrated by humans to the target scene, then applies the reinforcement learning method to generate the policy for the robot to perform the subsequent ceiling tile installation. The first phase of the proposed method, i.e., the context translation model, is implemented and evaluated by characterizing whether robot-installed ceiling tiles are successfully moved to the grid area. The experiments demonstrate promising results that show the applicability of the LfD method in teaching robots to perform geometrically-adaptive

[1]  Sergey Levine,et al.  Few-Shot Goal Inference for Visuomotor Learning and Planning , 2018, CoRL.

[2]  Shih-Chung Kang,et al.  RAS: a robotic assembly system for steel structure erection and assembly , 2017, International Journal of Intelligent Robotics and Applications.

[3]  Mario Fritz,et al.  Teaching robots the use of human tools from demonstration with non-dexterous end-effectors , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[4]  Joelle Pineau,et al.  Learning from Limited Demonstrations , 2013, NIPS.

[5]  Carol C. Menassa,et al.  Autonomous motion planning and task execution in geometrically adaptive robotized construction work , 2019, Automation in Construction.

[6]  Carol C. Menassa,et al.  Stacked Hourglass Networks for Markerless Pose Estimation of Articulated Construction Robots , 2018 .

[7]  Zhou Fang,et al.  Shaping in reinforcement learning by knowledge transferred from human-demonstrations of a simple similar task , 2018, J. Intell. Fuzzy Syst..

[8]  Ajay Kumar Tanwani,et al.  Learning Robot Manipulation Tasks With Task-Parameterized Semitied Hidden Semi-Markov Model , 2016, IEEE Robotics and Automation Letters.

[9]  Sergey Levine,et al.  One-Shot Visual Imitation Learning via Meta-Learning , 2017, CoRL.

[10]  Huosheng Hu,et al.  Robot imitation: Body schema and body percept , 2005 .

[11]  Huosheng Hu,et al.  Robot Learning from Demonstration in Robotic Assembly: A Survey , 2018, Robotics.

[12]  Song-Chun Zhu,et al.  Learning Human Utility from Video Demonstrations for Deductive Planning in Robotics , 2017, CoRL.

[13]  Shih-Chung Kang,et al.  Development of a Steel Beam Hauling System for Automatic Steel Beam Assembly , 2014 .

[14]  Tadej Petric,et al.  Robotic assembly solution by human-in-the-loop teaching method based on real-time stiffness modulation , 2018, Auton. Robots.

[15]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[16]  Andrew Owens,et al.  The Feeling of Success: Does Touch Sensing Help Predict Grasp Outcomes? , 2017, CoRL.

[17]  Alexander H. Slocum,et al.  Automation and robotics opportunities: Construction versus manufacturing , 1994 .

[18]  Carol C. Menassa,et al.  Scene understanding for adaptive manipulation in robotized construction work , 2017 .

[19]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[20]  Feng Gao,et al.  Feeling the force: Integrating force and pose for fluent discovery through imitation learning to open medicine bottles , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[22]  Sergey Levine,et al.  Nonlinear Inverse Reinforcement Learning with Gaussian Processes , 2011, NIPS.

[23]  Sergey Levine,et al.  Imitation from Observation: Learning to Imitate Behaviors from Raw Video via Context Translation , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[25]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[26]  Darwin G. Caldwell,et al.  Force-based variable impedance learning for robotic manipulation , 2018, Robotics Auton. Syst..

[27]  Vineet R. Kamat,et al.  Enhancing Perceived Safety in Human–Robot Collaborative Construction Using Immersive Virtual Environments , 2018, Automation in Construction.

[28]  Sergey Levine,et al.  Trust Region Policy Optimization , 2015, ICML.

[29]  Aude Billard,et al.  On learning the statistical representation of a task and generalizing it to various contexts , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[30]  Asif Iqbal,et al.  A collaborative augmented reality based modeling environment for construction engineering and management education , 2011, Proceedings of the 2011 Winter Simulation Conference (WSC).

[31]  Kamel S. Saidi,et al.  Real-time drill monitoring and control using building information models augmented with 3D imaging data , 2013 .

[32]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[33]  Matthieu Geist,et al.  Boosted Bellman Residual Minimization Handling Expert Demonstrations , 2014, ECML/PKDD.

[34]  Carme Torras,et al.  Teaching a Robot the Semantics of Assembly Tasks , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[35]  Ashwin P. Dani,et al.  Learning Partially Contracting Dynamical Systems from Demonstrations , 2017, CoRL.

[36]  Andrew Y. Ng,et al.  Pharmacokinetics of a novel formulation of ivermectin after administration to goats , 2000, ICML.

[37]  Ales Ude,et al.  Solving peg-in-hole tasks by human demonstration and exception strategies , 2014 .

[38]  Vineet R. Kamat,et al.  Comparison of simulation-driven construction operations visualization and 4D CAD , 2002, Proceedings of the Winter Simulation Conference.

[39]  Ion Stoica,et al.  DDCO: Discovery of Deep Continuous Options for Robot Learning from Demonstrations , 2017, CoRL.