Autonomous Wall Building with a UGV- UAV Team at MBZIRC 2020

Constructing large structures with robots is a challenging task with many potential applications that requires mobile manipulation capabilities. We present two systems for autonomous wall building that we developed for the Mohamed Bin Zayed International Robotics Challenge 2020. Both systems autonomously perceive their environment, find bricks, and build a predefined wall structure. While the UGV uses a 3D LiDAR-based perception system which measures brick poses with high precision, the UAV employs a real-time camera-based system for visual servoing. We report results and insights from our successful participation at the MBZIRC 2020 Finals, additional lab experiments, and discuss the lessons learned from the competition.

[1]  Vijay Kumar,et al.  Construction with quadrotor teams , 2012, Auton. Robots.

[2]  Aníbal Ollero,et al.  Aerial Manipulation: A Literature Review , 2018, IEEE Robotics and Automation Letters.

[3]  Caitlin Mueller,et al.  Feasibility study for drone-based masonry construction of real-scale structures , 2018, Automation in Construction.

[4]  Kok-Lim Low.  Linear Least-Squares Optimization for Point-to-Plane ICP Surface Registration , 2004 .

[5]  Justin R. Thomas,et al.  Cooperative Autonomous Search, Grasping and Delivering in a Treasure Hunt Scenario by a Team of UAVs , 2017 .

[6]  Michael Felsberg,et al.  Flexible Disaster Response of Tomorrow: Final Presentation and Evaluation of the CENTAURO System , 2019, IEEE Robotics & Automation Magazine.

[7]  Larry Jackel,et al.  The DARPA Robotics Challenge Finals: Results and Perspectives , 2017, J. Field Robotics.

[8]  Neri Oxman,et al.  Toward site-specific and self-sufficient robotic fabrication on architectural scales , 2017, Science Robotics.

[9]  Seungwon Choi,et al.  Aerial manipulation using a quadrotor with a two DOF robotic arm , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Sven Behnke,et al.  Team NimbRo at MBZIRC 2017: Autonomous valve stem turning using a wrench , 2018, J. Field Robotics.

[11]  Sven Behnke,et al.  Stillleben: Realistic Scene Synthesis for Deep Learning in Robotics , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Konstantin Kondak,et al.  First analysis and experiments in aerial manipulation using fully actuated redundant robot arm , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Alexander H. Slocum,et al.  Blockbot: A robot to automate construction of cement block walls , 1988, Robotics Auton. Syst..

[14]  Roland Siegwart,et al.  The ETH‐MAV Team in the MBZ International Robotics Challenge , 2017, J. Field Robotics.

[15]  Fabio Gramazio,et al.  Mobile Robotic Brickwork , 2016 .

[16]  Sven Behnke,et al.  Team NimbRo at MBZIRC 2017: Fast landing on a moving target and treasure hunting with a team of micro aerial vehicles , 2019, J. Field Robotics.

[17]  Rafael Muñoz-Salinas,et al.  Speeded up detection of squared fiducial markers , 2018, Image Vis. Comput..