The Furtherance of Autonomous Engineering via Reinforcement Learning

Engineering efforts are one of the major cost factors in today’s industrial automation systems. We present a configuration system, which grants a reduced obligation of engineering effort. Through self-learning the configuration system can adapt to various tasks by actively learning about its environment. We validate our configuration system using a robotic perception system, specifically a picking application. Perception systems for robotic applications become increasingly essential in industrial environments. Today, such systems often require tedious configuration and design from a well trained technician. These processes have to be carried out for each application and each change in the environment. Our robotic perception system is evaluated on the BOP benchmark and consists of two elements. First, we design building blocks, which are algorithms and datasets available for our configuration algorithm. Second, we implement agents (configuration algorithms) which are designed to intelligently interact with our building blocks. On an examplary industrial robotic picking problem we show, that our autonomous engineering system can reduce engineering efforts.

[1]  Alberto Pretto,et al.  D ^2 CO: Fast and Robust Registration of 3D Textureless Objects Using the Directional Chamfer Distance , 2015, ICVS.

[2]  Sven Wanner,et al.  Reconstructing Reflective and Transparent Surfaces from Epipolar Plane Images , 2013, GCPR.

[3]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[4]  Kevin Leyton-Brown,et al.  Sequential Model-Based Optimization for General Algorithm Configuration , 2011, LION.

[5]  Marco F. Huber,et al.  A Survey on Learning-Based Robotic Grasping , 2020, Current Robotics Reports.

[6]  Rama Chellappa,et al.  Fast object localization and pose estimation in heavy clutter for robotic bin picking , 2012, Int. J. Robotics Res..

[7]  Silvio Savarese,et al.  Toward Automatic 3D Generic Object Modeling from One Single Image , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[8]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[9]  Trevor Darrell,et al.  Fast concurrent object localization and recognition , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Eric Brachmann,et al.  BOP Challenge 2020 on 6D Object Localization , 2020, ECCV Workshops.

[11]  Jianwei Zhang,et al.  A Hierarchical Planner based on Set-theoretic Models: Towards Automating the Automation for Autonomous Systems , 2019, ICINCO.

[12]  Stefano Soatto,et al.  Multi-view stereo beyond Lambert , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[13]  Kai-Tai Song,et al.  CAD-based Pose Estimation Design for Random Bin Picking using a RGB-D Camera , 2017, J. Intell. Robotic Syst..

[14]  Pascal Fua,et al.  Real-Time Seamless Single Shot 6D Object Pose Prediction , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  Lars Kotthoff,et al.  Automated Machine Learning: Methods, Systems, Challenges , 2019, The Springer Series on Challenges in Machine Learning.

[16]  Wojciech Zaremba,et al.  OpenAI Gym , 2016, ArXiv.

[17]  Henrik I. Christensen,et al.  RGB-D object pose estimation in unstructured environments , 2016, Robotics Auton. Syst..

[18]  Vladlen Koltun,et al.  Open3D: A Modern Library for 3D Data Processing , 2018, ArXiv.

[19]  Yasuyuki Matsushita,et al.  Deep Photometric Stereo for Non-Lambertian Surfaces , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[22]  Michael Beetz,et al.  Automatic Configuration of the Structure and Parameterization of Perception Pipelines , 2019, 2019 19th International Conference on Advanced Robotics (ICAR).

[23]  Marco F. Huber,et al.  Simulation-driven machine learning for robotics and automation , 2019, tm - Technisches Messen.

[24]  Pieter Abbeel,et al.  A textured object recognition pipeline for color and depth image data , 2012, 2012 IEEE International Conference on Robotics and Automation.