Combined Optimization of Gripper Finger Design and Pose Estimation Processes for Advanced Industrial Assembly

Vision systems are often used jointly with robotic manipulators to perform automated tasks in industrial applications. Still, the correct set up of such workcells is difficult and requires significant resources. One of the main challenges, when implementing such systems in industrial use cases, is the pose uncertainties presented by the vision system which have to be handled by grasping. In this paper, we present a framework for the design and analysis of optimal gripper finger designs and vision parameters. The proposed framework consists of two parallel methods which rely on vision and grasping simulation to provide an initial estimation of the uncertainty compensation capabilities of the designs. In case the compensation is not feasible with the initial design, an optimization process is introduced, to select the optimal pose estimation parameters and finger designs for the presented task. The proposed framework was evaluated in dynamic simulation and implemented in a real industrial use case.

[1]  Norbert Krüger,et al.  Bayesian Optimization of 3D Feature Parameters for 6D Pose Estimation , 2019, VISIGRAPP.

[2]  Dirk Kraft,et al.  Optimizing Sensor Placement: A Mixture Model Framework Using Stable Poses and Sparsely Precomputed Pose Uncertainty Predictions , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  山田 祐,et al.  Open Dynamics Engine を用いたスノーボードロボットシミュレータの開発 , 2007 .

[4]  Norbert Krüger,et al.  Robust optimization of robotic pick and place operations for deformable objects through simulation , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Jimmy A. Jørgensen,et al.  RobWork: A Flexible Toolbox for Robotics Research and Education , 2010, ISR/ROBOTIK.

[6]  Xiaolong Feng,et al.  Generic Automated Multi-function Finger Design , 2016 .

[7]  Norbert Krüger,et al.  A Novel 2.5D Feature Descriptor Compensating for Depth Rotation , 2017, VISIGRAPP.

[8]  J. Roßmann,et al.  VALIDATING THE CAMERA AND LIGHT SIMULATION OF A VIRTUAL SPACE ROBOTICS TESTBED BY MEANS OF PHYSICAL MOCKUP DATA , 2012 .

[9]  Anders Glent Buch,et al.  Using spatial constraints for fast set-up of precise pose estimation in an industrial setting , 2019, 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE).

[10]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[11]  Vincent Lepetit,et al.  On rendering synthetic images for training an object detector , 2014, Comput. Vis. Image Underst..

[12]  Norbert Krüger,et al.  Designing Fingers in Simulation based on Imprints , 2017, SIMULTECH.

[13]  Andrej Gams,et al.  Compensating Pose Uncertainties through Appropriate Gripper Finger Cutouts , 2018 .

[14]  Norbert Krüger,et al.  Does Vision Work Well Enough for Industry? , 2018, VISIGRAPP.

[15]  Dirk Kraft,et al.  Simulation-based Optimization of Camera Placement in the Context of Industrial Pose Estimation , 2018, VISIGRAPP.

[16]  Xiaolong Feng,et al.  Generic Automated Finger Design , 2016 .

[17]  Alberto Costa,et al.  RBFOpt: an open-source library for black-box optimization with costly function evaluations , 2018, Mathematical Programming Computation.