Benchmarking Protocols for Evaluating Small Parts Robotic Assembly Systems

This article presents a set of performance metrics, test methods, and associated artifacts to help progress the development and deployment of robotic assembly systems. The designs for three task board artifacts that replicate small part insertion and fastening operations such as threading, snap fitting, and meshing with standard screws, nuts, washers, gears, electrical connectors, belt drives, and wiring are presented. To support the evaluation of robotic assembly and disassembly operations, benchmarking protocols and performance metrics are presented that leverage these task boards. Finally, robot competitions are discussed as use cases for these task boards.

[1]  Kimitoshi Yamazaki,et al.  Survey of robotic manipulation studies intending practical applications in real environments -object recognition, soft robot hand, and challenge program and benchmarking- , 2017, Adv. Robotics.

[2]  Jeremy A. Marvel,et al.  Benchmarking Robot Force Control Capabilities: Experimental Results , 2016 .

[3]  Sergey Levine,et al.  Deep Reinforcement Learning for Industrial Insertion Tasks with Visual Inputs and Natural Rewards , 2019, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Kazuhito Yokoi,et al.  Assembly Challenge: a robot competition of the Industrial Robotics Category, World Robot Summit – summary of the pre-competition in 2018* , 2019, Adv. Robotics.

[5]  Elena R. Messina,et al.  Measuring and Representing the Performance of Manufacturing Assembly Robots , 2015 .

[6]  J. L. Nevins,et al.  Robot Assembly Research and Its Future Applications , 1979 .

[7]  Yu Zhao,et al.  Autonomous alignment of peg and hole by force/torque measurement for robotic assembly , 2016, 2016 IEEE International Conference on Automation Science and Engineering (CASE).

[8]  P. Abbeel,et al.  Yale-CMU-Berkeley dataset for robotic manipulation research , 2017, Int. J. Robotics Res..

[9]  Moonhong Baeg,et al.  Dual arm peg-in-hole assembly with a programmed compliant system , 2014, 2014 11th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[10]  Zoe Doulgeri,et al.  A fast robot deployment strategy for successful snap assembly , 2016, 2016 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS).

[11]  Hubert Roth,et al.  An Approach for Peg-in-Hole Assembling using Intuitive Search Algorithm based on Human Behavior and Carried by Sensors Guided Industrial Robot , 2015 .

[12]  Kevin Kelly,et al.  Comparative Peg-in-Hole Testing of a Force-Based Manipulation Controlled Robotic Hand , 2018, IEEE Transactions on Robotics.

[13]  Anders Robertsson,et al.  Force controlled robotic assembly without a force sensor , 2012, 2012 IEEE International Conference on Robotics and Automation.