Real Robot Challenge: A Robotics Competition in the Cloud

Dexterous manipulation remains an open problem in robotics. To coordinate efforts of the research community towards tackling this problem, we propose a shared benchmark. We designed and built robotic platforms that are hosted at MPI for Intelligent Systems and can be accessed remotely. Each platform consists of three robotic fingers that are capable of dexterous object manipulation. Users are able to control the platforms remotely by submitting code that is executed automatically, akin to a computational cluster. Using this setup, i) we host robotics competitions, where teams from anywhere in the world access our platforms to tackle challenging tasks ii) we publish the datasets collected during these competitions (consisting of hundreds of robot hours), and iii) we give researchers access to these platforms for their own projects.

[1]  Qingfeng Yao,et al.  Real-World Dexterous Object Manipulation based Deep Reinforcement Learning , 2021, ArXiv.

[2]  Francisco Roldan Sanchez,et al.  Solving the Real Robot Challenge Using Deep Reinforcement Learning , 2021, AICS.

[3]  Animesh Garg,et al.  Transferring Dexterous Manipulation from GPU Simulation to a Remote Real-World TriFinger , 2021, 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Siddhartha S. Srinivasa,et al.  Benchmarking Structured Policies and Policy Optimization for Real-World Dexterous Object Manipulation , 2021, IEEE Robotics and Automation Letters.

[5]  Jeffrey Zhang,et al.  Dexterous Manipulation Primitives for the Real Robot Challenge , 2021, ArXiv.

[6]  Matthew R. Walter,et al.  Grasp and Motion Planning for Dexterous Manipulation for the Real Robot Challenge , 2021, ArXiv.

[7]  Yoshua Bengio,et al.  CausalWorld: A Robotic Manipulation Benchmark for Causal Structure and Transfer Learning , 2020, ICLR.

[8]  Ludovic Righetti,et al.  TriFinger: An Open-Source Robot for Learning Dexterity , 2020, CoRL.

[9]  Ludovic Righetti,et al.  An Open Torque-Controlled Modular Robot Architecture for Legged Locomotion Research , 2019, IEEE Robotics and Automation Letters.

[10]  S. Levine,et al.  ROBEL: Robotics Benchmarks for Learning with Low-Cost Robots , 2019, CoRL.

[11]  Abhinav Gupta,et al.  PyRobot: An Open-source Robotics Framework for Research and Benchmarking , 2019, ArXiv.

[12]  Sergey Levine,et al.  REPLAB: A Reproducible Low-Cost Arm Benchmark Platform for Robotic Learning , 2019, ArXiv.

[13]  Herke van Hoof,et al.  Addressing Function Approximation Error in Actor-Critic Methods , 2018, ICML.

[14]  Sergey Levine,et al.  Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor , 2018, ICML.

[15]  Yuval Tassa,et al.  DeepMind Control Suite , 2018, ArXiv.

[16]  Philip Bachman,et al.  Deep Reinforcement Learning that Matters , 2017, AAAI.

[17]  Yuval Tassa,et al.  Emergence of Locomotion Behaviours in Rich Environments , 2017, ArXiv.

[18]  Jonathan P. How,et al.  Duckietown: An open, inexpensive and flexible platform for autonomy education and research , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Martin A. Riedmiller,et al.  Data-efficient Deep Reinforcement Learning for Dexterous Manipulation , 2017, ArXiv.

[20]  Li Wang,et al.  The Robotarium: A remotely accessible swarm robotics research testbed , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Alejandro Hernández Cordero,et al.  Extending the OpenAI Gym for robotics: a toolkit for reinforcement learning using ROS and Gazebo , 2016, ArXiv.

[22]  Pieter Abbeel,et al.  Benchmarking Deep Reinforcement Learning for Continuous Control , 2016, ICML.

[23]  Alex Graves,et al.  Asynchronous Methods for Deep Reinforcement Learning , 2016, ICML.

[24]  Pedro U. Lima,et al.  Competitions for Benchmarking: Task and Functionality Scoring Complete Performance Assessment , 2015, IEEE Robotics & Automation Magazine.

[25]  Siddhartha S. Srinivasa,et al.  Benchmarking in Manipulation Research: Using the Yale-CMU-Berkeley Object and Model Set , 2015, IEEE Robotics & Automation Magazine.

[26]  Angel P. del Pobil,et al.  Toward Replicable and Measurable Robotics Research [From the Guest Editors] , 2015, IEEE Robotics Autom. Mag..

[27]  P. Abbeel,et al.  Benchmarking in Manipulation Research: The YCB Object and Model Set and Benchmarking Protocols , 2015, ArXiv.

[28]  Yuval Tassa,et al.  MuJoCo: A physics engine for model-based control , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Real Robot Challenge Stage 1: Cartesian Position Control with Triangular Grasp and Trajectory Interpolation , 2021 .

[30]  Real Robot Challenge Phase 3: Manipulating Objects using High-Level Coordination of Motion Primitives , 2020 .

[31]  Sven Behnke,et al.  Robot Competitions Ideal Benchmarks for Robotics Research , 2006 .