Four aspects of building robotic systems: lessons from the Amazon Picking Challenge 2015

We describe the winning entry to the Amazon Picking Challenge  2015. From the experience of building this system and competing in the Amazon Picking Challenge, we derive several conclusions: (1) We suggest to characterize robotic system building along four key aspects, each of them spanning a spectrum of solutions—modularity versus integration, generality versus assumptions, computation versus embodiment, and planning versus feedback. (2) To understand which region of each spectrum most adequately addresses which robotic problem, we must explore the full spectrum of possible approaches. To achieve this, our community should agree on key aspects that characterize the solution space of robotic systems. (3) For manipulation problems in unstructured environments, certain regions of each spectrum match the problem most adequately, and should be exploited further. This is supported by the fact that our solution deviated from the majority of the other 2015 challenge entries along each of the spectra.

[1]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[2]  Kuan-Ting Yu,et al.  A Summary of Team MIT's Approach to the Amazon Picking Challenge 2015 , 2016, ArXiv.

[3]  John P. van Gigch,et al.  System Design Modeling and Metamodeling , 1991 .

[4]  D. Coleman.  MoveIt! Strengths, Weaknesses, and Developer Insight , 2015 .

[5]  Heinrich M. Jaeger,et al.  Universal robotic gripper based on the jamming of granular material , 2010, Proceedings of the National Academy of Sciences.

[6]  Sanjiv Singh,et al.  The 2005 DARPA Grand Challenge: The Great Robot Race , 2007 .

[7]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Olivier Sigaud,et al.  Robot Skill Learning: From Reinforcement Learning to Evolution Strategies , 2013, Paladyn J. Behav. Robotics.

[9]  Oliver Brock,et al.  Online interactive perception of articulated objects with multi-level recursive estimation based on task-specific priors , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Martijn Wisse,et al.  Team Delft's Robot Winner of the Amazon Picking Challenge 2016 , 2016, RoboCup.

[11]  Sanjiv Singh,et al.  The 2005 DARPA Grand Challenge , 2007 .

[12]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[13]  Oliver Brock,et al.  Balancing Exploration and Exploitation in Sampling-Based Motion Planning , 2014, IEEE Transactions on Robotics.

[14]  Oliver Brock,et al.  Lessons from the Amazon Picking Challenge: Four Aspects of Building Robotic Systems , 2016, Robotics: Science and Systems.

[15]  Kim B. Clark,et al.  Design Rules: The Power of Modularity , 2000 .

[16]  Rolf Pfeifer,et al.  Morphological Computation - Connecting Brain, Body, and Environment , 2006, Australian Conference on Artificial Intelligence.

[17]  Oliver Brock,et al.  Probabilistic multi-class segmentation for the Amazon Picking Challenge , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Jr. Frederick P. Brooks,et al.  The mythical man-month (anniversary ed.) , 1995 .

[19]  Brian Rooks.  The harmonious robot , 2006, Ind. Robot.

[20]  Twan Koolen,et al.  Team IHMC's Lessons Learned from the DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[21]  Oliver Brock,et al.  An integrated approach to visual perception of articulated objects , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Peter K. Allen,et al.  Graspit! A versatile simulator for robotic grasping , 2004, IEEE Robotics & Automation Magazine.

[23]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[24]  Ken Schwaber,et al.  Agile Project Management with Scrum , 1980 .

[25]  Oussama Khatib,et al.  Development and Control of a Holonomic Mobile Robot for Mobile Manipulation Tasks , 2000, Int. J. Robotics Res..

[26]  Sven Behnke,et al.  RGB-D object detection and semantic segmentation for autonomous manipulation in clutter , 2018, Int. J. Robotics Res..

[27]  Oliver Brock,et al.  A novel type of compliant and underactuated robotic hand for dexterous grasping , 2016, Int. J. Robotics Res..

[28]  Oliver Brock,et al.  Learning state representations with robotic priors , 2015, Auton. Robots.

[29]  Sven Behnke,et al.  NimbRo picking: Versatile part handling for warehouse automation , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[30]  Kurt Konolige,et al.  The Office Marathon: Robust navigation in an indoor office environment , 2010, 2010 IEEE International Conference on Robotics and Automation.

[31]  Patric Jensfelt,et al.  Lessons Learnt from Scenario-Based Integration , 2010, Cognitive Systems.

[32]  Paul R. Cohen,et al.  Empirical methods for artificial intelligence , 1995, IEEE Expert.

[33]  Oliver Brock,et al.  Analysis and Observations From the First Amazon Picking Challenge , 2016, IEEE Transactions on Automation Science and Engineering.

[34]  Siddhartha S. Srinivasa,et al.  Autonomous manipulation with a general-purpose simple hand , 2011, Int. J. Robotics Res..

[35]  Alan Yuille,et al.  Active Vision , 2014, Computer Vision, A Reference Guide.

[36]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[37]  Magnus Egerstedt,et al.  Behavior Based Robotics Using Hybrid Automata , 2000, HSCC.

[38]  Jun Nakanishi,et al.  Operational Space Control: A Theoretical and Empirical Comparison , 2008, Int. J. Robotics Res..

[39]  Kuan-Ting Yu,et al.  Multi-view self-supervised deep learning for 6D pose estimation in the Amazon Picking Challenge , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[40]  Peter I. Corke,et al.  Cartman: The Low-Cost Cartesian Manipulator that Won the Amazon Robotics Challenge , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[41]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[42]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[43]  Oliver Brock,et al.  Interactive Perception: Leveraging Action in Perception and Perception in Action , 2016, IEEE Transactions on Robotics.

[44]  Karl T. Ulrich,et al.  The role of product architecture in the manufacturing firm , 2011 .

[45]  Kim B. Clark,et al.  Design Rules: The Power of Modularity Volume 1 , 1999 .

[46]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[47]  Robert D. Howe,et al.  The Highly Adaptive SDM Hand: Design and Performance Evaluation , 2010, Int. J. Robotics Res..

[48]  P. Kidwell,et al.  The mythical man-month: Essays on software engineering , 1996, IEEE Annals of the History of Computing.

[49]  Oliver Brock,et al.  Exploitation of Environmental Constraints in Human and Robotic Grasping , 2013, ISRR.

[50]  Russell H. Taylor,et al.  Automatic Synthesis of Fine-Motion Strategies for Robots , 1984 .

[51]  Kostas E. Bekris,et al.  A Dataset for Improved RGBD-Based Object Detection and Pose Estimation for Warehouse Pick-and-Place , 2015, IEEE Robotics and Automation Letters.

[52]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[53]  Brian Scassellati,et al.  Alternative Essences of Intelligence , 1998, AAAI/IAAI.

[54]  J. Laumond.  Kineo CAM: a success story of motion planning algorithms , 2006, IEEE Robotics & Automation Magazine.

[55]  Dmitry Berenson,et al.  No falls, no resets: Reliable humanoid behavior in the DARPA robotics challenge , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[56]  Yiannis Aloimonos,et al.  Active vision , 2004, International Journal of Computer Vision.

[57]  Fumiya Iida,et al.  Morphological Computation: Connecting Body, Brain, and Environment (特集:ロボティクスと神経科学) , 2005 .

[58]  David Wingate,et al.  A Physics-Based Model Prior for Object-Oriented MDPs , 2014, ICML.

[59]  David H. Wolpert,et al.  The Lack of A Priori Distinctions Between Learning Algorithms , 1996, Neural Computation.

[60]  Oliver Brock,et al.  A Factorization Approach to Manipulation in Unstructured Environments , 2009, ISRR.

[61]  John N. Tsitsiklis,et al.  The Complexity of Markov Decision Processes , 1987, Math. Oper. Res..

[62]  Rodney A. Brooks,et al.  Elephants don't play chess , 1990, Robotics Auton. Syst..