Deep Learning Approaches to Grasp Synthesis: A Review

—Grasping is the process of picking an object by applying forces and torques at a set of contacts. Recent advances in deep-learning methods have allowed rapid progress in robotic object grasping. We systematically surveyed the publications over the last decade, with a particular interest in grasping an object using all 6 degrees of freedom of the end-effector pose. Our review found four common methodologies for robotic grasping: sampling-based approaches, direct regression, reinforcement learning, and exemplar approaches. Furthermore, we found two ‘supporting methods‘ around grasping that use deep-learning to support the grasping process, shape approximation, and affordances. We have distilled the publications found in this systematic review (85 papers) into ten key takeaways we consider crucial for future robotic grasping and manipulation research. An online version of the survey is available at https: //rhys-newbury.github.io/projects/6dof/ found three main approaches: regress to a pose directly (Pose), employing a multi-stage approach, or perform dimensionality reduction (DimRed).

[1]  Hanwen Kang,et al.  Geometry-Aware Fruit Grasping Estimation for Robotic Harvesting in Orchards , 2021, Comput. Electron. Agric..

[2]  Kostas E. Bekris,et al.  CaTGrasp: Learning Category-Level Task-Relevant Grasping in Clutter from Simulation , 2021, 2022 International Conference on Robotics and Automation (ICRA).

[3]  S. Hamidreza Kasaei,et al.  MVGrasp: Real-Time Multi-View 3D Object Grasping in Highly Cluttered Environments , 2021, Robotics Auton. Syst..

[4]  Xinde Li,et al.  A Self-Supervised Learning-Based 6-DOF Grasp Planning Method for Manipulator , 2021, IEEE Transactions on Automation Science and Engineering.

[5]  Ales Leonardis,et al.  Deep Dexterous Grasping of Novel Objects from a Single View , 2019, Int. J. Humanoid Robotics.

[6]  M. Fallon,et al.  Integrating High-Resolution Tactile Sensing into Grasp Stability Prediction , 2022 .

[7]  Shiqi Li,et al.  An End-to-End Spatial Grasp Prediction Model for Humanoid Multi-fingered Hand Using Deep Network , 2021, 2021 6th International Conference on Control, Robotics and Cybernetics (CRC).

[8]  Cewu Lu,et al.  Graspness Discovery in Clutters for Fast and Accurate Grasp Detection , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[9]  Daniel D. Lee,et al.  Object Shell Reconstruction: Camera-centric Object Representation for Robotic Grasping , 2021, ArXiv.

[10]  Lei Li,et al.  Simultaneous Semantic and Collision Learning for 6-DoF Grasp Pose Estimation , 2021, 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  A. Schöttl,et al.  6-DOF Grasp Detection for Unknown Objects Using Surface Reconstruction , 2021, 2021 3rd International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA).

[12]  Yayu Huang,et al.  Robotics Dexterous Grasping: The Methods Based on Point Cloud and Deep Learning , 2021, Frontiers in Neurorobotics.

[13]  G. Konidaris,et al.  Learning to Detect Multi-Modal Grasps for Dexterous Grasping in Dense Clutter , 2021, 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Sotiris Malassiotis,et al.  A Geometric Approach for Grasping Unknown Objects With Multifingered Hands , 2021, IEEE Transactions on Robotics.

[15]  Stefanie Tellex,et al.  Learning Collaborative Pushing and Grasping Policies in Dense Clutter , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[16]  G. Peng,et al.  6-DOF grasp planning of manipulator combined with self-supervised learning , 2021, 2021 33rd Chinese Control and Decision Conference (CCDC).

[17]  Peng Wang,et al.  GPR: Grasp Pose Refinement Network for Cluttered Scenes , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Ki-Uk Kyung,et al.  Imitation Learning based Soft Robotic Grasping Control without Precise Estimation of Target Posture , 2021, 2021 IEEE 4th International Conference on Soft Robotics (RoboSoft).

[19]  Yuke Zhu,et al.  Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations , 2021, Robotics: Science and Systems.

[20]  Xibai Lou,et al.  Collision-Aware Target-Driven Object Grasping in Constrained Environments , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Ciro Natale,et al.  Can Robots Refill a Supermarket Shelf?: Motion Planning and Grasp Control , 2021, IEEE Robotics & Automation Magazine.

[22]  Masayoshi Tomizuka,et al.  6-DoF Contrastive Grasp Proposal Network , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Dieter Fox,et al.  Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenes , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Torsten Kröger,et al.  Robot Learning of 6 DoF Grasping using Model-based Adaptive Primitives , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Yoshihiro Sato,et al.  Learning 6DoF Grasping Using Reward-Consistent Demonstration , 2021, ArXiv.

[26]  Fumitoshi Matsuno,et al.  Robust grasp detection with incomplete point cloud and complex background , 2021, Adv. Robotics.

[27]  Ville Kyrki,et al.  DDGC: Generative Deep Dexterous Grasping in Clutter , 2021, IEEE Robotics and Automation Letters.

[28]  Cewu Lu,et al.  RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Images , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Rustam Stolkin,et al.  Simultaneous Tactile Exploration and Grasp Refinement for Unknown Objects , 2021, IEEE Robotics and Automation Letters.

[30]  Marcus Gualtieri,et al.  Robotic Pick-and-Place With Uncertain Object Instance Segmentation and Shape Completion , 2021, IEEE Robotics and Automation Letters.

[31]  Francesc Moreno-Noguer,et al.  Multi-FinGAN: Generative Coarse-To-Fine Sampling of Multi-Finger Grasps , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[32]  Dieter Fox,et al.  ACRONYM: A Large-Scale Grasp Dataset Based on Simulation , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[33]  Dieter Fox,et al.  Goal-Auxiliary Actor-Critic for 6D Robotic Grasping with Point Clouds , 2020, CoRL.

[34]  Kristen Grauman,et al.  Learning Dexterous Grasping with Object-Centric Visual Affordances , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[35]  Volkan Isler,et al.  Robotic Grasping through Combined Image-Based Grasp Proposal and 3D Reconstruction , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[36]  Wei Gao,et al.  kPAM-SC: Generalizable Manipulation Planning using KeyPoint Affordance and Shape Completion , 2019, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[37]  Oliver Kroemer,et al.  A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithms , 2019, J. Mach. Learn. Res..

[38]  Jen Jen Chung,et al.  Volumetric Grasping Network: Real-time 6 DOF Grasp Detection in Clutter , 2021, CoRL.

[39]  Sonia Chernova,et al.  Same Object, Different Grasps: Data and Semantic Knowledge for Task-Oriented Grasping , 2020, CoRL.

[40]  Winston H. Hsu,et al.  A Coarse-To-Fine (C2F) Representation for End-To-End 6-DoF Grasp Detection , 2020, CoRL.

[41]  Wenguang Zhang,et al.  Learning an end-to-end spatial grasp generation and refinement algorithm from simulation , 2020, Machine Vision and Applications.

[42]  Jian Chen,et al.  Grasp Proposal Networks: An End-to-End Solution for Visual Learning of Robotic Grasps , 2020, NeurIPS.

[43]  Marco F. Huber,et al.  A Survey on Learning-Based Robotic Grasping , 2020, Current Robotics Reports.

[44]  Harry Zhang,et al.  6-DoF Grasp Planning using Fast 3D Reconstruction and Grasp Quality CNN , 2020, ArXiv.

[45]  Alfred Schöttl,et al.  6-DOF Grasp Detection for Unknown Objects , 2020, 2020 10th International Conference on Advanced Computer Information Technologies (ACIT).

[46]  Dimitrios Tzionas,et al.  GRAB: A Dataset of Whole-Body Human Grasping of Objects , 2020, ECCV.

[47]  Dhiraj Gandhi,et al.  Swoosh! Rattle! Thump! - Actions that Sound , 2020, Robotics: Science and Systems.

[48]  Khashayar Namdar,et al.  A Brief Review of Deep Multi-task Learning and Auxiliary Task Learning , 2020, ArXiv.

[49]  Pei-Chun Lin,et al.  Q-PointNet: Intelligent Stacked-Objects Grasping Using a RGBD Sensor and a Dexterous Hand , 2020, 2020 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[50]  Tucker Hermans,et al.  Multi-Fingered Active Grasp Learning , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[51]  Cewu Lu,et al.  GraspNet-1Billion: A Large-Scale Benchmark for General Object Grasping , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[52]  Tucker Hermans,et al.  Multifingered Grasp Planning via Inference in Deep Neural Networks: Outperforming Sampling by Learning Differentiable Models , 2020, IEEE Robotics & Automation Magazine.

[53]  Kyungjae Lee,et al.  Hierarchical 6-DoF Grasping with Approaching Direction Selection , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[54]  Oliver Brock,et al.  Active Acoustic Contact Sensing for Soft Pneumatic Actuators , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[55]  Cewu Lu,et al.  Transferable Active Grasping and Real Embodied Dataset , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[56]  Ce Liu,et al.  Supervised Contrastive Learning , 2020, NeurIPS.

[57]  Ronald P. A. Petrick,et al.  Affordances in Robotic Tasks - A Survey , 2020, ArXiv.

[58]  Wenguang Zhang,et al.  PointNet++ Grasping: Learning An End-to-end Spatial Grasp Generation Algorithm from Sparse Point Clouds , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[59]  Peter Corke,et al.  EGAD! An Evolved Grasping Analysis Dataset for Diversity and Reproducibility in Robotic Manipulation , 2020, IEEE Robotics and Automation Letters.

[60]  Nanning Zheng,et al.  REGNet: REgion-based Grasp Network for Single-shot Grasp Detection in Point Clouds , 2020, ArXiv.

[61]  Presish Bhattachan,et al.  37,000 Human-Planned Robotic Grasps With Six Degrees of Freedom , 2020, IEEE Robotics and Automation Letters.

[62]  Feng Xu,et al.  Generative Attention Learning: a “GenerAL” framework for high-performance multi-fingered grasping in clutter , 2020, Autonomous Robots.

[63]  S. Hamidreza Kasaei,et al.  Learning to Grasp 3D Objects using Deep Residual U-Nets , 2020, 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).

[64]  Zherong Pan,et al.  Deep Differentiable Grasp Planner for High-DOF Grippers , 2020, Robotics: Science and Systems.

[65]  Markus Vincze,et al.  DGCM-Net: Dense Geometrical Correspondence Matching Network for Incremental Experience-Based Robotic Grasping , 2020, Frontiers in Robotics and AI.

[66]  Andy Zeng,et al.  Grasping in the Wild: Learning 6DoF Closed-Loop Grasping From Low-Cost Demonstrations , 2019, IEEE Robotics and Automation Letters.

[67]  Dieter Fox,et al.  6-DOF Grasping for Target-driven Object Manipulation in Clutter , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[68]  Dieter Fox,et al.  Manipulation Trajectory Optimization with Online Grasp Synthesis and Selection , 2019, Robotics: Science and Systems.

[69]  Jeannette Bohg,et al.  Learning to Scaffold the Development of Robotic Manipulation Skills , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[70]  Danica Kragic,et al.  Learning Task-Oriented Grasping From Human Activity Datasets , 2019, IEEE Robotics and Automation Letters.

[71]  Jianlan Luo,et al.  UniGrasp: Learning a Unified Model to Grasp With Multifingered Robotic Hands , 2019, IEEE Robotics and Automation Letters.

[72]  Yang Yang,et al.  Learning to Generate 6-DoF Grasp Poses with Reachability Awareness , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[73]  Mark Van der Merwe,et al.  Learning Continuous 3D Reconstructions for Geometrically Aware Grasping , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[74]  T. Kollar,et al.  A Mobile Manipulation System for One-Shot Teaching of Complex Tasks in Homes , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[75]  Ville Kyrki,et al.  Beyond Top-Grasps Through Scene Completion , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[76]  Marwan Qaid Mohammed,et al.  Review of Deep Reinforcement Learning-Based Object Grasping: Techniques, Open Challenges, and Recommendations , 2020, IEEE Access.

[77]  Jeannette Bohg,et al.  Predicting grasp success in the real world - A study of quality metrics and human assessment , 2019, Robotics Auton. Syst..

[78]  Hao Su,et al.  S4G: Amodal Single-view Single-Shot SE(3) Grasp Detection in Cluttered Scenes , 2019, CoRL.

[79]  Raphael Grimm,et al.  Visuo-Haptic Grasping of Unknown Objects based on Gaussian Process Implicit Surfaces and Deep Learning , 2019, 2019 IEEE-RAS 19th International Conference on Humanoid Robots (Humanoids).

[80]  Chao Chen,et al.  Fruit Detection and Segmentation for Apple Harvesting Using Visual Sensor in Orchards , 2019, Sensors.

[81]  Ken Goldberg,et al.  Adversarial Grasp Objects , 2019, 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE).

[82]  Dominik Belter,et al.  Learning better generative models for dexterous, single-view grasping of novel objects , 2019, Int. J. Robotics Res..

[83]  Ronald P. A. Petrick,et al.  Learning Grasp Affordance Reasoning Through Semantic Relations , 2019, IEEE Robotics and Automation Letters.

[84]  Diederik P. Kingma,et al.  An Introduction to Variational Autoencoders , 2019, Found. Trends Mach. Learn..

[85]  Dieter Fox,et al.  6-DOF GraspNet: Variational Grasp Generation for Object Manipulation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[86]  Pedro Lima,et al.  Grasp Planning with Incomplete Knowledge About the Object to be Grasped , 2019, 2019 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[87]  Charles C. Kemp,et al.  ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imaging , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[88]  Ken Goldberg,et al.  On-Policy Dataset Synthesis for Learning Robot Grasping Policies Using Fully Convolutional Deep Networks , 2019, IEEE Robotics and Automation Letters.

[89]  Wei Gao,et al.  kPAM: KeyPoint Affordances for Category-Level Robotic Manipulation , 2019, ISRR.

[90]  Peter K. Allen,et al.  Pixel-Attentive Policy Gradient for Multi-Fingered Grasping in Cluttered Scenes , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[91]  Ville Kyrki,et al.  Robust Grasp Planning Over Uncertain Shape Completions , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[92]  Zherong Pan,et al.  Generating Grasp Poses for a High-DOF Gripper Using Neural Networks , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[93]  Sergey Levine,et al.  Sim-To-Real via Sim-To-Sim: Data-Efficient Robotic Grasping via Randomized-To-Canonical Adaptation Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[94]  Ludovic Righetti,et al.  Leveraging Contact Forces for Learning to Grasp , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[95]  Fuchun Sun,et al.  PointNetGPD: Detecting Grasp Configurations from Point Sets , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[96]  Marco Santochi,et al.  Grasping , 2019, CIRP Encyclopedia of Production Engineering.

[97]  Jiajun Wu,et al.  Learning to Reconstruct Shapes from Unseen Classes , 2018, NeurIPS.

[98]  Wei Chen,et al.  Tactile Sensors for Friction Estimation and Incipient Slip Detection—Toward Dexterous Robotic Manipulation: A Review , 2018, IEEE Sensors Journal.

[99]  Manabu Hashimoto,et al.  Model-less Estimation Method for Robot Grasping Parameters Using 3D Shape Primitive Approximation , 2018, 2018 IEEE 14th International Conference on Automation Science and Engineering (CASE).

[100]  Patricio A. Vela,et al.  Real-World Multiobject, Multigrasp Detection , 2018, IEEE Robotics and Automation Letters.

[101]  Sergey Levine,et al.  QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation , 2018, CoRL.

[102]  Robert Platt,et al.  Learning 6-DoF Grasping and Pick-Place Using Attention Focus , 2018, CoRL.

[103]  Majid Shishehgar,et al.  A systematic review of research into how robotic technology can help older people , 2018 .

[104]  Jitendra Malik,et al.  More Than a Feeling: Learning to Grasp and Regrasp Using Vision and Touch , 2018, IEEE Robotics and Automation Letters.

[105]  Mirko Wächter,et al.  Grasping of Unknown Objects Using Deep Convolutional Neural Networks Based on Depth Images , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[106]  Peter Corke,et al.  Closing the Loop for Robotic Grasping: A Real-time, Generative Grasp Synthesis Approach , 2018, Robotics: Science and Systems.

[107]  Daniela Rus,et al.  Learning Object Grasping for Soft Robot Hands , 2018, IEEE Robotics and Automation Letters.

[108]  Sergey Levine,et al.  Deep Reinforcement Learning for Vision-Based Robotic Grasping: A Simulated Comparative Evaluation of Off-Policy Methods , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[109]  Nikolaus Correll,et al.  A Robotic Skin for Collision Avoidance and Affective Touch Recognition , 2018, IEEE Robotics and Automation Letters.

[110]  Wojciech Zaremba,et al.  Domain Randomization and Generative Models for Robotic Grasping , 2017, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[111]  Darwin G. Caldwell,et al.  AffordanceNet: An End-to-End Deep Learning Approach for Object Affordance Detection , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[112]  Arkanath Pathak,et al.  Learning 6-DOF Grasping Interaction via Deep Geometry-Aware 3D Representations , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[113]  Sergey Levine,et al.  Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection , 2016, Int. J. Robotics Res..

[114]  Sergey Levine,et al.  Using Simulation and Domain Adaptation to Improve Efficiency of Deep Robotic Grasping , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[115]  Tucker Hermans,et al.  Planning Multi-Fingered Grasps as Probabilistic Inference in a Learned Deep Network , 2018, ISRR.

[116]  Nikolaos G. Tsagarakis,et al.  Object-based affordances detection with Convolutional Neural Networks and dense Conditional Random Fields , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[117]  Alec Radford,et al.  Proximal Policy Optimization Algorithms , 2017, ArXiv.

[118]  Kate Saenko,et al.  Grasp Pose Detection in Point Clouds , 2017, Int. J. Robotics Res..

[119]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[120]  Xinyu Liu,et al.  Dex-Net 2.0: Deep Learning to Plan Robust Grasps with Synthetic Point Clouds and Analytic Grasp Metrics , 2017, Robotics: Science and Systems.

[121]  Yuxi Li,et al.  Deep Reinforcement Learning: An Overview , 2017, ArXiv.

[122]  Medhat A. Moussa,et al.  Modeling Grasp Motor Imagery Through Deep Conditional Generative Models , 2017, IEEE Robotics and Automation Letters.

[123]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[124]  Christopher Kanan,et al.  Robotic grasp detection using deep convolutional neural networks , 2016, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[125]  Chad DeChant,et al.  Shape completion enabled robotic grasping , 2016, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[126]  Peter I. Corke,et al.  The ACRV picking benchmark: A robotic shelf picking benchmark to foster reproducible research , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[127]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[128]  Oliver Brock,et al.  Lessons from the Amazon Picking Challenge: Four Aspects of Building Robotic Systems , 2016, IJCAI.

[129]  Kris K. Hauser,et al.  Grasp Planning by Optimizing a Deep Learning Scoring Function , 2017 .

[130]  Leonidas J. Guibas,et al.  ObjectNet3D: A Large Scale Database for 3D Object Recognition , 2016, ECCV.

[131]  Nikolaos G. Tsagarakis,et al.  Detecting object affordances with Convolutional Neural Networks , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[132]  Mathieu Aubry,et al.  Dex-Net 1.0: A cloud-based network of 3D objects for robust grasp planning using a Multi-Armed Bandit model with correlated rewards , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[133]  Kate Saenko,et al.  High precision grasp pose detection in dense clutter , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[134]  Oliver Brock,et al.  A novel type of compliant and underactuated robotic hand for dexterous grasping , 2016, Int. J. Robotics Res..

[135]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[136]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[137]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[138]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[139]  Manuel G. Catalano,et al.  From Soft to Adaptive Synergies: The Pisa/IIT SoftHand , 2016, Human and Robot Hands.

[140]  Peter K. Allen,et al.  Generating multi-fingered robotic grasps via deep learning , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[141]  Alberto Rodriguez,et al.  Prehensile pushing: In-hand manipulation with push-primitives , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[142]  Leonidas J. Guibas,et al.  ShapeNet: An Information-Rich 3D Model Repository , 2015, ArXiv.

[143]  Honglak Lee,et al.  Learning Structured Output Representation using Deep Conditional Generative Models , 2015, NIPS.

[144]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[145]  Siddhartha S. Srinivasa,et al.  The YCB object and Model set: Towards common benchmarks for manipulation research , 2015, 2015 International Conference on Advanced Robotics (ICAR).

[146]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[147]  Jeannette Bohg,et al.  Leveraging big data for grasp planning , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[148]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[149]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[150]  Sergey Levine,et al.  Trust Region Policy Optimization , 2015, ICML.

[151]  Joseph Redmon,et al.  Real-time grasp detection using convolutional neural networks , 2014, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[152]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[153]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[154]  Robert Platt,et al.  Using Geometry to Detect Grasp Poses in 3D Point Clouds , 2015, ISRR.

[155]  Peter Englert,et al.  Dual execution of optimized contact interaction trajectories , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[156]  Akira Nakamura,et al.  Modeling of everyday objects for semantic grasp , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[157]  Pieter Abbeel,et al.  BigBIRD: A large-scale 3D database of object instances , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[158]  Siddhartha S. Srinivasa,et al.  Extrinsic dexterity: In-hand manipulation with external forces , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[159]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[160]  Danica Kragic,et al.  Data-Driven Grasp Synthesis—A Survey , 2013, IEEE Transactions on Robotics.

[161]  Gaurav S. Sukhatme,et al.  An autonomous manipulation system based on force control and optimization , 2014, Auton. Robots.

[162]  Oliver Brock,et al.  Exploitation of environmental constraints in human and robotic grasping , 2015, Int. J. Robotics Res..

[163]  Danica Kragic,et al.  Enhancing visual perception of shape through tactile glances , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[164]  Honglak Lee,et al.  Deep learning for detecting robotic grasps , 2013, Int. J. Robotics Res..

[165]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[166]  J. Andrew Bagnell,et al.  Robust Object Grasping using Force Compliant Motion Primitives , 2012, Robotics: Science and Systems.

[167]  Rüdiger Dillmann,et al.  The KIT object models database: An object model database for object recognition, localization and manipulation in service robotics , 2012, Int. J. Robotics Res..

[168]  Markus Vincze,et al.  3DNet: Large-scale object class recognition from CAD models , 2012, 2012 IEEE International Conference on Robotics and Automation.

[169]  Larry H. Matthies,et al.  End-to-end dexterous manipulation with deliberate interactive estimation , 2012, 2012 IEEE International Conference on Robotics and Automation.

[170]  Shipra Agrawal,et al.  Analysis of Thompson Sampling for the Multi-armed Bandit Problem , 2011, COLT.

[171]  Stefan Ulbrich,et al.  Simox: A Robotics Toolbox for Simulation, Motion and Grasp Planning , 2012, IAS.

[172]  Jimmy A. Jørgensen,et al.  Assessing Grasp Stability Based on Learning and Haptic Data , 2011, IEEE Transactions on Robotics.

[173]  Ashutosh Saxena,et al.  Efficient grasping from RGBD images: Learning using a new rectangle representation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[174]  Matei T. Ciocarlie,et al.  Hand Posture Subspaces for Dexterous Robotic Grasping , 2009, Int. J. Robotics Res..

[175]  三嶋 博之 The theory of affordances , 2008 .

[176]  Lawson L. S. Wong,et al.  Learning Grasp Strategies with Partial Shape Information , 2008, AAAI.

[177]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects using Vision , 2008, Int. J. Robotics Res..

[178]  Anis Sahbani,et al.  Learning the natural grasping component of an unknown object , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[179]  Tamim Asfour,et al.  Integrated Grasp Planning and Visual Object Localization For a Humanoid Robot with Five-Fingered Hands , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[180]  C. Michel,et al.  An approach to extract Natural Grasping Axes with a real 3D vision system , 2006, 2006 IEEE International Symposium on Industrial Electronics.

[181]  Ashutosh Saxena,et al.  Learning to Grasp Novel Objects Using Vision , 2006, ISER.

[182]  Masayuki Nakajima,et al.  Detection and evaluation of grasping positions for autonomous agents , 2005, 2005 International Conference on Cyberworlds (CW'05).

[183]  Peter K. Allen,et al.  Graspit! A versatile simulator for robotic grasping , 2004, IEEE Robotics & Automation Magazine.

[184]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[185]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[186]  Antonio Morales Escrig Learning to predict grasp reliability with a multifinger robot hand by using visual features , 2004 .

[187]  Henrik I. Christensen,et al.  Automatic grasp planning using shape primitives , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[188]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[189]  Kenneth Y. Goldberg,et al.  Computing parallel-jaw grips , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[190]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[191]  Shimon Edelman,et al.  Learning to grasp using visual information , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[192]  David E. Orin,et al.  General formulation for force distribution in power grasp , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[193]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[194]  S. Srihari Mixture Density Networks , 1994 .

[195]  Joel W. Burdick,et al.  Finding antipodal point grasps on irregularly shaped objects , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[196]  John F. Canny,et al.  Planning optimal grasps , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[197]  Van-Duc Nguyen,et al.  Constructing force-closure grasps in 3D , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[198]  浅田 春比古,et al.  Studies on prehension and handling by robot hands with elastic fingers , 1979 .

[199]  R. Shaw,et al.  Perceiving, Acting and Knowing : Toward an Ecological Psychology , 1978 .