Learning a State Transition Model of an Underactuated Adaptive Hand

Fully actuated multifingered robotic hands are often expensive and fragile. Low-cost underactuated hands are appealing but present challenges due to the lack of analytical models. This letter aims to learn a stochastic version of such models automatically from data with minimum user effort. The focus is on identifying the dominant, sensible features required to express hand state transitions given quasi-static motions, thereby enabling the learning of a probabilistic transition model from recorded trajectories. Experiments both with Gaussian processes (GP) and neural etwork models are included for analysis and evaluation. The metric for local GP regression is obtained with a manifold learning approach, known as Diffusion Maps, to uncover the lower-dimensional subspace in which the data lies and provide a geodesic metric. Results show that using Diffusion Maps with a feature space composed of the object position, actuator angles, and actuator loads, sufficiently expresses the hand-object system configuration and can provide accurate enough predictions for a relatively long horizon. To the best of the authors’ knowledge, this is the first learned transition model for such underactuated hands that achieves this level of predictability. Notably, the same feature space implicitly embeds the size of the manipulated object and can generalize to new objects of varying sizes. Furthermore, the learned model can identify states that are on the verge of failure and which should be avoided during manipulation. The usefulness of the model is also demonstrated by integrating it with closed-loop control to successfully and safely complete manipulation tasks.

[1]  Stéphane Lafon,et al.  Diffusion maps , 2006 .

[2]  Sergey Levine,et al.  Optimal control with learned local models: Application to dexterous manipulation , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Yiannis Demiris,et al.  Enhanced kinematic model for dexterous manipulation with an underactuated hand , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[5]  Aaron M. Dollar,et al.  A parallel robots framework to study precision grasping and dexterous manipulation , 2013, 2013 IEEE International Conference on Robotics and Automation.

[6]  Manuel G. Catalano,et al.  Adaptive synergies: An approach to the design of under-actuated robotic hands , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Mark R. Cutkosky,et al.  Design and testing of a selectively compliant underactuated hand , 2014, Int. J. Robotics Res..

[8]  Clément Gosselin,et al.  Simulation and design of underactuated mechanical hands , 1998 .

[9]  Nolan Wagener,et al.  Learning contact-rich manipulation skills with guided policy search , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Dieter Fox,et al.  Gaussian Processes and Reinforcement Learning for Identification and Control of an Autonomous Blimp , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[11]  Jimmy A. Jørgensen,et al.  Assessing Grasp Stability Based on Learning and Haptic Data , 2011, IEEE Transactions on Robotics.

[12]  Antonio Bicchi,et al.  On the manipulability ellipsoids of underactuated robotic hands with compliance , 2012, Robotics Auton. Syst..

[13]  Pieter Abbeel,et al.  Deep learning helicopter dynamics models , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Robert D. Howe,et al.  The Highly Adaptive SDM Hand: Design and Performance Evaluation , 2010, Int. J. Robotics Res..

[15]  Athanasios S. Polydoros,et al.  Survey of Model-Based Reinforcement Learning: Applications on Robotics , 2017, J. Intell. Robotic Syst..

[16]  Aaron Dollar,et al.  Yale OpenHand Project: Optimizing Open-Source Hand Designs for Ease of Fabrication and Adoption , 2017, IEEE Robotics & Automation Magazine.

[17]  Aaron M. Dollar,et al.  Vision-based model predictive control for within-hand precision manipulation with underactuated grippers , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Alessio Rocchi,et al.  Stable simulation of underactuated compliant hands , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Dongming Gan,et al.  Modeling and Prototyping of an Underactuated Gripper Exploiting Joint Compliance and Modularity , 2018, IEEE Robotics and Automation Letters.

[20]  Aaron M. Dollar,et al.  Dexterous manipulation with underactuated elastic hands , 2011, 2011 IEEE International Conference on Robotics and Automation.

[21]  Jan Peters,et al.  Local Gaussian process regression for real-time model-based robot control , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Sudipto Banerjee,et al.  Hierarchical Nearest-Neighbor Gaussian Process Models for Large Geostatistical Datasets , 2014, Journal of the American Statistical Association.

[23]  Máximo A. Roa,et al.  Planning in-hand object manipulation with multifingered hands considering task constraints , 2013, 2013 IEEE International Conference on Robotics and Automation.

[24]  Suguru Arimoto,et al.  Control of an object with parallel surfaces by a pair of finger robots without object sensing , 2005, IEEE Transactions on Robotics.

[25]  Tze-Yun Leong,et al.  Online Feature Selection for Model-based Reinforcement Learning , 2013, ICML.

[26]  Aaron M. Dollar,et al.  Toward robust, whole-hand caging manipulation with underactuated hands , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Aaron M. Dollar,et al.  Learning Modes of Within-Hand Manipulation , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Suguru Arimoto,et al.  A stability theory of a manifold: concurrent realization of grasp and orientation control of an object by a pair of robot fingers , 2003, Robotica.

[29]  Aaron M. Dollar,et al.  Stable, open-loop precision manipulation with underactuated hands , 2015, Int. J. Robotics Res..

[30]  C. Karen Liu,et al.  Dexterous manipulation using both palm and fingers , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[31]  Takayoshi Yamada,et al.  Static Stability Analysis of Spatial Grasps Including Contact Surface Geometry , 2011, Adv. Robotics.

[32]  Moonhong Baeg,et al.  Development of a low cost anthropomorphic robot hand with high capability , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Jan Peters,et al.  Learning robot in-hand manipulation with tactile features , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[34]  Kuan-Ting Yu,et al.  More than a million ways to be pushed. A high-fidelity experimental dataset of planar pushing , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[35]  Aaron M. Dollar,et al.  Vision-based precision manipulation with underactuated hands: Simple and effective solutions for dexterity , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[36]  Jeff G. Schneider,et al.  Autonomous helicopter control using reinforcement learning policy search methods , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[37]  Peter K. Allen,et al.  Learning grasp stability , 2012, 2012 IEEE International Conference on Robotics and Automation.

[38]  Peter Englert,et al.  Multi-task policy search for robotics , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).