Recognizing Orientation Slip in Human Demonstrations

Manipulations of a constrained object often use a non-rigid grasp that allows the object to rotate relative to the end effector. This orientation slip strategy is often present in natural human demonstrations, yet it is generally overlooked in methods to identify constraints from such demonstrations. In this paper, we present a method to model and recognize prehensile orientation slip in human demonstrations of constrained interactions. Using only observations of an end effector, we can detect the type of constraint, parameters of the constraint, and orientation slip properties. Our method uses a novel hierarchical model selection method that is informed by multiple origins of physics-based evidence. A study with eight participants shows that orientation slip occurs in natural demonstrations and confirms that it can be detected by our method.

[1]  Leopoldo Armesto,et al.  Constraint-aware learning of policies by demonstration , 2018, Int. J. Robotics Res..

[2]  Aude Billard,et al.  Learning task manifolds for constrained object manipulation , 2018, Auton. Robots.

[3]  Dmitry Berenson,et al.  Learning constraints from demonstrations with grid and parametric representations , 2018, WAFR.

[4]  Kamal K. Gupta,et al.  Planning quasi-static fingertip manipulations for reconfiguring objects , 1999, IEEE Trans. Robotics Autom..

[5]  Bilge Mutlu,et al.  Characterizing Input Methods for Human-to-Robot Demonstrations , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[6]  Oliver Brock,et al.  Coupled recursive estimation for online interactive perception of articulated objects , 2019, Int. J. Robotics Res..

[7]  Alois Knoll,et al.  Task level robot programming using prioritized non-linear inequality constraints , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  S. Shankar Sastry,et al.  Kinematics and control of multifingered hands with rolling contact , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[9]  Christopher G. Atkeson,et al.  Online Bayesian changepoint detection for articulated motion models , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[10]  David L. Brock,et al.  Enhancing the dexterity of a robot hand using controlled slip , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[11]  Michael Gleicher,et al.  A Method for Constraint Inference Using Pose and Wrench Measurements , 2020, ArXiv.

[12]  Michael Gleicher,et al.  Recognizing Geometric Constraints in Human Demonstrations Using Force and Position Signals , 2018, IEEE Robotics and Automation Letters.

[13]  Siddhartha S. Srinivasa,et al.  Manipulation planning on constraint manifolds , 2009, 2009 IEEE International Conference on Robotics and Automation.

[14]  Dmitry Berenson,et al.  Learning Parametric Constraints in High Dimensions from Demonstrations , 2019, CoRL.

[15]  Joris De Schutter,et al.  eTaSL/eTC: A constraint-based task specification language and robot controller using expression graphs , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Oliver Brock,et al.  Interactive Perception: Leveraging Action in Perception and Perception in Action , 2016, IEEE Transactions on Robotics.

[17]  Scott Niekum,et al.  Learning Hybrid Object Kinematics for Efficient Hierarchical Planning Under Uncertainty , 2019, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Wolfram Burgard,et al.  A Probabilistic Framework for Learning Kinematic Models of Articulated Objects , 2011, J. Artif. Intell. Res..

[19]  Enric Celaya,et al.  A Relational Positioning Methodology for Robot Task Specification and Execution , 2008, IEEE Transactions on Robotics.

[20]  Julie A. Shah,et al.  C-LEARN: Learning geometric constraints from demonstrations for multi-step manipulation in shared autonomy , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Joris De Schutter,et al.  Contact-State Segmentation Using Particle Filters for Programming by Human Demonstration in Compliant-Motion Tasks , 2007, IEEE Transactions on Robotics.

[22]  S. Shankar Sastry,et al.  Dynamic control of sliding by robot hands for regrasping , 1992, IEEE Trans. Robotics Autom..

[23]  Pradeep K. Khosla,et al.  Manipulation task primitives for composing robot skills , 1997, Proceedings of International Conference on Robotics and Automation.

[24]  E. J. Haug,et al.  Computer aided kinematics and dynamics of mechanical systems. Vol. 1: basic methods , 1989 .