Sequence-to-sequence models for trajectory deformation of dynamic manipulation

In dynamic manipulation, robots can manipulate objects without grasping by utilizing inertia effect. However, the trajectory planning for dynamic manipulation is a difficult issue due to dynamic constraint. Trajectory deformation considering dynamic constraint after original trajectories are generated is necessary for the issue. To realize such deformation methods, we introduce on sequence-to-sequence (seq2seq) models, which can convert a time series to another time series. This paper proposes a trajectory deformation method with seq2seq models deforming trajectories to satisfy dynamic constraint. Users can obtain trajectories for dynamic manipulation by designing outlines of motion and inputting them to the proposed seq2seq model. In addition, this paper proposes a learning curriculum that does not need labeled dataset. Only mathematical representation of constraint and unlabeled trajectories are necessary. We implement a seq2seq model by the proposed method to a robot turning over pancakes and confirm the validity by a simulation and an experiment.

[1]  Florent Lamiraux,et al.  Reactive trajectory deformation for nonholonomic systems: application to mobile robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[2]  Bowen Zhou,et al.  Abstractive Text Summarization using Sequence-to-sequence RNNs and Beyond , 2016, CoNLL.

[3]  Samy Bengio,et al.  Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks , 2015, NIPS.

[4]  Toshiyuki Murakami,et al.  Torque sensorless control in multidegree-of-freedom manipulator , 1993, IEEE Trans. Ind. Electron..

[5]  Thierry Fraichard,et al.  From path to trajectory deformation , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Geoffrey E. Hinton,et al.  Layer Normalization , 2016, ArXiv.

[7]  Sandra Hirche,et al.  Fast trajectory replanning using Laplacian mesh optimization , 2012, 2012 12th International Conference on Control Automation Robotics & Vision (ICARCV).

[8]  Quang-Cuong Pham,et al.  Dynamic non-prehensile object transportation , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[9]  Kevin M. Lynch,et al.  Dynamic underactuated nonprehensile manipulation , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[10]  S. LaValle,et al.  Randomized Kinodynamic Planning , 2001 .

[11]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[12]  Naoji Shiroma,et al.  The roles of shape and motion in dynamic manipulation: the butterfly example , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[13]  M.T. Mason,et al.  Dynamic manipulation , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[14]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[15]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[16]  Jason Weston,et al.  Curriculum learning , 2009, ICML '09.

[17]  Toshiaki Tsuji,et al.  Dynamic Object Manipulation Considering Contact Condition of Robot With Tool , 2016, IEEE Transactions on Industrial Electronics.

[18]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[19]  Shigeki Sugano,et al.  Learning to Perceive the World as Probabilistic or Deterministic via Interaction With Others: A Neuro-Robotics Experiment , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Sandra Hirche,et al.  Online deformation of optimal trajectories for constrained nonprehensile manipulation , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Quoc V. Le,et al.  Semi-supervised Sequence Learning , 2015, NIPS.

[22]  Quoc V. Le,et al.  A Neural Conversational Model , 2015, ArXiv.

[23]  Darwin G. Caldwell,et al.  Robot motor skill coordination with EM-based Reinforcement Learning , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.