Time Series Motion Generation Considering Long Short-Term Motion

Various adaptive abilities are required for robots interacting with humans in daily life. It is difficult to design adaptive algorithms manually; however, by using end-to-end machine learning, labor can be saved during the design process. In our previous research, a task requiring force adjustment was achieved through imitation learning that considered position and force information using a four-channel bilateral control. Unfortunately, tasks that include long-term (slow) motion are still challenging. Furthermore, during system identification, there is a method known as the multi-decimation (MD) identification method. It separates lower and higher frequencies, and then identifies the parameters characterized at each frequency. Therefore, we proposed utilizing machine learning to take advantage of the MD method to infer short-term and long-term (high and low frequency, respectively) motion. In this paper, long-term motion tasks such as writing a letter using a pen fixed on a robot are discussed. We found differences in suitable sampling periods between position and force information. The validity of the proposed method was then experimentally verified, showing the importance of long-term inference with adequate sampling periods.

[1]  Daniela Rus,et al.  Baxter's Homunculus: Virtual Reality Spaces for Teleoperation in Manufacturing , 2017, IEEE Robotics and Automation Letters.

[2]  Ken Goldberg,et al.  Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperation , 2017, ICRA.

[3]  Claudio Pacchierotti,et al.  Cutaneous haptic feedback to ensure the stability of robotic teleoperation systems , 2015, Int. J. Robotics Res..

[4]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[5]  Marc'Aurelio Ranzato,et al.  Sequence Level Training with Recurrent Neural Networks , 2015, ICLR.

[6]  Sergey Levine,et al.  Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection , 2016, Int. J. Robotics Res..

[7]  Toshiyuki Murakami,et al.  Torque sensorless control in multidegree-of-freedom manipulator , 1993, IEEE Trans. Ind. Electron..

[8]  Andrew W. Senior,et al.  Fast and accurate recurrent neural network acoustic models for speech recognition , 2015, INTERSPEECH.

[9]  Subhashini Venugopalan,et al.  Translating Videos to Natural Language Using Deep Recurrent Neural Networks , 2014, NAACL.

[10]  Kouhei Ohnishi,et al.  A Novel Motion Equation for General Task Description and Analysis of Mobile-Hapto , 2013, IEEE Transactions on Industrial Electronics.

[11]  Kiyoshi Ohishi,et al.  Stability Analysis and Experimental Validation of a Motion-Copying System , 2009, IEEE Transactions on Industrial Electronics.

[12]  Toshiaki Tsuji,et al.  Estimation and Kinetic Modeling of Human Arm using Wearable Robot Arm , 2017 .

[13]  Jun Tani,et al.  Emergence of Functional Hierarchy in a Multiple Timescale Neural Network Model: A Humanoid Robot Experiment , 2008, PLoS Comput. Biol..

[14]  Tetsuya Ogata,et al.  Put-in-Box Task Generated from Multiple Discrete Tasks by aHumanoid Robot Using Deep Learning , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Oliver Brock,et al.  Lessons from the Amazon Picking Challenge: Four Aspects of Building Robotic Systems , 2016, Robotics: Science and Systems.

[16]  Samy Bengio,et al.  Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks , 2015, NIPS.

[17]  Tetsuya Ogata,et al.  Put-In-Box task generated from multiple discrete tasks by humanoid robot using deep learning , 2017 .

[18]  J. Nagumo,et al.  A learning method for system identification , 1967, IEEE Transactions on Automatic Control.

[19]  Blake Hannaford,et al.  Improving control precision and motion adaptiveness for surgical robot with recurrent neural network , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Toshiaki Tsuji,et al.  Bilateral control using functional electrical stimulation , 2015, IECON 2015 - 41st Annual Conference of the IEEE Industrial Electronics Society.

[21]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[22]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[23]  Darwin G. Caldwell,et al.  Imitation Learning of Positional and Force Skills Demonstrated via Kinesthetic Teaching and Haptic Input , 2011, Adv. Robotics.

[24]  Marcus Rohrbach,et al.  Translating Videos to Natural Language Using Deep Recurrent Neural Networks , 2014, NAACL.

[25]  Yeong-Hwa Chang,et al.  Deep learning for object identification in ROS-based mobile robots , 2018, 2018 IEEE International Conference on Applied System Invention (ICASI).

[26]  Tsuyoshi Adachi,et al.  Imitation Learning for Object Manipulation Based on Position/Force Information Using Bilateral Control , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  Kouhei Ohnishi,et al.  Multi-DOF Micro-Macro Bilateral Controller Using Oblique Coordinate Control , 2011, IEEE Transactions on Industrial Informatics.

[28]  Carme Torras,et al.  A robot learning from demonstration framework to perform force-based manipulation tasks , 2013, Intelligent Service Robotics.

[29]  Tomoki Toda,et al.  An Investigation of Subband Wavenet Vocoder Covering Entire Audible Frequency Range with Limited Acoustic Features , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[30]  Shigeki Sugano,et al.  Repeatable Folding Task by Humanoid Robot Worker Using Deep Learning , 2017, IEEE Robotics and Automation Letters.

[31]  Koichi Osuka,et al.  Control of a heavy material handling agricultural manipulator using /spl mu/-synthesis and robust gain scheduling , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[32]  Kouhei Ohnishi,et al.  Motion control for advanced mechatronics , 1996 .

[33]  VelosoManuela,et al.  A survey of robot learning from demonstration , 2009 .