A Real-Time Robot Motion Generation System Based on Human Gesture

When a communication robot conveys some messages to human users, showing some motions matching with the messages is an effective way in human robot interaction. Designing and implementing a set of useful robot motions, however, is a difficult problem. It requires developers to describe instructions for accurately controlling motors embedded in the robot. In this paper, we propose a method for generating robot motions by using human gestures as input. The proposed method captures human gestures in real time by using motion sensors, converting the acquired data to robot motion instructions, and applying them to a physical robot. We developed a prototype system targeted at supporting different motion sensors and robots with lightweight data communication between a control node and a robot. We conducted experiments for controlling the robots by human gestures to verify the effectiveness of the proposed method. It can promote better human robot communication environments with reducing labors in robot motion development.

[1]  Takashi Minato,et al.  Generating natural motion in an android by mapping human motion , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Toshiyuki Haramaki,et al.  An unsolicited heat stroke alert system for the elderly , 2017, 2017 IEEE International Conference on Consumer Electronics - Taiwan (ICCE-TW).

[3]  Hiroaki Nishino,et al.  A Mobile Wireless Network Visualizer for Assisting Administrators , 2018, EIDWT.

[4]  Takayuki Kanda,et al.  Guidelines for Contextual Motion Design of a Humanoid Robot , 2013, Int. J. Soc. Robotics.

[5]  Hans-Peter Seidel,et al.  VNect , 2017, ACM Trans. Graph..

[6]  Hiroaki Nishino,et al.  A Robot Assistant in an Edge-Computing-Based Safe Driving Support System , 2018, NBiS.

[7]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Cataldo Guaragnella,et al.  A Kinect-Based Gesture Recognition Approach for a Natural Human Robot Interface , 2015 .

[9]  Yuichiro Yoshikawa,et al.  Show, attend and interact: Perceivable human-robot social interaction through neural attention Q-network , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Hiroaki Nishino,et al.  A Safe Driving Support Method Using Olfactory Stimuli , 2018, CISIS.