Gesture recognition based human–robot interactive control for robot soccer

This paper proposes an interaction method in human gestures for controlling robot play soccer. It aims to design a human–robot interactive control scheme let a humanoid robot to substitute who want but cannot such as disabled people without feet for playing soccer games. The scheme first adopts the Kinect based gesture recognition system to analyze human gestures, and then drives the humanoid robot to do respective motions for playing soccer or throwing ball according to what human gestures. The proposed gesture recognition scheme consists of two subsystems in which the Kinect-based 3D framework trace system provides the kernel recognition and the electromyography signal measurement assists the slight movement detection. It mainly makes all the motions of upper body classified as several types of gestures. Every different gesture is set in relative to a unique soccer motion of the humanoid robot. Therefore, a gesture is a control commend of a robotic motion. Based on such translation, a human can only use his/her hands and upper body to play soccer but in humanoid robot. From the experimental results, it demonstrates the satisfactory interactive human–robot soccer processes.

[1]  Mario Fernando Montenegro Campos,et al.  Real-Time Gesture Recognition from Depth Data through Key Poses Learning and Decision Forests , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[2]  B. Watanapa,et al.  Human gesture recognition using Kinect camera , 2012, 2012 Ninth International Conference on Computer Science and Software Engineering (JCSSE).

[3]  Albert Ali Salah,et al.  Auto-evaluation of motion imitation in a child-robot imitation game for upper arm rehabilitation , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[4]  Mitsutaka Hikita,et al.  Robot finger design for myoelectric prosthetic hand and recognition of finger motions via surface EMG , 2010, 2010 IEEE International Conference on Automation and Logistics.

[5]  Honghai Liu,et al.  Intelligent computational control of multi-fingered dexterous robotic hand , 2015 .

[6]  Joo-Ho Lee,et al.  Full-body imitation of human motions with kinect and heterogeneous kinematic structure of humanoid robot , 2012, 2012 IEEE/SICE International Symposium on System Integration (SII).

[7]  Alessandra Pedrocchi,et al.  Robustness and Reliability of Synergy-Based Myocontrol of a Multiple Degree of Freedom Robotic Arm , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Marek R. Ogiela,et al.  Rule-based approach to recognizing human body poses and gestures in real time , 2013, Multimedia Systems.

[9]  Tanja Schultz,et al.  Recognizing Hand and Finger Gestures with IMU based Motion and EMG based Muscle Activity Sensing , 2015, BIOSIGNALS.

[10]  Danica Kulic,et al.  Human Motion Imitation , 2018, Humanoid Robotics: A Reference.

[11]  Ricardo Carelli,et al.  Human-machine interfaces based on EMG and EEG applied to robotic systems , 2008, Journal of NeuroEngineering and Rehabilitation.