Arm gesture recognition and humanoid imitation using functional principal component analysis

A method is proposed for gesture recognition and humanoid imitation based on Functional Principal Component Analysis (FPCA). FPCA is a statistical technique of functional data analysis that has never been applied before for humanoid imitation. In functional data analysis data (e.g. gestures) are functions that can be considered as observations of a random variable on a functional space. FPCA is an extension of multivariate PCA that provides functional principal components which describe the modes of variation in the data. In the proposed approach FPCA is used for both unsupervised clustering of training data and gesture recognition. In this work we focus on arm gesture recognition. Human hand paths in Cartesian space are reconstructed from inertial sensors. Recognized gestures are reproduced by a small humanoid robot. The FPCA algorithm has also been compared to a state of the art algorithm for gesture classification based on Dynamic Time Warping (DTW). Results indicate that, in this domain, the FPCA algorithm achieves a comparable recognition rate while it outperforms DTW in terms of efficiency in execution time.

[1]  Ales Ude,et al.  Motion imitation and recognition using parametric hidden Markov models , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[2]  Jizhou Sun,et al.  A Motion Retargeting Method for Topologically Different Characters , 2009, 2009 Sixth International Conference on Computer Graphics, Imaging and Visualization.

[3]  Yoshihiko Nakamura,et al.  Humanoid Robot's Autonomous Acquisition of Proto-Symbols through Motion Segmentation , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[4]  Yoshihiko Nakamura,et al.  Imitation and primitive symbol acquisition of humanoids by the integrated mimesis loop , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[5]  ZhiDong Xiao,et al.  Control of motion in character animation , 2004 .

[6]  Stefano Caselli,et al.  Trajectory clustering and stochastic approximation for robot programming by demonstration , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Eiichi Yoshida,et al.  On human motion imitation by humanoid robot , 2008, 2008 IEEE International Conference on Robotics and Automation.

[8]  Panos E. Trahanias,et al.  Gesture recognition based on arm tracking for human-robot interaction , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Christopher G. Atkeson,et al.  Adapting human motion for the control of a humanoid robot , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[10]  Sethu Vijayakumar,et al.  Latent spaces for dynamic movement primitives , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[11]  Rajesh P. N. Rao,et al.  Robotic imitation from human motion capture using Gaussian processes , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[12]  Weihua Sheng,et al.  Imitation learning of hand gestures and its evaluation for humanoid robots , 2010, The 2010 IEEE International Conference on Information and Automation.

[13]  M. Urban,et al.  Recognition of arm gestures using multiple orientation sensors: repeatability assessment , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[14]  Shahrokh Valaee,et al.  A Novel Accelerometer-Based Gesture Recognition System , 2011, IEEE Transactions on Signal Processing.

[15]  Frank Chongwoo Park,et al.  Natural Movement Generation Using Hidden Markov Models and Principal Components , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Aude Billard,et al.  Goal-Directed Imitation in a Humanoid Robot , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[17]  Behzad Dariush,et al.  Online and markerless motion retargeting with kinematic constraints , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Makoto Sato,et al.  "Do Like Me", "Do Like This": Creating Animations by Teaching a Virtual Human , 2007, IEEE International Conference on Shape Modeling and Applications 2007 (SMI '07).

[19]  Shahrokh Valaee,et al.  Accelerometer-based gesture recognition via dynamic-time warping, affinity propagation, & compressive sensing , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[20]  Bernt Schiele,et al.  A new approach to enable gesture recognition in continuous data streams , 2008, 2008 12th IEEE International Symposium on Wearable Computers.

[21]  Yoshihiko Nakamura,et al.  Motion capture based human motion recognition and imitation by direct marker control , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[22]  ChangHwan Kim,et al.  Human-like Arm Motion Generation for Humanoid Robots Using Motion Capture Database , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Alejandro Hernández Arieta,et al.  Gesture recognition in upper-limb prosthetics: A viability study using dynamic time warping and gyroscopes , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[24]  Joan Climent,et al.  A Performance Evaluation of HMM and DTW for Gesture Recognition , 2012, CIARP.

[25]  Dana Kulic,et al.  Incremental Learning, Clustering and Hierarchy Formation of Whole Body Motion Patterns using Adaptive Hidden Markov Chains , 2008, Int. J. Robotics Res..

[26]  Samsu Sempena,et al.  Human action recognition using Dynamic Time Warping , 2011, Proceedings of the 2011 International Conference on Electrical Engineering and Informatics.

[27]  Masayuki Inaba,et al.  Intent imitation using wearable motion capturing system with on-line teaching of task attention , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[28]  Markus H. Gross,et al.  A Framework for 3D Spatial Gesture Design and Modeling Using a Wearable Input Device , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[29]  Paulo Menezes,et al.  A single camera motion capture system dedicated to gestures imitation , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[30]  Ales Ude,et al.  Enabling real-time full-body imitation: a natural way of transferring human movement to humanoids , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[31]  Aude Billard,et al.  Stochastic gesture production and recognition model for a humanoid robot , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[32]  Jun Tani,et al.  On-line imitative interaction with a humanoid robot using a mirror neuron model , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[33]  Andrew T. Irish,et al.  Trajectory Learning for Robot Programming by Demonstration Using Hidden Markov Model and Dynamic Time Warping , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  Joris De Schutter,et al.  Recognition of 6 DOF rigid body motion trajectories using a coordinate-free representation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[35]  Maja J. Mataric,et al.  Generating and recognizing free-space movements in humanoid robots , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[36]  B. Silverman,et al.  Functional Data Analysis , 1997 .