Full-body multi-primitive segmentation using classifiers

During human-robot interaction, the robot observes a continuous stream of time-series data capturing the behaviour of the human and any changes in the environment. For applications such as imitation learning, intention and gesture recognition, the time-series data is typically segmented into action or motion primitives, requiring accurate and online temporal segmentation. This paper casts the time-series segmentation problem into a two-class classification problem, labelling each data point as either a segment edge or a within-segment point, and applies several common classifiers to a set of full body motion data. The support vector machine combined with principal component analysis dimensionality reduction were found to perform best, with a classification F1 score of 91% when applied to novel exemplars. The proposed approach can also generalize to motions unseen during training, achieving a classification F1 score of 83% when applied to novel motions.

[1]  Cynthia Breazeal,et al.  Improvements on action parsing and action interpolation for learning through demonstration , 2004, 4th IEEE/RAS International Conference on Humanoid Robots, 2004..

[2]  Jonathan Feng-Shun Lin,et al.  Online Segmentation of Human Motion for Automated Rehabilitation Exercise Analysis , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Dana Kulic,et al.  Online Segmentation and Clustering From Continuous Observation of Whole Body Motions , 2009, IEEE Transactions on Robotics.

[4]  J. Mark Introduction to radial basis function networks , 1996 .

[5]  Cordelia Schmid,et al.  Learning realistic human actions from movies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Kristof Van Laerhoven,et al.  Detecting leisure activities with dense motif discovery , 2012, UbiComp.

[7]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[8]  Darwin G. Caldwell,et al.  Learning and Reproduction of Gestures by Imitation , 2010, IEEE Robotics & Automation Magazine.

[9]  Lie Lu,et al.  Content-based audio segmentation using support vector machines , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[10]  Rüdiger Dillmann,et al.  Advances in Robot Programming by Demonstration , 2010, KI - Künstliche Intelligenz.

[11]  Taghi M. Khoshgoftaar,et al.  Resampling or Reweighting: A Comparison of Boosting Implementations , 2008, 2008 20th IEEE International Conference on Tools with Artificial Intelligence.

[12]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[13]  M G Pandy,et al.  Computer modeling and simulation of human movement. , 2001, Annual review of biomedical engineering.

[14]  Andrea Lockerd Thomaz,et al.  Effects of nonverbal communication on efficiency and robustness in human-robot teamwork , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[16]  I K Fodor,et al.  A Survey of Dimension Reduction Techniques , 2002 .

[17]  Xindong Wu,et al.  10 Challenging Problems in Data Mining Research , 2006, Int. J. Inf. Technol. Decis. Mak..

[18]  Maja J. Mataric,et al.  Automated Derivation of Primitives for Movement Classification , 2000, Auton. Robots.

[19]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[20]  Dana Kulic,et al.  Human motion segmentation by data point classification , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  Andrea Lockerd Thomaz,et al.  Teachable robots: Understanding human teaching behavior to build more effective robot learners , 2008, Artif. Intell..

[22]  Maja J. Matarić,et al.  Behavior-Based Segmentation of Demonstrated Task , 2006 .

[23]  Kevin Murphy,et al.  Bayes net toolbox for Matlab , 1999 .

[24]  Abraham Kandel,et al.  Data Mining in Time Series Database , 2004 .

[25]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[26]  Eric O. Postma,et al.  Dimensionality Reduction: A Comparative Review , 2008 .

[27]  Daniel P. Siewiorek,et al.  Performance Analysis of an HMM-Based Gesture Recognition Using a Wristwatch Device , 2009, 2009 International Conference on Computational Science and Engineering.

[28]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Ales Ude,et al.  A Simple Ontology of Manipulation Actions Based on Hand-Object Relations , 2013, IEEE Transactions on Autonomous Mental Development.

[30]  Anil K. Jain,et al.  Artificial Neural Networks: A Tutorial , 1996, Computer.