Human motion segmentation using cost weights recovered from inverse optimal control

A common hypothesis in human motor control is that human movement is generated by optimizing with respect to a certain criterion and is task dependent. In this paper, a method to segment human movement by detecting changes to the optimization criterion being used via inverse optimal control is proposed. The control strategy employed by the motor system is hypothesized to be a weighted sum of basis cost functions, with the basis weights changing with changes to the motion objective(s). Continuous time series data of movement is processed using a sliding fixed width window, estimating the basis weights of each cost function for each window by minimizing the Karush-Kuhn-Tucker optimality conditions. The quality of the cost function recovery is verified by evaluating the residual. The successfully estimated basis weights are averaged together to create a set of time varying basis weights that describe the changing control strategy of the motion and can be used to segment the movement with simple thresholds. The proposed algorithm is first demonstrated on simulation data and then demonstrated on a dataset of human subjects performing a series of squatting tasks. The proposed approach reliably identifies the squatting movements, achieving a segmentation accuracy of 84%.

[1]  Gianni Ferretti,et al.  Generation of human walking paths , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Timothy Bretl,et al.  A convex approach to inverse optimal control and its application to modeling human locomotion , 2012, 2012 IEEE International Conference on Robotics and Automation.

[3]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[4]  Yeti Li,et al.  Automated Rehabilitation System: Movement Measurement and Feedback for Patients and Physiotherapists in the Rehabilitation Clinic , 2016, Hum. Comput. Interact..

[5]  M. Spong,et al.  Robot Modeling and Control , 2005 .

[6]  Adina M. Panchea Inverse optimal control for redundant systems of biological motion , 2015 .

[7]  E. Todorov Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[8]  R. McN. Alexander,et al.  The Gaits of Bipedal and Quadrupedal Animals , 1984 .

[9]  Dana Kulic,et al.  Online Segmentation and Clustering From Continuous Observation of Whole Body Motions , 2009, IEEE Transactions on Robotics.

[10]  Ramakant Nevatia,et al.  Recognition and Segmentation of 3-D Human Action Using HMM and Multi-class AdaBoost , 2006, ECCV.

[11]  Jonathan Feng-Shun Lin,et al.  Online Segmentation of Human Motion for Automated Rehabilitation Exercise Analysis , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Jean-Paul Laumond,et al.  From human to humanoid locomotion—an inverse optimal control approach , 2010, Auton. Robots.

[13]  Katja D. Mombaur,et al.  Inverse optimal control based identification of optimality criteria in whole-body human walking on level ground , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[14]  Jorge Nocedal,et al.  A trust region method based on interior point techniques for nonlinear programming , 2000, Math. Program..

[15]  Timothy Bretl,et al.  Inverse optimal control for differentially flat systems with application to locomotion modeling , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Darwin G. Caldwell,et al.  Learning and Reproduction of Gestures by Imitation , 2010, IEEE Robotics & Automation Magazine.

[17]  Francesco Nori,et al.  Evidence for Composite Cost Functions in Arm Movement Planning: An Inverse Optimal Control Approach , 2011, PLoS Comput. Biol..

[18]  Andrea Lockerd Thomaz,et al.  Effects of nonverbal communication on efficiency and robustness in human-robot teamwork , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  L. Chèze,et al.  Adjustments to McConville et al. and Young et al. body segment inertial parameters. , 2007, Journal of Biomechanics.

[20]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[21]  Michelle Karg,et al.  Movement Primitive Segmentation for Human Motion Modeling: A Framework for Analysis , 2016, IEEE Transactions on Human-Machine Systems.

[22]  Stephen P. Boyd,et al.  Imputing a convex objective function , 2011, 2011 IEEE International Symposium on Intelligent Control.

[23]  Gentiane Venture,et al.  Human arm optimal motion analysis in industrial screwing task , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[24]  Dana Kulic,et al.  Segmentation of Human Body Movement Using Inertial Measurement Unit , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[25]  Michael Ulbrich,et al.  Imitating human reaching motions using physically inspired optimization principles , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[26]  L. A. Colby,et al.  Therapeutic Exercise: Foundations and Techniques , 1990 .

[27]  Peter Englert,et al.  Inverse KKT - Learning Cost Functions of Manipulation Tasks from Demonstrations , 2017, ISRR.

[28]  Faicel Chamroukhi,et al.  Joint segmentation of multivariate time series with hidden process regression for human activity recognition , 2013, Neurocomputing.

[29]  Philip E. Gill,et al.  Practical optimization , 1981 .

[30]  C. Mazzà,et al.  A least-squares identification algorithm for estimating squat exercise mechanics using a single inertial measurement unit. , 2012, Journal of biomechanics.

[31]  Nacim Ramdani,et al.  Towards solving inverse optimal control in a bounded-error framework , 2015, 2015 American Control Conference (ACC).

[32]  Dan Schonfeld,et al.  HMM-based motion recognition system using segmented PCA , 2005, IEEE International Conference on Image Processing 2005.

[33]  Katja D. Mombaur,et al.  A new template model for optimization studies of human walking on different terrains , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[34]  Wisama Khalil,et al.  SYMORO+: A system for the symbolic modelling of robots , 1997, Robotica.

[35]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.