Human Motion Prediction using Semi-adaptable Neural Networks

Human motion prediction is an important component to facilitate human robot interaction. Robots need to accurately predict human's future movement in order to safely plan its own motion trajectories and efficiently collaborate with humans. Many recent approaches predict human's movement using deep learning methods, such as recurrent neural networks. However, existing methods lack the ability to adapt to time-varying human behaviors, and many of them do not quantify uncertainties in the prediction. This paper proposes an approach that uses a semi-adaptable neural network for human motion prediction, and provides uncertainty bounds of the predictions in real time. In particular, a neural network is trained offline to represent the human motion transition model, and then recursive least square parameter adaptation algorithm (RLS-PAA) is adopted for online parameter adaptation of the neural network and for uncertainty estimation. Experiments on several human motion datasets verify that the proposed method significantly outperforms the state-of-the-art approach in terms of prediction accuracy and computation efficiency.

[1]  Ling Shao,et al.  Leveraging Hierarchical Parametric Networks for Skeletal Joints Based Action Segmentation and Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Silvio Savarese,et al.  Social LSTM: Human Trajectory Prediction in Crowded Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Daniel A. Braun,et al.  Assessing randomness and complexity in human motion trajectories through analysis of symbolic sequences , 2014, Front. Hum. Neurosci..

[4]  Geoffrey J. Gordon,et al.  Better Motion Prediction for People-tracking , 2004 .

[5]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH Classes.

[6]  Ashwin P. Dani,et al.  Human Intention Inference Using Expectation-Maximization Algorithm With Online Model Learning , 2017, IEEE Transactions on Automation Science and Engineering.

[7]  Otmar Hilliges,et al.  Learning Human Motion Models for Long-Term Predictions , 2017, 2017 International Conference on 3D Vision (3DV).

[8]  Masayoshi Tomizuka,et al.  SERoCS: Safe and Efficient Robot Collaborative Systems for Next Generation Intelligent Industrial Co-Robots , 2018, ArXiv.

[9]  James J. Little,et al.  3D Pose from Motion for Cross-View Action Recognition via Non-linear Circulant Temporal Encoding , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[11]  Markus Kohler,et al.  Using the Kalman Filter to track Human Interactive Motion - Modelling and Initialization of the Kalm , 1997 .

[12]  Kimitoshi Yamazaki,et al.  Home-Assistant Robot for an Aging Society , 2012, Proceedings of the IEEE.

[13]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[14]  Stefan Schaal,et al.  STOMP: Stochastic trajectory optimization for motion planning , 2011, 2011 IEEE International Conference on Robotics and Automation.

[15]  Robert O. Ambrose,et al.  Robonaut 2 - The first humanoid robot in space , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  N. Troje Decomposing biological motion: a framework for analysis and synthesis of human gait patterns. , 2002, Journal of vision.

[17]  Keegan Kang,et al.  Feature Representation in Convolutional Neural Networks , 2015, ArXiv.

[18]  Masayoshi Tomizuka,et al.  Safe exploration: Addressing various uncertainty levels in human robot interactions , 2015, 2015 American Control Conference (ACC).