Adaptive human motion analysis and prediction

Human motion analysis and prediction is an active research area where predicting human motion is often performed for a single time step based on historical motion. In recent years, longer term human motion prediction has been attempted over a number of future time steps. Most current methods learn motion patterns (MPs) from observed trajectories and then use them for prediction. However, these learned MPs may not be indicative due to inadequate observation, which naturally affects the reliability of motion prediction. In this paper, we present an adaptive human motion analysis and prediction method. It adaptively predicts motion based on the classified MPs in terms of their credibility, which refers to how indicative the learned MPs are for the specific environment. The main contributions of the proposed method are as follows: First, it provides a comprehensive description of MPs including not only the learned MPs but also their evaluated credibility. Second, it predicts long-term future motion with reasonable accuracy. A number of experiments have been conducted in simulated scenes and real-world scenes and the prediction results have been quantitatively evaluated. The results show that the proposed method is effective and superior in its performance when compared with a recursively applied Auto-Regressive (AR) model, which is called the Recursive Short-term Predictor (RSP) for long-term prediction. The proposed method has 17.73% of improvement over the RSP in prediction accuracy in the experiment with the best performance. On average, the proposed method has 5% improvement over the RSP in prediction accuracy over 10 experiments.

[1]  Christian Laugier,et al.  Intentional motion on-line learning and prediction , 2008, Machine Vision and Applications.

[2]  Ernst D. Dickmanns,et al.  An integrated spatio-temporal approach to automatic visual guidance of autonomous vehicles , 1990, IEEE Trans. Syst. Man Cybern..

[3]  Zhouyu Fu,et al.  Semantic-Based Surveillance Video Retrieval , 2007, IEEE Transactions on Image Processing.

[4]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[5]  Lu Wang,et al.  Crowd counting and segmentation in visual surveillance , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[6]  Tieniu Tan,et al.  A system for learning statistical motion patterns , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Wei Hu,et al.  A Coarse-to-Fine Strategy for Vehicle Motion Trajectory Clustering , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[8]  Cang. Ye,et al.  Behavior-based fuzzy navigation of mobile vehicle in unknown and dynamically changing environment , 1999 .

[9]  Ashraf Elnagar,et al.  Prediction of moving objects in dynamic environments using Kalman filters , 2001, Proceedings 2001 IEEE International Symposium on Computational Intelligence in Robotics and Automation (Cat. No.01EX515).

[10]  Lu Wang,et al.  Detection Based Low Frame Rate Human Tracking , 2010, 2010 20th International Conference on Pattern Recognition.

[11]  H. C. Yung,et al.  Segmentation of color images based on the gravitational clustering concept , 1998 .

[12]  Mubarak Shah,et al.  Multi feature path modeling for video surveillance , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[13]  Mohan M. Trivedi,et al.  Learning trajectory patterns by clustering: Experimental studies and comparative evaluation , 2009, CVPR.

[14]  Debasish Ghose,et al.  Obstacle avoidance in a dynamic environment: a collision cone approach , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[15]  Lu Wang,et al.  Extraction of Moving Objects From Their Background Based on Multiple Adaptive Thresholds and Boundary Evaluation , 2010, IEEE Transactions on Intelligent Transportation Systems.

[16]  Jean-Philippe Thiran,et al.  Multi-Layer Hierarchical Clustering of Pedestrian Trajectories for Automatic Counting of People in Video Sequences , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[17]  Ramakant Nevatia,et al.  Robust Object Tracking by Hierarchical Association of Detection Responses , 2008, ECCV.

[18]  W. Eric L. Grimson,et al.  Learning Semantic Scene Models by Trajectory Analysis , 2006, ECCV.

[19]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Qiuming Zhu,et al.  Hidden Markov model for dynamic obstacle avoidance of mobile robot navigation , 1991, IEEE Trans. Robotics Autom..

[21]  Jun Tani,et al.  Model-based learning for mobile robot navigation from the dynamical systems perspective , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[22]  Vijay S. Rajpurohit,et al.  An Optimized Fuzzy Based Short Term Object Motion Prediction for Real-Life Robot Navigation Environment , 2008, VISUAL.

[23]  Christian Laugier,et al.  Incremental Learning of Statistical Motion Patterns With Growing Hidden Markov Models , 2007, IEEE Transactions on Intelligent Transportation Systems.

[24]  Panos E. Trahanias,et al.  Predictive autonomous robot navigation , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  N. H. C. Yung,et al.  Behavior Prediction Based on Obstacle Motion Patterns in Dynamically Changing Environments , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[26]  Wolfram Burgard,et al.  Learning Motion Patterns of People for Compliant Robot Motion , 2005, Int. J. Robotics Res..

[27]  Zhihua Qu,et al.  A new analytical solution to mobile robot trajectory generation in the presence of moving obstacles , 2004, IEEE Transactions on Robotics.

[28]  Tim J. Ellis,et al.  Spatial and Probabilistic Modelling of Pedestrian Behaviour , 2002, BMVC.