A two-layer semi-Markov model for recognizing the destination of a moving agent

Recognizing the destination of a moving agent is quite significant in many systems such as real time strategy games. Probabilistic graphical models are widely used to solve this problem, but existing models cannot recognize the changeable destination with noisy and partially missing observations in a grid based map. To solve this problem, a two-layer semi-Markov model (TLSMM) is proposed. In this model, two layers represent the transition of destinations and the grids where the agent is respectively; the duration of being in one grid is modeled by a discrete Coxian distribution. The particle filtering is also used to solve inference problem of TLSMM with noisy and partial data. In experiments, we simulate an agent's movements in an urban field and employ the agent's traces to evaluate the performance of TLSMM and PF. The results indicate that no matter the destination changes or not, our methods can effectively recognize it. In addition, through comparing the metrics like precision, recall, and F-measure of our model and a two-layer Markov model, we conclude that the explicit duration modeling improves the recognizing performance when the agent is not closed to the destination.

[1]  Svetha Venkatesh,et al.  Tracking and Surveillance in Wide-Area Spatial Environments Using the Abstract Hidden Markov Model , 2001, Int. J. Pattern Recognit. Artif. Intell..

[2]  Zha Ya-bing,et al.  Tactical intention recognition based on multi-entity Bayesian network , 2010 .

[3]  Yiannis Demiris,et al.  Partial observability during predictions of the opponent's movements in an RTS game , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[4]  Svetha Venkatesh,et al.  Policy Recognition in the Abstract Hidden Markov Model , 2002, J. Artif. Intell. Res..

[5]  Nando de Freitas,et al.  Rao-Blackwellised Particle Filtering for Dynamic Bayesian Networks , 2000, UAI.

[6]  Subrata Das,et al.  Factored reasoning for monitoring dynamic team and goal formation , 2009, Inf. Fusion.

[7]  Kalyan Moy Gupta,et al.  Maritime Threat Detection Using Probabilistic Graphical Models , 2012, FLAIRS Conference.

[8]  Yue Shiguan Path plan recognition by CGF based on abstract hidden Markov model , 2014 .

[9]  Nadia Maïzi,et al.  Securing harbors by modeling and classifying ship behavior , 2011 .

[10]  Svetha Venkatesh,et al.  Efficient duration and hierarchical modeling for human activity recognition , 2009, Artif. Intell..

[11]  Gwenn Englebienne,et al.  UvA-DARE ( Digital Academic Repository ) Activity recognition using semi-Markov models on real world smart home datasets , 2010 .

[12]  Hung Hai Bui,et al.  A General Model for Online Probabilistic Plan Recognition , 2003, IJCAI.

[13]  Finnegan Southey,et al.  Inferring Complex Agent Motions from Partial Trajectory Observations , 2007, IJCAI.