Cost-Based Goal Recognition Meets Deep Learning

The ability to observe the effects of actions performed by others and to infer their intent, most likely goals, or course of action, is known as a plan or intention recognition cognitive capability and has long been one of the fundamental research challenges in AI. Deep learning has recently been making significant inroads on various pattern recognition problems, except for intention recognition. While extensively explored since the seventies, the problem remains unsolved for most interesting cases in various areas, ranging from natural language understanding to human behavior understanding based on video feeds. This paper compares symbolic inverse planning, one of the most investigated approaches to goal recognition, to deep learning using CNN and LTSM neural network architectures, on five synthetic benchmarks often used in the literature. The results show that the deep learning approach achieves better goal-prediction accuracy and timeliness than the symbolic cost-based plan recognizer in these domains. Although preliminary, these results point to interesting future research avenues.

[1]  R. Goldman,et al.  Requirements for Plan Recognition in Network Security Systems , 2003 .

[2]  Razvan Pascanu,et al.  Visual Interaction Networks: Learning a Physics Simulator from Video , 2017, NIPS.

[3]  Jiebo Luo,et al.  Unsupervised Deep Learning of Mid-Level Video Representation for Action Recognition , 2018, AAAI.

[4]  Cen Chen,et al.  AntProphet: an Intention Mining System behind Alipay's Intelligent Customer Service Bot , 2019, IJCAI.

[5]  David E. Smith,et al.  A Fast Goal Recognition Technique Based on Interaction Estimates , 2015, IJCAI.

[6]  Robert P. Goldman,et al.  A Bayesian Model of Plan Recognition , 1993, Artif. Intell..

[7]  Sebastian Sardiña,et al.  Cost-Based Goal Recognition for Path-Planning , 2017, AAMAS.

[8]  Svetha Venkatesh,et al.  Policy Recognition in the Abstract Hidden Markov Model , 2002, J. Artif. Intell. Res..

[9]  Robert P. Goldman,et al.  Plan, Activity, and Intent Recognition: Theory and Practice , 2014 .

[10]  Chris L. Baker,et al.  Action understanding as inverse planning , 2009, Cognition.

[11]  Jonathan P. Rowe,et al.  Deep Learning-Based Goal Recognition in Open-Ended Digital Games , 2014, AIIDE.

[12]  Robert P. Goldman,et al.  A probabilistic plan recognition algorithm based on plan tree grammars , 2009, Artif. Intell..

[13]  Tsung-Hsien Wen,et al.  Latent Intention Dialogue Models , 2017, ICML.

[14]  Hector Geffner,et al.  Probabilistic Plan Recognition Using Off-the-Shelf Classical Planners , 2010, AAAI.

[15]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[16]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[17]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[18]  Andrew Zisserman,et al.  Two-Stream Convolutional Networks for Action Recognition in Videos , 2014, NIPS.

[19]  Pieter Abbeel,et al.  Value Iteration Networks , 2016, NIPS.

[20]  Sebastian Sardiña,et al.  Cost-Based Goal Recognition in Navigational Domains , 2019, J. Artif. Intell. Res..

[21]  James M. Rehg,et al.  A Scalable Approach to Activity Recognition based on Object Use , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  Hugo Larochelle,et al.  Using a Recursive Neural Network to Learn an Agent's Decision Model for Plan Recognition , 2015, IJCAI.

[23]  Hector Geffner,et al.  Plan Recognition as Planning , 2009, IJCAI.

[24]  Gregory F. Cooper,et al.  The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks , 1990, Artif. Intell..

[25]  Felipe Meneguzzi,et al.  LSTM-Based Goal Recognition in Latent Space , 2018, ArXiv.

[26]  Gal A. Kaminka,et al.  Heuristic Online Goal Recognition in Continuous Domains , 2017, IJCAI.

[27]  Roland Siegwart,et al.  A data-driven approach for pedestrian intention estimation , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[28]  Alex S. Fukunaga,et al.  Classical Planning in Deep Latent Space: Bridging the Subsymbolic-Symbolic Boundary , 2017, AAAI.

[29]  Shirin Sohrabi,et al.  Plan Recognition as Planning Revisited , 2016, IJCAI.

[30]  Jeremy S. Smith,et al.  Driver behavior recognition based on deep convolutional neural networks , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[31]  Roger Leitzke Granada,et al.  Hybrid Activity and Plan Recognition for Video Streams , 2017, AAAI Workshops.

[32]  Felipe Meneguzzi,et al.  Landmark-Based Heuristics for Goal Recognition , 2017, AAAI.

[33]  Jonathan P. Rowe,et al.  Player Goal Recognition in Open-World Digital Games with Long Short-Term Memory Networks , 2016, IJCAI.

[34]  N. S. Sridharan,et al.  The Plan Recognition Problem: An Intersection of Psychology and Artificial Intelligence , 1978, Artif. Intell..

[35]  Henry A. Kautz,et al.  Recognizing Multi-Agent Activities from GPS Data , 2010, AAAI.